Benchmarks by Michael Larabel for a future article. 2 x Intel Xeon Max 9480 testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2405073-NE-UPLOAD15789 2024 Server CPUs - Phoronix Test Suite 2024 Server CPUs Benchmarks by Michael Larabel for a future article. 2 x Intel Xeon Max 9480 testing with a Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2405073-NE-UPLOAD15789&sor&grr .
2024 Server CPUs Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Intel Xeon Platinum 8490H @ 3.50GHz (60 Cores / 120 Threads) Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) Intel Device 1bce 512GB 2 x 1920GB KIOXIA KCD8XPUG1T92 ASPEED Ubuntu 24.04 6.9.0-060900rc3-generic (x86_64) GCC 13.2.0 ext4 1920x1200 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads) 1008GB 2 x Intel X710 for 10GBASE-T INTEL XEON PLATINUM 8592+ @ 3.90GHz (64 Cores / 128 Threads) 512GB 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads) 1008GB 2 x Intel X710 for 10GBASE-T Intel Xeon Max 9468 @ 3.50GHz (48 Cores / 96 Threads) 576GB 2 x Intel Xeon Max 9468 @ 3.50GHz (96 Cores / 192 Threads) 1136GB 2 x Intel X710 for 10GBASE-T Intel Xeon Max 9480 @ 3.50GHz (56 Cores / 112 Threads) 576GB 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads) 1136GB 2 x Intel X710 for 10GBASE-T OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Xeon Platinum 8490H: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590 - Xeon Platinum 8490H 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b000590 - Xeon Platinum 8592+: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200 - Xeon Platinum 8592+ 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000200 - Xeon Max 9468: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Xeon Max 9468 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Xeon Max 9480: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 - Xeon Max 9480 2P: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2c000290 Java Details - OpenJDK Runtime Environment (build 21.0.3-ea+7-Ubuntu-1build1) Python Details - Python 3.12.2 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
2024 Server CPUs wrf: conus 2.5km openvkl: vklBenchmarkCPU ISPC askap: tConvolve MT - Degridding nwchem: C240 Buckyball relion: Basic - CPU easywave: e2Asean Grid + BengkuluSept2007 Source - 2400 askap: tConvolve MT - Gridding cockroach: KV, 95% Reads - 512 brl-cad: VGR Performance Metric cockroach: KV, 60% Reads - 512 pgbench: 100 - 1000 - Read Only - Average Latency pgbench: 100 - 1000 - Read Only tensorflow: CPU - 512 - ResNet-50 cloverleaf: clover_bm16 namd: STMV with 1,066,628 Atoms hpcg: 144 144 144 - 60 apache-iotdb: 500 - 100 - 800 - 400 apache-iotdb: 500 - 100 - 800 - 400 clickhouse: 100M Rows Hits Dataset, Third Run clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache openssl: RSA4096 openssl: RSA4096 tensorflow: CPU - 256 - ResNet-50 build-linux-kernel: allmodconfig incompact3d: X3D-benchmarking input.i3d stockfish: Chess Benchmark securemark: SecureMark-TLS apache-iotdb: 800 - 100 - 800 - 100 apache-iotdb: 800 - 100 - 800 - 100 cockroach: KV, 50% Reads - 512 pytorch: CPU - 64 - ResNet-152 luxcorerender: Danish Mood - CPU build-gem5: Time To Compile rocksdb: Read While Writing lammps: 20k Atoms blender: Barbershop - CPU-Only llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPU build-nodejs: Time To Compile onnx: fcn-resnet101-11 - CPU - Standard onnx: fcn-resnet101-11 - CPU - Standard duckdb: TPC-H Parquet easywave: e2Asean Grid + BengkuluSept2007 Source - 1200 openradioss: Chrysler Neon 1M luxcorerender: DLSC - CPU ffmpeg: libx265 - Upload onnx: yolov4 - CPU - Standard onnx: yolov4 - CPU - Standard openssl: AES-128-GCM openssl: AES-256-GCM openssl: ChaCha20-Poly1305 openssl: SHA512 openssl: ChaCha20 openssl: SHA256 speedb: Rand Read ffmpeg: libx265 - Video On Demand ffmpeg: libx265 - Platform pytorch: CPU - 512 - ResNet-152 compress-zstd: 19 - Decompression Speed compress-zstd: 19 - Compression Speed onednn: Recurrent Neural Network Inference - CPU john-the-ripper: MD5 pytorch: CPU - 256 - ResNet-152 ospray: particle_volume/scivis/real_time duckdb: IMDB ospray: particle_volume/pathtracer/real_time ospray: gravity_spheres_volume/dim_512/scivis/real_time luxcorerender: Orange Juice - CPU build-llvm: Ninja namd: ATPase with 327,506 Atoms vvenc: Bosphorus 4K - Fast numpy: pytorch: CPU - 512 - ResNet-50 luxcorerender: LuxCore Benchmark - CPU openfoam: drivaerFastback, Medium Mesh Size - Execution Time openfoam: drivaerFastback, Medium Mesh Size - Mesh Time pgbench: 100 - 1000 - Read Write - Average Latency pgbench: 100 - 1000 - Read Write openradioss: Rubber O-Ring Seal Installation openradioss: INIVOL and Fluid Structure Interaction Drop Container compress-zstd: 19, Long Mode - Decompression Speed compress-zstd: 19, Long Mode - Compression Speed build-godot: Time To Compile xmrig: GhostRider - 1M tensorflow: CPU - 512 - GoogLeNet onnx: CaffeNet 12-int8 - CPU - Standard onnx: CaffeNet 12-int8 - CPU - Standard onnx: GPT-2 - CPU - Standard onnx: GPT-2 - CPU - Standard onnx: T5 Encoder - CPU - Parallel onnx: T5 Encoder - CPU - Parallel openradioss: Bird Strike on Windshield qmcpack: Li2_STO_ae appleseed: Material Tester onnx: ArcFace ResNet-100 - CPU - Standard onnx: ArcFace ResNet-100 - CPU - Standard ospray: gravity_spheres_volume/dim_512/ao/real_time ospray: particle_volume/ao/real_time onednn: Recurrent Neural Network Training - CPU speedb: Read While Writing memcached: 1:100 dacapobench: Tradesoap onnx: ResNet50 v1-12-int8 - CPU - Standard onnx: ResNet50 v1-12-int8 - CPU - Standard onnx: super-resolution-10 - CPU - Standard onnx: super-resolution-10 - CPU - Standard pytorch: CPU - 1 - ResNet-152 onnx: bertsquad-12 - CPU - Standard onnx: bertsquad-12 - CPU - Standard openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU onnx: T5 Encoder - CPU - Standard onnx: T5 Encoder - CPU - Standard build-python: Released Build, PGO + LTO Optimized appleseed: Emily onnx: fcn-resnet101-11 - CPU - Parallel onnx: fcn-resnet101-11 - CPU - Parallel openradioss: Bumper Beam aircrack-ng: helsing: 14 digit dacapobench: Tradebeans tensorflow: CPU - 1 - ResNet-50 tensorflow: CPU - 64 - ResNet-50 blender: Pabellon Barcelona - CPU-Only avifenc: 0 ospray-studio: 3 - 4K - 1 - Path Tracer - CPU tensorflow: CPU - 256 - GoogLeNet graphics-magick: Rotate ospray-studio: 1 - 4K - 1 - Path Tracer - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU ospray-studio: 3 - 4K - 32 - Path Tracer - CPU minibude: OpenMP - BM2 minibude: OpenMP - BM2 ospray: gravity_spheres_volume/dim_512/pathtracer/real_time ospray-studio: 1 - 4K - 32 - Path Tracer - CPU ospray-studio: 1 - 4K - 16 - Path Tracer - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU ospray-studio: 3 - 4K - 16 - Path Tracer - CPU onnx: CaffeNet 12-int8 - CPU - Parallel onnx: CaffeNet 12-int8 - CPU - Parallel openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU quantlib: Multi-Threaded onnx: Faster R-CNN R-50-FPN-int8 - CPU - Standard onnx: Faster R-CNN R-50-FPN-int8 - CPU - Standard onnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallel onnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallel jpegxl: JPEG - 90 openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU onnx: GPT-2 - CPU - Parallel onnx: GPT-2 - CPU - Parallel openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU node-web-tooling: openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU onnx: yolov4 - CPU - Parallel onnx: yolov4 - CPU - Parallel onnx: bertsquad-12 - CPU - Parallel onnx: bertsquad-12 - CPU - Parallel openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU onnx: ArcFace ResNet-100 - CPU - Parallel onnx: ArcFace ResNet-100 - CPU - Parallel openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU graphics-magick: Sharpen graphics-magick: Noise-Gaussian graphics-magick: Resizing onnx: ResNet50 v1-12-int8 - CPU - Parallel onnx: ResNet50 v1-12-int8 - CPU - Parallel graphics-magick: HWB Color Space graphics-magick: Enhanced onnx: super-resolution-10 - CPU - Parallel onnx: super-resolution-10 - CPU - Parallel graphics-magick: Swirl rocksdb: Rand Read blender: Classroom - CPU-Only pytorch: CPU - 256 - ResNet-50 pytorch: CPU - 64 - ResNet-50 cloverleaf: clover_bm64_short llamafile: llava-v1.5-7b-q4 - CPU srsran: PDSCH Processor Benchmark, Throughput Total rawtherapee: Total Benchmark Time gpaw: Carbon Nanotube vvenc: Bosphorus 4K - Faster coremark: CoreMark Size 666 - Iterations Per Second minife: Small build-php: Time To Compile john-the-ripper: WPA PSK compress-7zip: Decompression Rating compress-7zip: Compression Rating luxcorerender: Rainbow Colors and Prism - CPU liquid-dsp: 1 - 256 - 512 build-linux-kernel: defconfig webp: Quality 100, Lossless, Highest Compression tensorflow: CPU - 512 - AlexNet jpegxl: PNG - 90 primesieve: 1e13 graph500: 26 graph500: 26 graph500: 26 graph500: 26 liquid-dsp: 1 - 256 - 57 srsran: PUSCH Processor Benchmark, Throughput Total avifenc: 2 askap: tConvolve MPI - Gridding askap: tConvolve MPI - Degridding openradioss: Cell Phone Drop Test liquid-dsp: 64 - 256 - 512 liquid-dsp: 1 - 256 - 32 build-wasmer: Time To Compile pytorch: CPU - 1 - ResNet-50 appleseed: Disney Material astcenc: Very Thorough liquid-dsp: 64 - 256 - 57 uvg266: Bosphorus 4K - Slow astcenc: Exhaustive liquid-dsp: 128 - 256 - 512 svt-av1: Preset 13 - Bosphorus 4K quantlib: Single-Threaded liquid-dsp: 128 - 256 - 57 nginx: 1000 liquid-dsp: 256 - 256 - 512 blender: Junkshop - CPU-Only npb: EP.D john-the-ripper: bcrypt john-the-ripper: Blowfish liquid-dsp: 256 - 256 - 57 liquid-dsp: 256 - 256 - 32 uvg266: Bosphorus 4K - Medium liquid-dsp: 128 - 256 - 32 synthmark: VoiceMark_100 liquid-dsp: 64 - 256 - 32 blender: Fishy Cat - CPU-Only tensorflow: CPU - 1 - GoogLeNet dacapobench: Apache Lucene Search Index embree: Pathtracer ISPC - Asian Dragon Obj gromacs: MPI CPU - water_GMX50_bare svt-av1: Preset 4 - Bosphorus 4K tensorflow: CPU - 64 - GoogLeNet askap: tConvolve OpenMP - Degridding askap: tConvolve OpenMP - Gridding kvazaar: Bosphorus 4K - Slow kvazaar: Bosphorus 4K - Medium svt-av1: Preset 8 - Bosphorus 4K uvg266: Bosphorus 4K - Ultra Fast tensorflow: CPU - 256 - AlexNet minibude: OpenMP - BM1 minibude: OpenMP - BM1 tensorflow: CPU - 1 - AlexNet blender: BMW27 - CPU-Only y-cruncher: 1B openfoam: drivaerFastback, Small Mesh Size - Execution Time openfoam: drivaerFastback, Small Mesh Size - Mesh Time npb: IS.D kvazaar: Bosphorus 4K - Super Fast amg: incompact3d: input.i3d 193 Cells Per Direction build-ffmpeg: Time To Compile oidn: RTLightmap.hdr.4096x4096 - CPU-Only onednn: Deconvolution Batch shapes_1d - CPU x265: Bosphorus 4K uvg266: Bosphorus 4K - Very Fast lulesh: onednn: IP Shapes 1D - CPU tensorflow: CPU - 64 - AlexNet npb: SP.C pennant: sedovbig kvazaar: Bosphorus 4K - Ultra Fast uvg266: Bosphorus 4K - Super Fast dacapobench: Jython jpegxl: PNG - 100 build-mesa: Time To Compile pybench: Total For Average Test Times dacapobench: Apache Kafka webp: Quality 100, Lossless build-imagemagick: Time To Compile jpegxl: JPEG - 100 astcenc: Thorough npb: LU.C m-queens: Time To Solve srsran: PUSCH Processor Benchmark, Throughput Thread y-cruncher: 500M npb: CG.C kvazaar: Bosphorus 4K - Very Fast embree: Pathtracer ISPC - Asian Dragon octave-benchmark: oidn: RT.hdr_alb_nrm.3840x2160 - CPU-Only pennant: leblancbig oidn: RT.ldr_alb_nrm.3840x2160 - CPU-Only embree: Pathtracer ISPC - Crown webp: Quality 100, Highest Compression onednn: IP Shapes 3D - CPU draco: Church Facade onednn: Convolution Batch Shapes Auto - CPU mt-dgemm: Sustained Floating-Point Rate astcenc: Medium avifenc: 6, Lossless svt-av1: Preset 12 - Bosphorus 4K draco: Lion lammps: Rhodopsin Protein avifenc: 10, Lossless srsran: PDSCH Processor Benchmark, Throughput Thread primesieve: 1e12 avifenc: 6 npb: MG.C compress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img Compression onednn: Deconvolution Batch shapes_3d - CPU webp: Quality 100 build-python: Default Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P 11980.806 1734 2070.3 373.182 119.837 8088.11 131999.7 833892 116603.7 0.572 1748146 148.45 328.47 1.05274 31.0738 294.33 87797206 481.66 486.05 465.50 974189.9 27431.1 143.67 362.454 357.009712 96887479 277205 85.16 90871770 108953.6 20.13 6.85 210.934 7841738 34.892 261.97 5.85 254.003 116.315 8.59719 145.574 46.289 207.20 8.72 24.97 50.3522 19.8593 768804693697 700239352717 225038850730 22219927723 316126421173 61806994523 276179617 49.84 49.79 20.46 1032.0 14.6 409.592 9583000 20.25 21.8932 99.493 160.242 19.5762 13.46 187.017 2.97021 6.719 455.57 56.44 7.10 420.6467 160.72685 14.040 71227 59.91 140.43 1069.1 7.94 140.233 5808.8 461.23 1.17292 852.326 4.49976 222.029 3.06500 326.143 117.41 109.30 126.152247 18.9319 52.8167 19.8458 21.9324 623.604 10695360 4481667.95 4115 3.17002 315.410 4.39649 227.423 19.41 49.6376 20.1453 0.43 115106.30 2.79694 357.355 277.39 120.750285 329.036 3.03922 79.54 147469.328 93.348 7270 10.53 120.93 87.92 69.931 1977 448.46 196 1657 356.38 167.83 68006 86.967 2174.192 24.6445 58026 31380 3.58 15943.17 13.95 4209.10 36649 1.27368 784.304 16.50 3606.12 9.79 5943.66 55.99 1068.43 179647.5 29.4080 34.0021 30.9165 32.3433 43.202 100.39 298.56 5.21520 191.562 62.46 477.77 15.76 17.84 3325.90 55.1204 18.1413 62.1276 16.0956 6.43 9004.23 21.3436 46.8491 36.20 1643.43 157 158 229 3.19298 313.100 265 216 4.86604 205.525 502 265366170 68.61 54.84 56.01 39.48 20.95 24688.5 46.757 47.776 15.060 2194630.600449 35230.1 48.007 401278 287862 388190 13.54 16882333 39.450 0.52 1278.45 42.905 51.820 67074667 2616.9 37.752 21314.2 17891.6 31.49 744410000 36506000 34.933 51.46 53.490276 7.0885 2539200000 15.71 4.2689 918566667 162.474 3209.6 3181266667 1020833333 35.96 7562.80 94551 94513 3500833333 3243800000 17.85 3200600000 711.378 1890566667 34.83 33.56 3581 79.3805 8.762 7.061 380.14 30471.5 19798.5 20.23 20.97 70.908 60.87 1205.30 82.848 2071.189 56.53 25.89 7.047 42.219419 31.384585 2865.72 66.74 1605097000 12.9293413 24.056 1.29 6.15856 37.86 49.42 23072.302 0.539467 969.62 71245.26 16.03080 74.57 55.54 3801 28.100 19.226 765 5106 1.31 14.724 28.754 51.2971 135125.15 15.211 129.7 3.267 33811.63 50.03 91.9925 7.532 2.71 4.955865 2.71 70.0540 3.08 0.771506 5670 0.650618 23.543705 333.9902 6.278 164.250 4731 28.716 4.923 680.2 4.576 3.169 83448.70 2.144857 1.07743 10.11 19.201 6674.12 2716 1960.9 203.407 126.388 7630.06 82341.2 4136969 72110.1 1.293 778141 174.95 214.80 1.10900 60.8515 317.36 80169620 501.63 507.56 485.63 1916162.9 54601.1 161.06 218.570 196.808116 187761769 275472 92.23 83651785 68524.7 14.03 7.00 178.282 12321300 50.521 141.54 3.82 172.990 92.3473 10.83623 155.730 50.834 115.89 11.12 24.56 64.2858 15.5555 1533026300727 1369534328470 442202532977 42846254477 624402972947 119106802107 551286958 48.77 48.76 14.59 963.6 15.2 633.288 18166000 14.08 38.2269 125.882 149.088 35.6026 18.70 122.314 2.21948 6.480 456.18 37.55 8.82 196.49644 162.02669 14.856 67315 88.39 107.36 992.1 8.16 118.572 11263.2 576.08 1.43573 696.980 5.55101 180.032 4.05881 246.335 124.44 101.629 225.34692 27.5944 36.2493 36.1529 38.2235 635.154 17297027 3245908.40 4215 5.62517 177.763 4.72530 212.924 15.77 60.3589 16.5705 0.29 189893.31 3.46571 288.471 279.692 130.618252 352.738 2.83498 81.30 53914.933 50.831 8050 4.39 115.47 46.38 67.375 1063 528.93 172 894 283.11 423.18 38813 140.828 3520.705 42.8188 33411 14138 2.50 47654.95 15.96 7356.63 16837 1.76353 566.377 15.04 7862.58 7.72 15519.92 65.02 1843.61 350187.5 29.7536 33.6082 33.2899 30.0368 42.040 45.78 654.84 6.90619 144.640 37.58 793.64 15.49 21.73 5483.81 78.3989 12.7546 68.8299 14.5280 5.72 20937.58 34.3054 29.1487 25.12 4744.05 265 182 95 6.39031 156.461 236 342 5.29287 188.890 617 525049998 35.91 37.44 37.08 26.58 10.44 30108.7 53.758 41.563 12.536 3902076.243612 46877.5 46.644 793253 557054 592729 5.96 16843333 29.981 0.51 1899.64 40.075 27.107 66991333 4853.6 37.311 41773.0 34614.1 28.22 799496667 36461000 35.455 35.53 48.56418 13.7518 2655500000 24.71 8.3701 1126466667 154.502 3210.1 3723666667 1616966667 21.15 14946.76 183603 183583 5361266667 6116566667 27.65 3558600000 712.697 2025000000 19.13 13.50 3689 132.2806 15.450 6.698 331.76 51476.2 17010.8 31.24 32.04 65.224 55.26 1730.25 133.628 3340.694 37.57 13.74 5.008 28.556037 35.604097 3960.28 69.05 3124402667 6.39169817 19.506 2.18 16.5507 37.04 54.88 43724.062 0.783180 996.47 147311.14 11.28438 72.01 55.40 3892 27.659 18.293 767 5113 1.30 13.262 28.163 86.9845 261127.09 7.881 129.7 2.364 58128.24 67.64 152.7472 8.036 4.41 2.529807 4.48 124.7084 3.07 0.714699 5672 0.438154 45.965955 484.5499 6.172 156.516 4733 42.281 5.074 675.5 2.325 3.044 163333.21 1.469210 0.736170 10.05 18.931 10602.408 2004 1878.3 290.448 75.732 5062.07 135861.9 916904 121465.2 0.589 1699046 140.53 410.59 1.43787 35.1361 280.26 92709751 458.23 455.79 437.20 1036735.6 31594.4 129.02 316.902 323.245697 109766345 309896 81.73 94616807 115715.8 23.49 7.63 187.507 8926893 37.460 236.73 4.08 214.431 109.670 9.11885 132.873 28.698 157.56 9.38 26.93 43.5355 22.9689 889567506540 744387683670 223625738013 23886054770 344150916937 66573957920 315178381 53.99 53.92 23.41 1221.8 18.0 488.922 10922667 23.33 30.6799 99.184 193.138 23.1755 14.74 165.048 4.64814 7.392 520.22 63.30 8.06 302.0641 148.40248 13.264 75396 54.14 128.74 1242.6 9.80 122.718 8378.3 462.78 1.10042 908.187 3.69649 270.329 2.15980 462.855 110.32 105.98 118.779059 15.0376 66.5162 23.7293 30.8404 703.474 12168413 4752673.79 7321 3.18392 314.057 3.85774 259.186 27.21 39.7451 25.1591 0.49 81279.79 2.16966 460.775 244.824 119.803392 302.266 3.30836 78.71 153584.203 89.070 11004 6.43 91.51 80.29 64.475 1709 423.59 203 1441 224.64 284.64 59522 108.124 2703.088 27.1010 50798 23125 2.36 26943.42 9.40 6757.26 31993 1.20298 830.725 11.17 5725.03 6.72 9515.86 55.07 1159.66 195648.8 29.0185 34.4595 29.9566 33.3797 48.360 39.62 403.20 4.01687 248.682 26.85 592.20 17.42 13.73 4656.92 47.8953 20.8795 50.8307 19.6773 5.19 12317.94 16.5534 60.4094 21.87 2924.66 167 171 230 3.23780 308.801 285 228 4.26352 234.540 529 297517946 63.61 63.60 63.06 39.38 16.61 26378.1 42.775 43.048 15.966 2369998.356940 31830.2 41.846 428116 338146 441636 14.28 18774333 34.591 0.60 1486.12 46.317 48.406 416523000 539613000 1244300000 1299170000 73140667 3088.7 34.791 37265.9 31177.2 27.90 783770000 40244000 30.174 77.52 48.425051 7.6240 2475500000 16.06 4.6303 1152933333 174.832 3600.5 3503200000 399698.78 1178766667 32.08 8089.14 105781 105831 3806833333 3167200000 16.64 3148233333 799.717 1927766667 31.91 21.67 3242 97.1861 10.477 7.876 319.76 16936.8 19141.8 24.23 24.80 79.437 39.31 1277.46 106.395 2659.883 35.50 23.72 6.701 33.065393 31.704905 4059.70 39.20 1814760000 10.1967066 21.357 1.58 6.69692 38.93 35.10 38433.973 0.398446 819.89 109416.42 16.96910 47.07 35.56 3424 31.348 17.258 691 5560 1.50 12.595 32.239 54.4547 232012.77 14.257 129.5 3.391 63760.45 38.02 112.6611 6.458 3.31 4.182707 3.32 82.9663 3.47 0.841608 4565 0.585804 29.141078 327.7829 5.784 177.861 3861 34.301 4.456 742.9 4.250 2.971 107321.89 1.847537 0.907161 11.36 17.076 5601.101 3222 1809.7 155.741 102.125 6038.92 85613.1 5186677 73640.9 1.149 881881 169.75 378.05 2.25422 69.2976 286.78 89231850 438.60 443.58 423.30 2057021.6 61499.6 150.33 189.739 171.375778 222610378 308434 82.73 92771639 77327.1 16.25 7.70 157.363 12425519 56.400 125.87 3.05 145.413 100.738 9.92684 144.258 37.660 86.93 12.74 26.80 58.9394 16.9672 1769313146013 1497529939377 444099144270 46520760707 684284382760 131976050120 586147871 53.29 53.22 16.17 1165.8 17.8 538.225 18438600 16.00 53.9348 127.567 176.395 41.9111 19.91 106.815 5.85267 6.960 519.89 40.83 8.88 137.03802 139.61713 30.203 33110 86.85 100.00 1189.7 9.67 103.376 16324.7 577.76 1.32454 754.805 4.29531 236.648 2.81739 354.754 113.15 97.911 210.815856 26.0866 38.4240 42.1295 54.1195 626.138 17585737 3780240.56 7492 5.83954 171.231 3.98013 251.305 17.57 44.5996 22.4251 0.46 128566.81 2.80263 356.764 244.952 129.956841 327.875 3.05085 86.11 64181.293 48.091 12713 3.85 94.66 41.85 60.526 898 501.39 182 759 234.24 545.21 33391 191.818 4795.462 48.7576 24249 12124 2.48 48122.16 13.15 9360.89 14358 1.64919 605.589 11.69 10934.17 6.95 18375.63 57.13 2237.69 380867.5 28.8481 34.6628 31.5324 31.7109 42.974 43.41 736.23 5.10948 195.453 28.17 1128.78 17.02 14.67 8719.37 70.4377 14.1980 64.7891 15.4341 5.18 24676.86 31.7907 31.4589 22.96 5570.63 284 194 96 6.49693 153.922 256 374 4.65431 214.812 689 578392800 33.61 41.45 40.77 31.90 7.49 30547.6 52.689 38.049 13.256 4966250.777983 42114.6 40.381 797093 573410 674239 7.22 18200533 25.872 0.59 2039.63 39.524 25.021 484977000 667365000 1204520000 1267480000 70499000 5493.4 33.650 72004.0 59139.2 26.88 883701250 38950600 30.472 45.69 43.695399 14.6334 2620066667 27.11 8.9091 1493833333 162.979 3586.3 4450525000 381352.69 2027000000 18.31 16004.07 206778 205499 6284300000 6077300000 30.37 3520766667 799.491 2154633333 17.29 12.69 3345 173.2208 18.540 7.360 291.37 48686.8 20204.9 40.92 41.58 70.426 57.13 1681.44 199.734 4993.343 30.76 12.76 5.110 23.558932 29.325125 7437.81 66.78 3609646333 5.39125967 17.389 2.40 38.0813 39.31 53.66 70826.734 0.580664 858.84 228184.68 9.964526 73.81 54.95 3466 30.966 16.183 692 5611 1.50 11.493 31.610 97.9383 455312.09 7.402 129.5 2.659 98764.93 65.38 199.6089 6.856 5.03 2.159459 5.09 153.1622 3.46 0.738442 4693 0.306795 58.253340 550.0168 5.613 165.495 3894 55.496 4.579 755.5 2.187 2.805 220893.78 1.432362 0.624250 11.31 16.928 13273.694 1243 8868.20 2530.5 412.371 173.014 3375.32 128125.9 713937 110666.9 0.559 1792636 117.53 351.29 1.45223 25.2423 314.44 82455664 470.02 465.06 446.40 697707.2 22861.0 119.73 428.387 407.589406 68019088 277647 90.02 85744542 103089.8 19.01 6.03 220.569 7439663 28.278 320.11 1.47 270.380 139.096 7.24187 146.868 63.428 228.74 7.46 23.33 54.9599 18.2179 641200848170 507456728087 161321058213 16199261277 226597354153 44439185187 211457048 47.34 47.32 19.47 1126.4 14.4 734.804 7626333 19.20 16.0869 100.089 144.481 15.5028 11.86 212.482 5.97130 6.324 461.61 51.05 6.30 440.83113 153.12467 14.292 69969 59.58 160.56 1131.1 7.76 149.378 5446.8 383.57 1.37831 728.469 5.67700 176.333 2.97094 337.004 126.89 121.19 136.492406 21.2179 47.2703 15.3984 16.0502 1200.75 8795408 4384040.52 3887 3.02897 330.104 4.58912 217.880 19.99 47.2417 21.1702 0.33 135075.07 4.57581 219.532 275.385 132.132632 380.902 2.62544 83.44 117588.992 123.832 6130 11.29 104.23 106.96 76.915 2357 375.73 197 1988 236.52 202.59 80742 70.213 1755.333 19.9102 68973 37055 2.50 19183.83 11.37 4208.49 42837 1.45280 687.671 12.54 3802.61 7.13 6717.65 55.74 860.64 143755.3 33.3341 29.9973 35.0665 28.5164 39.100 41.93 285.95 5.22781 191.111 28.73 415.96 15.59 16.33 2935.47 61.8256 16.1742 61.2547 16.3251 5.27 9087.12 24.5535 40.7289 23.12 2074.30 114 150 245 3.13366 319.043 286 160 5.10914 195.705 394 205346154 86.67 52.97 51.55 41.43 7.67 21286.6 46.959 54.376 14.101 1614763.703237 20091.1 48.708 286552 207738 314716 12.80 16906333 43.421 0.55 1047.96 43.362 67.324 67130333 2170.7 41.125 21766.5 18522 33.75 632396667 36537667 35.657 50.99 58.379116 5.1342 2138766667 13.36 3.1204 800186667 144.698 3225.7 2670033333 838530000 42.85 5366.69 67875 67893 2848933333 2381800000 15.17 2351900000 711.101 1640266667 42.78 36.13 3378 64.9597 7.545 6.490 333.73 6758.81 4173.46 17.52 18.13 62.750 48.91 986.04 63.620 1590.501 48.28 31.66 8.300 45.947435 31.781874 3050.16 53.13 1588496667 13.9692376 26.458 1.08 5.30953 29.05 39.56 23848.540 0.725974 841.68 58815.36 21.02112 63.10 44.05 3785 26.249 20.175 763 5108 1.40 16.075 26.864 37.0051 126171.52 21.030 129.7 3.781 35116.55 40.23 75.4690 7.622 2.26 5.930957 2.27 58.4230 3.10 4.32465 6707 9.19434 19.768930 247.2979 6.836 146.097 5217 27.629 4.916 702.6 6.160 3.730 85910.95 2.632077 1.26407 10.13 19.117 7157.961 1776 14665.0 1785 214.416 182.123 3347.93 80804.7 3658790 71680.5 1.027 976035 145.29 263.33 1.88679 54.4054 328.41 77501248 501.07 499.18 491.89 1395446.4 45531.0 141.95 246.936 189.686116 137977203 277589 94.84 80770465 69221.4 15.84 6.23 184.298 9624417 46.705 169.44 1.77 175.625 121.670 8.39962 156.136 74.866 125.15 10.17 22.34 69.4501 14.4831 1277583382757 1011898993323 320396720447 32304222993 449908494927 88635753413 419943570 45.29 45.95 16.68 1040.2 13.8 1498.584 12958000 16.30 29.3496 127.703 137.503 15.3405 16.91 134.419 7.30065 6.023 435.21 41.65 6.81 201.10956 134.78213 16.963 58952 70.73 114.29 1041.8 7.62 123.882 10975.8 467.91 1.65270 604.755 7.04111 141.954 4.05270 246.680 116.49 102.12 243.236578 24.6510 40.5671 15.9777 29.5018 1966.88 13859254 3373323.92 4199 5.74491 174.677 4.85818 205.885 17.91 60.1120 16.6394 0.28 174862.56 5.02267 199.079 276.457 137.457437 460.673 2.17463 78.27 83665.758 65.026 6681 5.11 111.71 55.26 69.647 1237 447.50 148 1049 256.63 373.50 45211 127.845 3196.123 35.9324 38926 16645 2.53 37710.60 17.15 5565.23 19701 2.02659 492.885 13.34 7127.28 7.32 13102.28 56.71 1691.79 288129.1 36.2283 27.6074 40.4534 24.7274 39.594 42.16 568.81 7.34848 135.976 29.98 795.63 14.99 17.19 5576.86 76.4227 13.0869 72.8018 13.7366 5.55 17252.27 30.4733 32.8141 24.00 3998.02 199 150 108 6.00525 166.485 193 269 5.74921 173.909 509 405533173 44.71 41.68 42.35 32.25 7.77 30236.0 55.442 42.873 11.897 2993136.601832 19876.5 46.871 562875 401707 491729 9.64 16904667 32.143 0.54 1604.11 34.826 33.921 67064000 3787.0 38.653 42939.2 36900.5 27.51 732560000 36497667 36.197 46.49 51.245898 10.2051 2494050000 19.75 6.2126 1091460000 122.617 3207.0 3596400000 1444066667 24.99 10970.45 133866 134562 4825133333 4670966667 22.25 3254033333 710.916 1963233333 23.17 18.24 3643 104.8425 13.392 5.991 341.51 4437.6 3916.78 26.00 26.69 54.823 46.13 1479.53 108.397 2709.930 37.76 16.55 6.334 28.993119 32.481993 3816.70 52.63 3156261667 7.29349117 20.788 1.72 13.4500 27.26 44.75 52102.668 0.662387 932.59 135939.25 13.21125 54.98 45.09 3926 26.842 18.474 763 5101 1.39 14.402 27.325 72.3297 246822.52 10.840 129.7 3.110 65396.22 51.91 125.7494 12.617 3.51 2.881099 3.49 107.6299 3.09 4.28399 6821 7.75431 39.345732 441.6518 7.121 122.089 5342 47.512 5.317 651.9 3.121 3.776 172614.10 1.982932 0.945075 10.01 18.812 12410.29 1356 9204.87 2245.2 384.384 145.236 3406.96 120494.3 767812 109388.2 0.622 1607424 125.14 357.57 1.50214 30.5872 309.03 83475645 476.91 474.68 461.62 813667.6 25441.5 123.69 384.063 351.644165 73592230 277260 89.53 86354518 112265.3 19.24 6.29 215.496 7366500 32.157 290.56 1.54 252.648 155.788 6.54965 145.238 64.883 212.99 8.00 23.77 59.1795 16.9166 747710702660 592014115453 187796174440 18893980783 263740690067 51840436763 244070674 48.14 48.35 19.29 1127.5 14.5 632.146 8957000 19.58 18.4851 99.619 143.480 16.2652 12.50 197.844 5.92501 6.501 464.72 51.86 6.82 410.29005 150.66848 13.845 72225 59.32 146.03 1133.3 7.72 143.808 6122.3 398.40 1.41662 705.606 5.91961 168.859 2.88734 346.213 120.76 117.81 134.388009 23.6625 42.2747 16.3219 18.5533 1180.85 9988176 4315467.17 3884 3.37034 296.799 4.67269 213.985 18.07 49.9740 20.0103 0.37 140144.01 4.64757 215.127 273.515 128.603449 382.109 2.61721 81.72 134048.964 107.237 5994 9.99 103.56 97.80 73.060 2123 386.00 194 1792 257.50 217.11 73366 78.105 1952.606 22.3625 62540 33790 2.67 20910.53 12.72 4386.48 39238 1.47249 678.483 13.59 4093.73 7.76 7207.74 62.53 894.87 162727.4 33.9877 29.4250 35.1110 28.4798 43.629 59.69 301.30 5.29027 188.930 38.50 467.08 15.62 19.44 2877.32 61.0107 16.3898 63.5353 15.7394 5.77 9686.39 23.6565 42.2711 24.94 2243.84 130 158 213 3.32030 301.136 277 181 5.26075 190.063 432 234469939 76.87 51.56 51.35 42.22 8.13 15081.0 47.086 48.487 14.362 1855135.326098 18621.2 47.951 334076 243347 342363 12.97 16885333 40.501 0.55 1108.95 40.347 58.159 67127667 2514.0 39.876 23250.2 20561.4 31.92 689003333 36539000 35.201 48.59 56.401698 5.9702 2308966667 13.89 3.6276 882200000 149.996 3229.1 2972400000 367199.06 944550000 39.17 6445.09 79144 79152 3222533333 2769066667 15.68 2739633333 712.013 1679700000 38.48 31.47 3396 71.8253 8.282 6.572 335.58 7046.56 4438.58 18.24 18.84 65.359 50.09 1058.99 70.843 1771.065 43.67 28.49 7.959 41.746192 31.998248 3076.66 54.47 1597993333 12.7997582 24.840 1.14 6.09747 31.40 40.82 25831.838 0.617190 852.36 69776.41 19.88246 63.99 45.32 3707 27.087 19.650 762 5102 1.39 15.376 27.750 42.9834 131606.86 18.102 129.7 3.704 35234.06 41.34 83.4921 7.748 2.38 5.114161 2.39 65.3318 3.10 4.27481 6693 8.75105 22.539990 284.3336 6.605 151.718 5188 30.843 4.867 705.5 5.332 3.550 86407.46 2.287766 1.19643 10.13 18.847 6840.057 1852 14463.4 1873.1 201.382 173.550 4382.97 76524.7 4075342 71696.5 1.098 920725 138.39 269.20 1.76778 62.6357 325.97 78057728 471.79 467.96 460.66 1627941.4 48534.8 135.28 231.033 187.224004 149409082 277298 95.39 80139566 66816.9 14.96 5.91 181.629 11223329 51.816 156.70 1.54 171.174 121.780 8.26016 158.310 68.860 117.91 10.44 23.30 69.2014 14.4583 1484669627050 1181148957353 372735215297 37564522053 522912403347 103382860113 497907490 46.79 46.59 14.74 1039.2 13.3 719.229 14609417 14.92 33.1275 131.795 135.436 15.8207 16.64 128.066 2.56319 6.077 439.84 37.84 7.41 186.32539 159.31171 16.655 60046 81.65 110.56 1046.0 7.46 122.704 12115.0 477.33 1.71875 581.769 7.53259 132.712 3.95819 252.671 119.03 106.27 239.726773 29.4448 33.9621 15.3743 33.1125 2776.52 15354400 3392842.38 4069 6.17796 161.886 5.00222 199.896 14.86 55.9019 17.9873 0.30 176900.32 5.39123 185.46 276.229 137.004266 475.254 2.10480 80.32 65663.823 58.248 6672 4.37 107.30 51.29 68.437 1143 449.91 143 961 278.52 401.45 41971 133.990 3349.756 39.3389 36179 15357 2.79 40032.81 18.72 5933.65 18111 2.08780 478.467 14.42 7689.32 7.97 14033.94 62.11 1801.89 316359.2 36.0039 27.7772 40.5178 24.6818 34.634 64.91 569.60 7.30822 136.689 41.57 889.18 14.51 20.24 5525.56 79.3770 12.5974 73.9684 13.5190 6.02 18561.91 34.2507 29.1955 25.72 4351.59 227 164 97 6.51744 153.407 207 301 5.88628 169.850 558 473755946 40.38 37.91 38.30 32.44 7.26 11866.7 56.776 43.911 11.967 3279262.530349 21583.2 46.571 657889 469131 525514 6.51 16884000 30.530 0.54 1677.62 33.274 30.196 66266000 4386.6 38.136 45195.1 40368.6 27.63 757176667 36521333 35.700 35.46 49.136175 11.8875 2491340000 22.14 7.2075 1206066667 124.263 3222.8 3896500000 1518933333 23.45 12793.01 155959 156658 5036000000 5367033333 24.65 3337066667 712.085 2090466667 21.45 14.67 3537 112.7231 14.127 6.052 308.95 7304.58 3836.73 28.96 29.62 55.979 45.79 1528.41 114.902 2872.562 33.21 15.29 6.266 27.577291 28.840157 3819.83 54.19 3205161000 6.66387510 20.008 1.74 16.0901 27.90 46.25 53269.469 0.759434 940.40 141954.15 12.10690 58.14 44.40 3921 26.994 18.138 763 5088 1.39 14.094 27.260 83.3395 257384.55 9.285 129.7 2.961 66492.44 52.23 129.7482 12.578 3.65 2.527363 3.66 116.6053 3.09 4.17553 6777 7.06043 44.668302 483.1049 7.038 127.546 5322 52.244 5.311 663.8 2.691 3.738 171436.47 1.711296 0.864358 10.03 18.824 OpenBenchmarking.org
WRF Input: conus 2.5km OpenBenchmarking.org Seconds, Fewer Is Better WRF 4.2.2 Input: conus 2.5km Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 3K 6K 9K 12K 15K 5601.10 6674.12 6840.06 7157.96 10602.41 11980.81 12410.29 13273.69 1. (F9X) gfortran options: -O2 -ftree-vectorize -funroll-loops -ffree-form -fconvert=big-endian -frecord-marker=4 -fallow-invalid-boz -lesmf_time -lwrfio_nf -lnetcdff -lnetcdf -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
OpenVKL Benchmark: vklBenchmarkCPU ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 700 1400 2100 2800 3500 SE +/- 13.62, N = 3 SE +/- 6.74, N = 3 SE +/- 2.08, N = 3 SE +/- 4.36, N = 3 SE +/- 8.62, N = 3 SE +/- 1.53, N = 3 SE +/- 13.96, N = 3 SE +/- 6.66, N = 3 3222 2716 2004 1852 1776 1734 1356 1243 MIN: 248 / MAX: 36519 MIN: 188 / MAX: 30888 MIN: 134 / MAX: 29750 MIN: 191 / MAX: 28947 MIN: 177 / MAX: 27371 MIN: 104 / MAX: 26188 MIN: 107 / MAX: 20909 MIN: 95 / MAX: 19286
ASKAP Test: tConvolve MT - Degridding OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve MT - Degridding Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 3K 6K 9K 12K 15K SE +/- 577.93, N = 3 SE +/- 295.26, N = 8 SE +/- 228.53, N = 12 SE +/- 150.41, N = 12 14665.00 14463.40 9204.87 8868.20 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
NWChem Input: C240 Buckyball OpenBenchmarking.org Seconds, Fewer Is Better NWChem 7.0.2 Input: C240 Buckyball Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 500 1000 1500 2000 2500 1785.0 1809.7 1873.1 1878.3 1960.9 2070.3 2245.2 2530.5 1. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2
RELION Test: Basic - Device: CPU OpenBenchmarking.org Seconds, Fewer Is Better RELION 4.0.1 Test: Basic - Device: CPU Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 90 180 270 360 450 SE +/- 1.41, N = 3 SE +/- 2.66, N = 12 SE +/- 2.65, N = 3 SE +/- 3.24, N = 12 SE +/- 2.68, N = 7 SE +/- 7.14, N = 9 SE +/- 4.65, N = 9 SE +/- 2.98, N = 3 155.74 201.38 203.41 214.42 290.45 373.18 384.38 412.37 1. (CXX) g++ options: -fopenmp -std=c++11 -O3 -rdynamic -ldl -ltiff -lfftw3f -lfftw3 -lpng -ljpeg -lmpi_cxx -lmpi
easyWave Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 40 80 120 160 200 SE +/- 0.96, N = 15 SE +/- 9.88, N = 12 SE +/- 0.67, N = 3 SE +/- 0.99, N = 12 SE +/- 5.17, N = 9 SE +/- 12.12, N = 12 SE +/- 18.26, N = 12 SE +/- 15.80, N = 12 75.73 102.13 119.84 126.39 145.24 173.01 173.55 182.12 1. (CXX) g++ options: -O3 -fopenmp
ASKAP Test: tConvolve MT - Gridding OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve MT - Gridding Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P 2K 4K 6K 8K 10K SE +/- 4.15, N = 3 SE +/- 75.19, N = 5 SE +/- 60.72, N = 3 SE +/- 54.27, N = 5 SE +/- 195.28, N = 8 SE +/- 32.87, N = 12 SE +/- 87.89, N = 12 SE +/- 23.56, N = 3 8088.11 7630.06 6038.92 5062.07 4382.97 3406.96 3375.32 3347.93 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
CockroachDB Workload: KV, 95% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 512 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 30K 60K 90K 120K 150K SE +/- 2853.06, N = 12 SE +/- 3058.00, N = 15 SE +/- 2758.29, N = 15 SE +/- 2047.28, N = 12 SE +/- 1875.64, N = 15 SE +/- 1606.68, N = 15 SE +/- 1830.36, N = 15 SE +/- 1792.91, N = 12 135861.9 131999.7 128125.9 120494.3 85613.1 82341.2 80804.7 76524.7
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.38.2 VGR Performance Metric Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1.1M 2.2M 3.3M 4.4M 5.5M 5186677 4136969 4075342 3658790 916904 833892 767812 713937 1. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6
CockroachDB Workload: KV, 60% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 512 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 30K 60K 90K 120K 150K SE +/- 2440.36, N = 12 SE +/- 1885.96, N = 15 SE +/- 1362.07, N = 3 SE +/- 1384.66, N = 15 SE +/- 1250.17, N = 13 SE +/- 886.06, N = 15 SE +/- 970.10, N = 15 SE +/- 889.12, N = 15 121465.2 116603.7 110666.9 109388.2 73640.9 72110.1 71696.5 71680.5
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 0.2909 0.5818 0.8727 1.1636 1.4545 SE +/- 0.008, N = 12 SE +/- 0.007, N = 3 SE +/- 0.005, N = 12 SE +/- 0.007, N = 3 SE +/- 0.017, N = 9 SE +/- 0.038, N = 9 SE +/- 0.040, N = 12 SE +/- 0.030, N = 12 0.559 0.572 0.589 0.622 1.027 1.098 1.149 1.293 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 400K 800K 1200K 1600K 2000K SE +/- 24978.23, N = 12 SE +/- 20350.34, N = 3 SE +/- 13863.97, N = 12 SE +/- 17697.00, N = 3 SE +/- 16726.04, N = 9 SE +/- 36627.33, N = 9 SE +/- 30933.90, N = 12 SE +/- 18635.21, N = 12 1792636 1748146 1699046 1607424 976035 920725 881881 778141 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 40 80 120 160 200 SE +/- 1.39, N = 3 SE +/- 0.61, N = 3 SE +/- 0.01, N = 3 SE +/- 0.79, N = 3 SE +/- 0.48, N = 3 SE +/- 1.80, N = 3 SE +/- 0.61, N = 3 SE +/- 1.17, N = 3 174.95 169.75 148.45 145.29 140.53 138.39 125.14 117.53
CloverLeaf Input: clover_bm16 OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm16 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 90 180 270 360 450 SE +/- 0.74, N = 3 SE +/- 1.56, N = 3 SE +/- 2.11, N = 9 SE +/- 0.13, N = 3 SE +/- 1.43, N = 3 SE +/- 2.03, N = 3 SE +/- 2.02, N = 3 SE +/- 0.54, N = 3 214.80 263.33 269.20 328.47 351.29 357.57 378.05 410.59 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
NAMD Input: STMV with 1,066,628 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8490H 0.5072 1.0144 1.5216 2.0288 2.536 SE +/- 0.08185, N = 13 SE +/- 0.05644, N = 12 SE +/- 0.05463, N = 15 SE +/- 0.05862, N = 15 SE +/- 0.05087, N = 15 SE +/- 0.02648, N = 15 SE +/- 0.04403, N = 15 SE +/- 0.01396, N = 15 2.25422 1.88679 1.76778 1.50214 1.45223 1.43787 1.10900 1.05274
High Performance Conjugate Gradient X Y Z: 144 144 144 - RT: 60 OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 15 30 45 60 75 SE +/- 0.94, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.29, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.37, N = 3 SE +/- 0.08, N = 3 69.30 62.64 60.85 54.41 35.14 31.07 30.59 25.24 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
Apache IoTDB Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 70 140 210 280 350 SE +/- 3.41, N = 3 SE +/- 3.40, N = 12 SE +/- 2.20, N = 3 SE +/- 5.07, N = 3 SE +/- 5.15, N = 3 SE +/- 3.79, N = 8 SE +/- 3.74, N = 12 SE +/- 2.59, N = 12 280.26 286.78 294.33 309.03 314.44 317.36 325.97 328.41 MAX: 27450.82 MAX: 28496.67 MAX: 27740.38 MAX: 26720.06 MAX: 27244.84 MAX: 32341.07 MAX: 30042.47 MAX: 29309.84
Apache IoTDB Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 500 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 400 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 20M 40M 60M 80M 100M SE +/- 746822.47, N = 3 SE +/- 761276.42, N = 12 SE +/- 308756.34, N = 3 SE +/- 1037167.36, N = 3 SE +/- 662950.65, N = 3 SE +/- 692701.79, N = 8 SE +/- 574699.97, N = 12 SE +/- 565297.90, N = 12 92709751 89231850 87797206 83475645 82455664 80169620 78057728 77501248
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 110 220 330 440 550 SE +/- 2.55, N = 3 SE +/- 3.08, N = 3 SE +/- 3.45, N = 3 SE +/- 3.60, N = 3 SE +/- 3.54, N = 12 SE +/- 6.03, N = 3 SE +/- 3.62, N = 6 SE +/- 5.39, N = 5 501.63 501.07 481.66 476.91 471.79 470.02 458.23 438.60 MIN: 64.45 / MAX: 6666.67 MIN: 54.25 / MAX: 5000 MIN: 40.16 / MAX: 5454.55 MIN: 36.01 / MAX: 5000 MIN: 53.43 / MAX: 6000 MIN: 32.59 / MAX: 5454.55 MIN: 42.16 / MAX: 6000 MIN: 58.2 / MAX: 6000
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 110 220 330 440 550 SE +/- 3.26, N = 3 SE +/- 0.19, N = 3 SE +/- 2.93, N = 3 SE +/- 4.95, N = 3 SE +/- 3.17, N = 12 SE +/- 1.94, N = 3 SE +/- 2.86, N = 6 SE +/- 3.10, N = 5 507.56 499.18 486.05 474.68 467.96 465.06 455.79 443.58 MIN: 66.45 / MAX: 5454.55 MIN: 54.2 / MAX: 4615.38 MIN: 40.43 / MAX: 6666.67 MIN: 36.43 / MAX: 6000 MIN: 52.36 / MAX: 6000 MIN: 32.59 / MAX: 5000 MIN: 42.19 / MAX: 6666.67 MIN: 62.43 / MAX: 6666.67
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 110 220 330 440 550 SE +/- 1.35, N = 3 SE +/- 4.37, N = 3 SE +/- 3.41, N = 3 SE +/- 5.88, N = 3 SE +/- 3.85, N = 12 SE +/- 2.85, N = 3 SE +/- 4.18, N = 6 SE +/- 4.12, N = 5 491.89 485.63 465.50 461.62 460.66 446.40 437.20 423.30 MIN: 51.86 / MAX: 5454.55 MIN: 63.63 / MAX: 5000 MIN: 40.93 / MAX: 5454.55 MIN: 35.59 / MAX: 5454.55 MIN: 53.62 / MAX: 5454.55 MIN: 32.64 / MAX: 4615.38 MIN: 41.7 / MAX: 5454.55 MIN: 61.54 / MAX: 6000
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 400K 800K 1200K 1600K 2000K SE +/- 6745.42, N = 3 SE +/- 862.96, N = 3 SE +/- 277.84, N = 3 SE +/- 355.69, N = 3 SE +/- 92.62, N = 3 SE +/- 92.46, N = 3 SE +/- 200.66, N = 3 SE +/- 165.80, N = 3 2057021.6 1916162.9 1627941.4 1395446.4 1036735.6 974189.9 813667.6 697707.2 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.3 Algorithm: RSA4096 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 13K 26K 39K 52K 65K SE +/- 56.68, N = 3 SE +/- 14.34, N = 3 SE +/- 83.09, N = 3 SE +/- 6.92, N = 3 SE +/- 15.15, N = 3 SE +/- 9.84, N = 3 SE +/- 20.13, N = 3 SE +/- 19.45, N = 3 61499.6 54601.1 48534.8 45531.0 31594.4 27431.1 25441.5 22861.0 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 40 80 120 160 200 SE +/- 1.57, N = 3 SE +/- 0.21, N = 3 SE +/- 0.03, N = 3 SE +/- 1.40, N = 3 SE +/- 1.04, N = 12 SE +/- 0.58, N = 3 SE +/- 0.63, N = 3 SE +/- 0.14, N = 3 161.06 150.33 143.67 141.95 135.28 129.02 123.69 119.73
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 90 180 270 360 450 SE +/- 0.56, N = 3 SE +/- 0.86, N = 3 SE +/- 0.73, N = 3 SE +/- 0.56, N = 3 SE +/- 0.72, N = 3 SE +/- 0.80, N = 3 SE +/- 0.67, N = 3 SE +/- 0.61, N = 3 189.74 218.57 231.03 246.94 316.90 362.45 384.06 428.39
Xcompact3d Incompact3d Input: X3D-benchmarking input.i3d OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 90 180 270 360 450 SE +/- 0.37, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 2.51, N = 3 SE +/- 0.14, N = 3 SE +/- 3.88, N = 4 SE +/- 1.25, N = 3 171.38 187.22 189.69 196.81 323.25 351.64 357.01 407.59 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
Stockfish Chess Benchmark OpenBenchmarking.org Nodes Per Second, More Is Better Stockfish 16.1 Chess Benchmark Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 50M 100M 150M 200M 250M SE +/- 2482737.87, N = 3 SE +/- 2148606.38, N = 4 SE +/- 2925715.37, N = 11 SE +/- 4344961.90, N = 10 SE +/- 2966712.90, N = 9 SE +/- 1304590.97, N = 3 SE +/- 629927.17, N = 3 SE +/- 1751369.24, N = 12 222610378 187761769 149409082 137977203 109766345 96887479 73592230 68019088 1. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver
SecureMark Benchmark: SecureMark-TLS OpenBenchmarking.org marks, More Is Better SecureMark 1.0.4 Benchmark: SecureMark-TLS Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8490H 2P 70K 140K 210K 280K 350K SE +/- 209.97, N = 3 SE +/- 411.11, N = 3 SE +/- 256.85, N = 3 SE +/- 384.08, N = 3 SE +/- 196.24, N = 3 SE +/- 670.43, N = 3 SE +/- 625.56, N = 3 SE +/- 330.95, N = 3 309896 308434 277647 277589 277298 277260 277205 275472 1. (CC) gcc options: -pedantic -O3
Apache IoTDB Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 OpenBenchmarking.org Average Latency, Fewer Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.68, N = 3 SE +/- 0.80, N = 7 SE +/- 0.15, N = 3 SE +/- 0.87, N = 3 SE +/- 0.48, N = 3 SE +/- 1.18, N = 3 SE +/- 1.01, N = 3 SE +/- 1.11, N = 4 81.73 82.73 85.16 89.53 90.02 92.23 94.84 95.39 MAX: 24081.78 MAX: 24148.34 MAX: 23810.86 MAX: 23819.37 MAX: 23857.34 MAX: 23842.9 MAX: 23842.98 MAX: 23846.38
Apache IoTDB Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 OpenBenchmarking.org point/sec, More Is Better Apache IoTDB 1.2 Device Count: 800 - Batch Size Per Write: 100 - Sensor Count: 800 - Client Number: 100 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 20M 40M 60M 80M 100M SE +/- 739343.51, N = 3 SE +/- 862582.24, N = 7 SE +/- 276414.35, N = 3 SE +/- 782176.98, N = 3 SE +/- 435900.66, N = 3 SE +/- 928557.10, N = 3 SE +/- 594234.55, N = 3 SE +/- 872659.60, N = 4 94616807 92771639 90871770 86354518 85744542 83651785 80770465 80139566
CockroachDB Workload: KV, 50% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 512 Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P 20K 40K 60K 80K 100K SE +/- 1659.04, N = 15 SE +/- 1352.20, N = 3 SE +/- 1037.18, N = 15 SE +/- 297.86, N = 3 SE +/- 325.76, N = 3 SE +/- 833.19, N = 3 SE +/- 639.27, N = 15 SE +/- 556.62, N = 3 115715.8 112265.3 108953.6 103089.8 77327.1 69221.4 68524.7 66816.9
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-152 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 6 12 18 24 30 SE +/- 0.34, N = 3 SE +/- 0.18, N = 3 SE +/- 0.17, N = 12 SE +/- 0.19, N = 5 SE +/- 0.15, N = 12 SE +/- 0.21, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 3 23.49 20.13 19.24 19.01 16.25 15.84 14.96 14.03 MIN: 19.73 / MAX: 24.56 MIN: 17.06 / MAX: 21.01 MIN: 10.95 / MAX: 20.39 MIN: 11.15 / MAX: 20.08 MIN: 6.19 / MAX: 17.5 MIN: 6.82 / MAX: 16.51 MIN: 10.89 / MAX: 15.42 MIN: 8.98 / MAX: 15.41
LuxCoreRender Scene: Danish Mood - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Danish Mood - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.11, N = 15 SE +/- 0.10, N = 12 SE +/- 0.18, N = 12 SE +/- 0.08, N = 3 SE +/- 0.07, N = 15 SE +/- 0.22, N = 15 SE +/- 0.02, N = 3 SE +/- 0.20, N = 15 7.70 7.63 7.00 6.85 6.29 6.23 6.03 5.91 MIN: 3.44 / MAX: 9.79 MIN: 3.26 / MAX: 9.01 MIN: 2.74 / MAX: 9.4 MIN: 3.05 / MAX: 8.02 MIN: 2.44 / MAX: 7.56 MIN: 2.27 / MAX: 9.18 MIN: 2.52 / MAX: 7 MIN: 2.31 / MAX: 9.24
Timed Gem5 Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Gem5 Compilation 23.0.1 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 50 100 150 200 250 SE +/- 0.89, N = 3 SE +/- 0.58, N = 3 SE +/- 1.01, N = 3 SE +/- 1.72, N = 3 SE +/- 2.17, N = 3 SE +/- 0.92, N = 3 SE +/- 2.11, N = 6 SE +/- 2.59, N = 4 157.36 178.28 181.63 184.30 187.51 210.93 215.50 220.57
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Read While Writing Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 3M 6M 9M 12M 15M SE +/- 215352.04, N = 15 SE +/- 343737.14, N = 15 SE +/- 254193.37, N = 15 SE +/- 218479.19, N = 15 SE +/- 28201.44, N = 3 SE +/- 61518.27, N = 10 SE +/- 83772.27, N = 13 SE +/- 26369.56, N = 3 12425519 12321300 11223329 9624417 8926893 7841738 7439663 7366500 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
LAMMPS Molecular Dynamics Simulator Model: 20k Atoms OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: 20k Atoms Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 13 26 39 52 65 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 56.40 51.82 50.52 46.71 37.46 34.89 32.16 28.28 1. (CXX) g++ options: -O3 -lm -ldl
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Barbershop - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 70 140 210 280 350 SE +/- 0.21, N = 3 SE +/- 0.42, N = 3 SE +/- 0.06, N = 3 SE +/- 0.23, N = 3 SE +/- 0.69, N = 3 SE +/- 0.18, N = 3 SE +/- 1.09, N = 3 SE +/- 0.12, N = 3 125.87 141.54 156.70 169.44 236.73 261.97 290.56 320.11
Llamafile Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: wizardcoder-python-34b-v1.0.Q6_K - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 1.3163 2.6326 3.9489 5.2652 6.5815 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.12, N = 6 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.85 4.08 3.82 3.05 1.77 1.54 1.54 1.47
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 21.7.2 Time To Compile Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 60 120 180 240 300 SE +/- 0.12, N = 3 SE +/- 0.52, N = 3 SE +/- 0.48, N = 3 SE +/- 0.84, N = 3 SE +/- 0.52, N = 3 SE +/- 0.74, N = 3 SE +/- 0.71, N = 3 SE +/- 0.53, N = 3 145.41 171.17 172.99 175.63 214.43 252.65 254.00 270.38
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 30 60 90 120 150 SE +/- 0.69, N = 15 SE +/- 0.44, N = 3 SE +/- 0.71, N = 3 SE +/- 0.09, N = 3 SE +/- 5.82, N = 12 SE +/- 2.59, N = 15 SE +/- 3.36, N = 15 SE +/- 6.41, N = 15 92.35 100.74 109.67 116.32 121.67 121.78 139.10 155.79 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 3 6 9 12 15 SE +/- 0.07619, N = 15 SE +/- 0.04271, N = 3 SE +/- 0.05824, N = 3 SE +/- 0.00664, N = 3 SE +/- 0.34632, N = 12 SE +/- 0.16487, N = 15 SE +/- 0.15651, N = 15 SE +/- 0.22869, N = 15 10.83623 9.92684 9.11885 8.59719 8.39962 8.26016 7.24187 6.54965 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
DuckDB Benchmark: TPC-H Parquet OpenBenchmarking.org Seconds, Fewer Is Better DuckDB 0.9.1 Benchmark: TPC-H Parquet Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.34, N = 3 SE +/- 0.44, N = 3 SE +/- 0.58, N = 3 SE +/- 0.12, N = 3 SE +/- 0.15, N = 3 SE +/- 0.55, N = 3 SE +/- 0.57, N = 3 SE +/- 0.95, N = 3 132.87 144.26 145.24 145.57 146.87 155.73 156.14 158.31 1. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl
easyWave Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200 OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P 20 40 60 80 100 SE +/- 0.32, N = 4 SE +/- 0.23, N = 3 SE +/- 0.10, N = 3 SE +/- 0.24, N = 3 SE +/- 3.12, N = 12 SE +/- 3.75, N = 15 SE +/- 3.75, N = 15 SE +/- 4.11, N = 15 28.70 37.66 46.29 50.83 63.43 64.88 68.86 74.87 1. (CXX) g++ options: -O3 -fopenmp
OpenRadioss Model: Chrysler Neon 1M OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Chrysler Neon 1M Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 50 100 150 200 250 SE +/- 0.14, N = 3 SE +/- 0.11, N = 3 SE +/- 0.14, N = 3 SE +/- 0.13, N = 3 SE +/- 0.20, N = 3 SE +/- 0.15, N = 3 SE +/- 0.18, N = 3 SE +/- 0.08, N = 3 86.93 115.89 117.91 125.15 157.56 207.20 212.99 228.74
LuxCoreRender Scene: DLSC - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 3 6 9 12 15 SE +/- 0.24, N = 15 SE +/- 0.23, N = 15 SE +/- 0.20, N = 15 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 15 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 12.74 11.12 10.44 10.17 9.38 8.72 8.00 7.46 MIN: 10.69 / MAX: 19.19 MIN: 9.18 / MAX: 17.51 MIN: 8.86 / MAX: 16.08 MIN: 9.34 / MAX: 14.75 MIN: 8.94 / MAX: 11.49 MIN: 8.12 / MAX: 10.6 MIN: 7.65 / MAX: 9.12 MIN: 7.17 / MAX: 8.21
FFmpeg Encoder: libx265 - Scenario: Upload OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Upload Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 6 12 18 24 30 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.00, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 26.93 26.80 24.97 24.56 23.77 23.33 23.30 22.34 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 15 30 45 60 75 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 SE +/- 0.55, N = 15 SE +/- 0.35, N = 3 SE +/- 0.55, N = 15 SE +/- 0.28, N = 3 SE +/- 0.47, N = 14 SE +/- 1.43, N = 15 43.54 50.35 54.96 58.94 59.18 64.29 69.20 69.45 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.05, N = 3 SE +/- 0.05, N = 3 SE +/- 0.17, N = 15 SE +/- 0.10, N = 3 SE +/- 0.15, N = 15 SE +/- 0.07, N = 3 SE +/- 0.29, N = 15 SE +/- 0.10, N = 14 22.97 19.86 18.22 16.97 16.92 15.56 14.48 14.46 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenSSL Algorithm: AES-128-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-128-GCM Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 400000M 800000M 1200000M 1600000M 2000000M SE +/- 1622921637.03, N = 3 SE +/- 159598753.20, N = 3 SE +/- 697208281.49, N = 3 SE +/- 268465891.11, N = 3 SE +/- 1253503549.61, N = 3 SE +/- 28627701.54, N = 3 SE +/- 56355870.99, N = 3 SE +/- 43545680.66, N = 3 1769313146013 1533026300727 1484669627050 1277583382757 889567506540 768804693697 747710702660 641200848170 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: AES-256-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: AES-256-GCM Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 300000M 600000M 900000M 1200000M 1500000M SE +/- 1320809584.03, N = 3 SE +/- 1397764228.85, N = 3 SE +/- 112278705.55, N = 3 SE +/- 108288170.03, N = 3 SE +/- 3966858436.56, N = 3 SE +/- 2848140790.67, N = 3 SE +/- 63026881.96, N = 3 SE +/- 119857064.56, N = 3 1497529939377 1369534328470 1181148957353 1011898993323 744387683670 700239352717 592014115453 507456728087 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: ChaCha20-Poly1305 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20-Poly1305 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 100000M 200000M 300000M 400000M 500000M SE +/- 82161991.11, N = 3 SE +/- 132227134.30, N = 3 SE +/- 36941390.18, N = 3 SE +/- 4148679.28, N = 3 SE +/- 766713911.50, N = 3 SE +/- 120899798.30, N = 3 SE +/- 37795783.50, N = 3 SE +/- 6370607.14, N = 3 444099144270 442202532977 372735215297 320396720447 225038850730 223625738013 187796174440 161321058213 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: SHA512 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA512 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 10000M 20000M 30000M 40000M 50000M SE +/- 14734422.48, N = 3 SE +/- 481040738.21, N = 3 SE +/- 14339684.98, N = 3 SE +/- 3500318.33, N = 3 SE +/- 37654528.63, N = 3 SE +/- 203213936.42, N = 3 SE +/- 1250834.62, N = 3 SE +/- 500176.69, N = 3 46520760707 42846254477 37564522053 32304222993 23886054770 22219927723 18893980783 16199261277 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: ChaCha20 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: ChaCha20 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 150000M 300000M 450000M 600000M 750000M SE +/- 303075210.03, N = 3 SE +/- 271318554.29, N = 3 SE +/- 863978337.15, N = 3 SE +/- 329510485.23, N = 3 SE +/- 3335467.26, N = 3 SE +/- 232288636.76, N = 3 SE +/- 312824840.64, N = 3 SE +/- 415487944.57, N = 3 684284382760 624402972947 522912403347 449908494927 344150916937 316126421173 263740690067 226597354153 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.3 Algorithm: SHA256 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 30000M 60000M 90000M 120000M 150000M SE +/- 29142783.86, N = 3 SE +/- 66583540.43, N = 3 SE +/- 70647143.49, N = 3 SE +/- 126029257.64, N = 3 SE +/- 23323764.84, N = 3 SE +/- 159515825.53, N = 3 SE +/- 33334799.97, N = 3 SE +/- 27466135.54, N = 3 131976050120 119106802107 103382860113 88635753413 66573957920 61806994523 51840436763 44439185187 1. (CC) gcc options: -pthread -m64 -O3 -lssl -lcrypto -ldl
Speedb Test: Random Read OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 130M 260M 390M 520M 650M SE +/- 5399265.88, N = 15 SE +/- 5393159.45, N = 3 SE +/- 2955608.21, N = 3 SE +/- 8491098.40, N = 15 SE +/- 242146.75, N = 3 SE +/- 168680.90, N = 3 SE +/- 2763560.64, N = 13 SE +/- 3698537.65, N = 15 586147871 551286958 497907490 419943570 315178381 276179617 244070674 211457048 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
FFmpeg Encoder: libx265 - Scenario: Video On Demand OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Video On Demand Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 12 24 36 48 60 SE +/- 0.03, N = 3 SE +/- 0.14, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.10, N = 3 SE +/- 0.13, N = 3 SE +/- 0.43, N = 3 53.99 53.29 49.84 48.77 48.14 47.34 46.79 45.29 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
FFmpeg Encoder: libx265 - Scenario: Platform OpenBenchmarking.org FPS, More Is Better FFmpeg 7.0 Encoder: libx265 - Scenario: Platform Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 12 24 36 48 60 SE +/- 0.14, N = 3 SE +/- 0.15, N = 3 SE +/- 0.16, N = 3 SE +/- 0.12, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.27, N = 3 SE +/- 0.09, N = 3 53.92 53.22 49.79 48.76 48.35 47.32 46.59 45.95 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-152 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 6 12 18 24 30 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.18, N = 7 SE +/- 0.18, N = 7 SE +/- 0.09, N = 3 SE +/- 0.18, N = 3 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 23.41 20.46 19.47 19.29 16.68 16.17 14.74 14.59 MIN: 22.41 / MAX: 24.3 MIN: 17.25 / MAX: 21.16 MIN: 11.79 / MAX: 20.53 MIN: 10.66 / MAX: 20.07 MIN: 7.02 / MAX: 17.07 MIN: 11.54 / MAX: 16.69 MIN: 10.63 / MAX: 15.36 MIN: 10.11 / MAX: 16.06
Zstd Compression Compression Level: 19 - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P 300 600 900 1200 1500 SE +/- 3.01, N = 4 SE +/- 1.88, N = 3 SE +/- 1.08, N = 15 SE +/- 2.12, N = 3 SE +/- 0.66, N = 15 SE +/- 0.65, N = 15 SE +/- 4.45, N = 3 SE +/- 4.96, N = 3 1221.8 1165.8 1127.5 1126.4 1040.2 1039.2 1032.0 963.6 1. (CC) gcc options: -O3 -pthread -lz -llzma
Zstd Compression Compression Level: 19 - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.21, N = 4 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 15 SE +/- 0.15, N = 3 SE +/- 0.09, N = 15 SE +/- 0.13, N = 15 18.0 17.8 15.2 14.6 14.5 14.4 13.8 13.3 1. (CC) gcc options: -O3 -pthread -lz -llzma
oneDNN Harness: Recurrent Neural Network Inference - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Inference - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9468 2P 300 600 900 1200 1500 SE +/- 0.29, N = 3 SE +/- 2.24, N = 3 SE +/- 3.17, N = 3 SE +/- 20.21, N = 15 SE +/- 2.30, N = 3 SE +/- 7.22, N = 3 SE +/- 21.06, N = 12 SE +/- 113.47, N = 12 409.59 488.92 538.23 632.15 633.29 719.23 734.80 1498.58 MIN: 390.22 MIN: 457.65 MIN: 529.58 MIN: 459.4 MIN: 621.42 MIN: 696.95 MIN: 546.95 MIN: 641.2 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: MD5 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 4M 8M 12M 16M 20M SE +/- 317498.76, N = 15 SE +/- 22338.31, N = 3 SE +/- 695042.48, N = 12 SE +/- 601801.63, N = 12 SE +/- 1201.85, N = 3 SE +/- 3511.88, N = 3 SE +/- 5000.00, N = 3 SE +/- 54649.77, N = 15 18438600 18166000 14609417 12958000 10922667 9583000 8957000 7626333 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-152 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 6 12 18 24 30 SE +/- 0.29, N = 3 SE +/- 0.08, N = 3 SE +/- 0.15, N = 3 SE +/- 0.15, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.18, N = 4 SE +/- 0.13, N = 7 23.33 20.25 19.58 19.20 16.30 16.00 14.92 14.08 MIN: 19.78 / MAX: 24.54 MIN: 17.03 / MAX: 21.21 MIN: 13.13 / MAX: 20.27 MIN: 10.93 / MAX: 20 MIN: 11.86 / MAX: 16.95 MIN: 11.43 / MAX: 16.66 MIN: 8.28 / MAX: 15.85 MIN: 6.98 / MAX: 15.46
OSPRay Benchmark: particle_volume/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/scivis/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 12 24 36 48 60 SE +/- 0.05, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 53.93 38.23 33.13 30.68 29.35 21.89 18.49 16.09
DuckDB Benchmark: IMDB OpenBenchmarking.org Seconds, Fewer Is Better DuckDB 0.9.1 Benchmark: IMDB Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P 30 60 90 120 150 SE +/- 0.59, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.23, N = 3 SE +/- 0.67, N = 3 SE +/- 0.30, N = 3 SE +/- 0.07, N = 3 SE +/- 0.41, N = 3 99.18 99.49 99.62 100.09 125.88 127.57 127.70 131.80 1. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/pathtracer/real_time Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.25, N = 3 SE +/- 0.89, N = 3 SE +/- 0.17, N = 3 SE +/- 0.49, N = 3 SE +/- 0.09, N = 3 SE +/- 0.29, N = 3 SE +/- 0.42, N = 3 SE +/- 0.81, N = 3 193.14 176.40 160.24 149.09 144.48 143.48 137.50 135.44
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9468 2P 10 20 30 40 50 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.18, N = 15 SE +/- 0.22, N = 15 SE +/- 0.22, N = 15 SE +/- 0.24, N = 12 41.91 35.60 23.18 19.58 16.27 15.82 15.50 15.34
LuxCoreRender Scene: Orange Juice - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 5 10 15 20 25 SE +/- 0.30, N = 15 SE +/- 0.12, N = 3 SE +/- 0.16, N = 15 SE +/- 0.28, N = 15 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.10, N = 3 19.91 18.70 16.91 16.64 14.74 13.46 12.50 11.86 MIN: 15 / MAX: 30.59 MIN: 16.22 / MAX: 25.05 MIN: 12.9 / MAX: 23.07 MIN: 12.39 / MAX: 24.93 MIN: 12.17 / MAX: 18.21 MIN: 11.09 / MAX: 16.56 MIN: 10.38 / MAX: 14.93 MIN: 9.93 / MAX: 13.28
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 50 100 150 200 250 SE +/- 0.27, N = 3 SE +/- 0.15, N = 3 SE +/- 0.79, N = 3 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.36, N = 3 SE +/- 0.19, N = 3 106.82 122.31 128.07 134.42 165.05 187.02 197.84 212.48
NAMD Input: ATPase with 327,506 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 2P Xeon Platinum 8490H 2P 2 4 6 8 10 SE +/- 0.26203, N = 15 SE +/- 0.16058, N = 15 SE +/- 0.14537, N = 15 SE +/- 0.34017, N = 12 SE +/- 0.54361, N = 15 SE +/- 0.21567, N = 12 SE +/- 0.44989, N = 15 SE +/- 0.17435, N = 15 7.30065 5.97130 5.92501 5.85267 4.64814 2.97021 2.56319 2.21948
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Fast Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 2 4 6 8 10 SE +/- 0.023, N = 3 SE +/- 0.038, N = 3 SE +/- 0.022, N = 3 SE +/- 0.033, N = 3 SE +/- 0.047, N = 3 SE +/- 0.010, N = 3 SE +/- 0.043, N = 15 SE +/- 0.081, N = 3 7.392 6.960 6.719 6.501 6.480 6.324 6.077 6.023 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
Numpy Benchmark OpenBenchmarking.org Score, More Is Better Numpy Benchmark Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P 110 220 330 440 550 SE +/- 1.84, N = 3 SE +/- 1.42, N = 3 SE +/- 0.79, N = 3 SE +/- 0.60, N = 3 SE +/- 0.26, N = 3 SE +/- 0.33, N = 3 SE +/- 1.30, N = 3 SE +/- 1.13, N = 3 520.22 519.89 464.72 461.61 456.18 455.57 439.84 435.21
PyTorch Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 512 - Model: ResNet-50 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 14 28 42 56 70 SE +/- 0.19, N = 3 SE +/- 0.12, N = 3 SE +/- 0.43, N = 15 SE +/- 0.72, N = 3 SE +/- 0.26, N = 3 SE +/- 0.30, N = 15 SE +/- 0.34, N = 15 SE +/- 0.21, N = 3 63.30 56.44 51.86 51.05 41.65 40.83 37.84 37.55 MIN: 48.94 / MAX: 65.25 MIN: 48.09 / MAX: 58.6 MIN: 30.55 / MAX: 55.87 MIN: 40.71 / MAX: 53.89 MIN: 31.6 / MAX: 43.65 MIN: 15.4 / MAX: 43.41 MIN: 19.63 / MAX: 40.77 MIN: 24.5 / MAX: 40.69
LuxCoreRender Scene: LuxCore Benchmark - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: LuxCore Benchmark - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 2 4 6 8 10 SE +/- 0.17, N = 12 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.16, N = 15 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.22, N = 12 SE +/- 0.03, N = 3 8.88 8.82 8.06 7.41 7.10 6.82 6.81 6.30 MIN: 3.73 / MAX: 11.48 MIN: 3.72 / MAX: 10.41 MIN: 3.62 / MAX: 9.37 MIN: 2.67 / MAX: 9.42 MIN: 3.06 / MAX: 8.2 MIN: 2.81 / MAX: 7.94 MIN: 2.55 / MAX: 9.19 MIN: 2.53 / MAX: 7.3
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 100 200 300 400 500 137.04 186.33 196.50 201.11 302.06 410.29 420.65 440.83 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P 40 80 120 160 200 134.78 139.62 148.40 150.67 153.12 159.31 160.73 162.03 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P 7 14 21 28 35 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 13.26 13.85 14.04 14.29 14.86 16.66 16.96 30.20 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P 16K 32K 48K 64K 80K SE +/- 198.41, N = 3 SE +/- 143.25, N = 3 SE +/- 78.02, N = 3 SE +/- 95.84, N = 3 SE +/- 137.82, N = 3 SE +/- 440.63, N = 3 SE +/- 195.77, N = 3 SE +/- 106.16, N = 3 75396 72225 71227 69969 67315 60046 58952 33110 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Rubber O-Ring Seal Installation Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 20 40 60 80 100 SE +/- 0.34, N = 3 SE +/- 0.32, N = 3 SE +/- 0.60, N = 3 SE +/- 0.12, N = 3 SE +/- 0.02, N = 3 SE +/- 0.51, N = 15 SE +/- 0.72, N = 8 SE +/- 0.06, N = 3 54.14 59.32 59.58 59.91 70.73 81.65 86.85 88.39
OpenRadioss Model: INIVOL and Fluid Structure Interaction Drop Container OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: INIVOL and Fluid Structure Interaction Drop Container Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 40 80 120 160 200 SE +/- 0.30, N = 3 SE +/- 0.17, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.12, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.08, N = 3 100.00 107.36 110.56 114.29 128.74 140.43 146.03 160.56
Zstd Compression Compression Level: 19, Long Mode - Decompression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P 300 600 900 1200 1500 SE +/- 0.84, N = 3 SE +/- 1.60, N = 3 SE +/- 1.45, N = 3 SE +/- 0.56, N = 3 SE +/- 0.43, N = 3 SE +/- 1.78, N = 15 SE +/- 1.00, N = 3 SE +/- 3.69, N = 3 1242.6 1189.7 1133.3 1131.1 1069.1 1046.0 1041.8 992.1 1. (CC) gcc options: -O3 -pthread -lz -llzma
Zstd Compression Compression Level: 19, Long Mode - Compression Speed OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 3 6 9 12 15 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 15 9.80 9.67 8.16 7.94 7.76 7.72 7.62 7.46 1. (CC) gcc options: -O3 -pthread -lz -llzma
Timed Godot Game Engine Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 4.0 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 30 60 90 120 150 SE +/- 0.29, N = 3 SE +/- 0.56, N = 3 SE +/- 1.69, N = 3 SE +/- 0.91, N = 3 SE +/- 0.56, N = 3 SE +/- 0.76, N = 3 SE +/- 0.32, N = 3 SE +/- 0.18, N = 3 103.38 118.57 122.70 122.72 123.88 140.23 143.81 149.38
Xmrig Variant: GhostRider - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.21 Variant: GhostRider - Hash Count: 1M Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 3K 6K 9K 12K 15K SE +/- 64.69, N = 3 SE +/- 7.44, N = 3 SE +/- 4.03, N = 3 SE +/- 14.02, N = 3 SE +/- 44.68, N = 3 SE +/- 14.78, N = 3 SE +/- 23.16, N = 3 SE +/- 12.93, N = 3 16324.7 12115.0 11263.2 10975.8 8378.3 6122.3 5808.8 5446.8 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: GoogLeNet Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 120 240 360 480 600 SE +/- 1.52, N = 3 SE +/- 2.62, N = 3 SE +/- 2.46, N = 3 SE +/- 1.14, N = 3 SE +/- 3.68, N = 3 SE +/- 0.34, N = 3 SE +/- 0.37, N = 3 SE +/- 0.41, N = 3 577.76 576.08 477.33 467.91 462.78 461.23 398.40 383.57
ONNX Runtime Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 0.3867 0.7734 1.1601 1.5468 1.9335 SE +/- 0.00291, N = 3 SE +/- 0.01594, N = 3 SE +/- 0.01541, N = 3 SE +/- 0.02719, N = 15 SE +/- 0.01456, N = 3 SE +/- 0.01405, N = 15 SE +/- 0.00498, N = 3 SE +/- 0.01853, N = 5 1.10042 1.17292 1.32454 1.37831 1.41662 1.43573 1.65270 1.71875 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 200 400 600 800 1000 SE +/- 2.43, N = 3 SE +/- 11.46, N = 3 SE +/- 8.88, N = 3 SE +/- 12.91, N = 15 SE +/- 7.34, N = 3 SE +/- 6.50, N = 15 SE +/- 1.83, N = 3 SE +/- 6.21, N = 5 908.19 852.33 754.81 728.47 705.61 696.98 604.76 581.77 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.01631, N = 3 SE +/- 0.15083, N = 15 SE +/- 0.03075, N = 3 SE +/- 0.03218, N = 3 SE +/- 0.06596, N = 15 SE +/- 0.06620, N = 3 SE +/- 0.02902, N = 3 SE +/- 0.06105, N = 3 3.69649 4.29531 4.49976 5.55101 5.67700 5.91961 7.04111 7.53259 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 60 120 180 240 300 SE +/- 1.19, N = 3 SE +/- 8.14, N = 15 SE +/- 1.50, N = 3 SE +/- 1.05, N = 3 SE +/- 2.01, N = 15 SE +/- 1.88, N = 3 SE +/- 0.58, N = 3 SE +/- 1.08, N = 3 270.33 236.65 222.03 180.03 176.33 168.86 141.95 132.71 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: T5 Encoder - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P 0.9132 1.8264 2.7396 3.6528 4.566 SE +/- 0.01801, N = 3 SE +/- 0.01381, N = 3 SE +/- 0.01443, N = 3 SE +/- 0.03338, N = 15 SE +/- 0.00807, N = 3 SE +/- 0.02633, N = 15 SE +/- 0.04072, N = 3 SE +/- 0.04801, N = 3 2.15980 2.81739 2.88734 2.97094 3.06500 3.95819 4.05270 4.05881 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: T5 Encoder - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P 100 200 300 400 500 SE +/- 3.84, N = 3 SE +/- 1.73, N = 3 SE +/- 1.74, N = 3 SE +/- 3.48, N = 15 SE +/- 0.86, N = 3 SE +/- 1.67, N = 15 SE +/- 2.44, N = 3 SE +/- 2.94, N = 3 462.86 354.75 346.21 337.00 326.14 252.67 246.68 246.34 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Bird Strike on Windshield Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 30 60 90 120 150 SE +/- 0.14, N = 3 SE +/- 0.83, N = 3 SE +/- 0.69, N = 3 SE +/- 0.24, N = 3 SE +/- 0.38, N = 3 SE +/- 0.03, N = 3 SE +/- 0.29, N = 3 SE +/- 0.45, N = 3 110.32 113.15 116.49 117.41 119.03 120.76 124.44 126.89
QMCPACK Input: Li2_STO_ae OpenBenchmarking.org Total Execution Time - Seconds, Fewer Is Better QMCPACK 3.17.1 Input: Li2_STO_ae Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 30 60 90 120 150 SE +/- 0.93, N = 3 SE +/- 1.11, N = 3 SE +/- 0.88, N = 3 SE +/- 1.03, N = 3 SE +/- 1.11, N = 5 SE +/- 0.89, N = 3 SE +/- 1.04, N = 3 SE +/- 1.20, N = 3 97.91 101.63 102.12 105.98 106.27 109.30 117.81 121.19 1. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl
Appleseed Scene: Material Tester OpenBenchmarking.org Seconds, Fewer Is Better Appleseed 2.0 Beta Scene: Material Tester Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 50 100 150 200 250 118.78 126.15 134.39 136.49 210.82 225.35 239.73 243.24
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P 7 14 21 28 35 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.32, N = 15 SE +/- 0.33, N = 3 SE +/- 0.21, N = 3 SE +/- 0.39, N = 13 SE +/- 0.36, N = 3 SE +/- 0.18, N = 3 15.04 18.93 21.22 23.66 24.65 26.09 27.59 29.44 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P 15 30 45 60 75 SE +/- 0.82, N = 3 SE +/- 0.16, N = 3 SE +/- 0.69, N = 15 SE +/- 0.59, N = 3 SE +/- 0.34, N = 3 SE +/- 0.51, N = 13 SE +/- 0.48, N = 3 SE +/- 0.21, N = 3 66.52 52.82 47.27 42.27 40.57 38.42 36.25 33.96 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 2P 10 20 30 40 50 SE +/- 0.36, N = 3 SE +/- 0.11, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.18, N = 15 SE +/- 0.22, N = 3 SE +/- 0.17, N = 3 SE +/- 0.32, N = 15 42.13 36.15 23.73 19.85 16.32 15.98 15.40 15.37
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/ao/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 12 24 36 48 60 SE +/- 0.07, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 54.12 38.22 33.11 30.84 29.50 21.93 18.55 16.05
oneDNN Harness: Recurrent Neural Network Training - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Recurrent Neural Network Training - Engine: CPU Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 2P 600 1200 1800 2400 3000 SE +/- 0.67, N = 3 SE +/- 4.22, N = 3 SE +/- 2.79, N = 3 SE +/- 5.57, N = 3 SE +/- 8.14, N = 3 SE +/- 12.69, N = 3 SE +/- 119.20, N = 12 SE +/- 31.34, N = 3 623.60 626.14 635.15 703.47 1180.85 1200.75 1966.88 2776.52 MIN: 598.72 MIN: 600.37 MIN: 612.85 MIN: 649.83 MIN: 1153.29 MIN: 1127.94 MIN: 1146.52 MIN: 2715.64 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Speedb Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Read While Writing Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 4M 8M 12M 16M 20M SE +/- 195912.00, N = 15 SE +/- 239363.92, N = 3 SE +/- 197596.27, N = 3 SE +/- 171807.74, N = 3 SE +/- 143570.67, N = 4 SE +/- 62510.72, N = 3 SE +/- 93731.24, N = 7 SE +/- 88257.34, N = 3 17585737 17297027 15354400 13859254 12168413 10695360 9988176 8795408 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Memcached Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:100 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P 1000K 2000K 3000K 4000K 5000K SE +/- 35182.67, N = 3 SE +/- 25335.31, N = 3 SE +/- 21428.06, N = 3 SE +/- 52575.97, N = 3 SE +/- 35300.21, N = 3 SE +/- 24083.78, N = 3 SE +/- 26891.33, N = 3 SE +/- 50660.01, N = 15 4752673.79 4481667.95 4384040.52 4315467.17 3780240.56 3392842.38 3373323.92 3245908.40 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
DaCapo Benchmark Java Test: Tradesoap OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Tradesoap Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 1600 3200 4800 6400 8000 SE +/- 40.72, N = 15 SE +/- 36.36, N = 15 SE +/- 48.60, N = 15 SE +/- 29.41, N = 3 SE +/- 48.92, N = 14 SE +/- 31.29, N = 3 SE +/- 57.43, N = 15 SE +/- 52.55, N = 15 3884 3887 4069 4115 4199 4215 7321 7492
ONNX Runtime Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.02187, N = 3 SE +/- 0.01810, N = 3 SE +/- 0.02572, N = 3 SE +/- 0.03815, N = 5 SE +/- 0.03225, N = 3 SE +/- 0.09530, N = 15 SE +/- 0.01358, N = 3 SE +/- 0.06816, N = 3 3.02897 3.17002 3.18392 3.37034 5.62517 5.74491 5.83954 6.17796 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P 70 140 210 280 350 SE +/- 2.40, N = 3 SE +/- 1.80, N = 3 SE +/- 2.52, N = 3 SE +/- 3.31, N = 5 SE +/- 1.01, N = 3 SE +/- 2.72, N = 15 SE +/- 0.40, N = 3 SE +/- 1.78, N = 3 330.10 315.41 314.06 296.80 177.76 174.68 171.23 161.89 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 1.1255 2.251 3.3765 4.502 5.6275 SE +/- 0.00044, N = 3 SE +/- 0.05342, N = 3 SE +/- 0.00313, N = 3 SE +/- 0.00187, N = 3 SE +/- 0.00532, N = 3 SE +/- 0.10855, N = 15 SE +/- 0.05347, N = 4 SE +/- 0.02558, N = 3 3.85774 3.98013 4.39649 4.58912 4.67269 4.72530 4.85818 5.00222 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 60 120 180 240 300 SE +/- 0.03, N = 3 SE +/- 3.39, N = 3 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.25, N = 3 SE +/- 4.15, N = 15 SE +/- 2.30, N = 4 SE +/- 1.02, N = 3 259.19 251.31 227.42 217.88 213.99 212.92 205.89 199.90 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-152 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-152 Xeon Platinum 8592+ Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P 6 12 18 24 30 SE +/- 0.08, N = 3 SE +/- 0.26, N = 3 SE +/- 0.09, N = 3 SE +/- 0.16, N = 3 SE +/- 0.18, N = 3 SE +/- 0.19, N = 5 SE +/- 0.16, N = 4 SE +/- 0.13, N = 8 27.21 19.99 19.41 18.07 17.91 17.57 15.77 14.86 MIN: 13.91 / MAX: 28.31 MIN: 0.34 / MAX: 23.05 MIN: 14.68 / MAX: 22.3 MIN: 0.27 / MAX: 21.93 MIN: 5.47 / MAX: 18.9 MIN: 5.14 / MAX: 18.58 MIN: 8.33 / MAX: 16.91 MIN: 0.53 / MAX: 17.18
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P 14 28 42 56 70 SE +/- 0.04, N = 3 SE +/- 0.44, N = 3 SE +/- 0.44, N = 3 SE +/- 0.17, N = 3 SE +/- 0.23, N = 3 SE +/- 1.12, N = 15 SE +/- 0.68, N = 3 SE +/- 0.62, N = 3 39.75 44.60 47.24 49.64 49.97 55.90 60.11 60.36 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.22, N = 3 SE +/- 0.20, N = 3 SE +/- 0.07, N = 3 SE +/- 0.09, N = 3 SE +/- 0.35, N = 15 SE +/- 0.19, N = 3 SE +/- 0.17, N = 3 25.16 22.43 21.17 20.15 20.01 17.99 16.64 16.57 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 0.1103 0.2206 0.3309 0.4412 0.5515 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 15 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 0.28 0.29 0.30 0.33 0.37 0.43 0.46 0.49 MIN: 0.25 / MAX: 41.4 MIN: 0.24 / MAX: 39.69 MIN: 0.26 / MAX: 42.1 MIN: 0.26 / MAX: 19.2 MIN: 0.28 / MAX: 40.85 MIN: 0.23 / MAX: 17.03 MIN: 0.18 / MAX: 22.29 MIN: 0.18 / MAX: 16.07 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ 40K 80K 120K 160K 200K SE +/- 2494.14, N = 3 SE +/- 1422.88, N = 15 SE +/- 18.38, N = 3 SE +/- 1761.33, N = 3 SE +/- 383.22, N = 3 SE +/- 1158.60, N = 3 SE +/- 75.30, N = 3 SE +/- 988.12, N = 3 189893.31 176900.32 174862.56 140144.01 135075.07 128566.81 115106.30 81279.79 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime Model: T5 Encoder - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 1.213 2.426 3.639 4.852 6.065 SE +/- 0.00472, N = 3 SE +/- 0.00659, N = 3 SE +/- 0.02371, N = 3 SE +/- 0.00316, N = 3 SE +/- 0.08827, N = 15 SE +/- 0.01103, N = 3 SE +/- 0.03283, N = 3 SE +/- 0.02608, N = 3 2.16966 2.79694 2.80263 3.46571 4.57581 4.64757 5.02267 5.39123 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: T5 Encoder - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: T5 Encoder - Device: CPU - Executor: Standard Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 100 200 300 400 500 SE +/- 1.00, N = 3 SE +/- 0.84, N = 3 SE +/- 3.01, N = 3 SE +/- 0.26, N = 3 SE +/- 3.95, N = 15 SE +/- 0.51, N = 3 SE +/- 1.31, N = 3 SE +/- 0.89, N = 3 460.78 357.36 356.76 288.47 219.53 215.13 199.08 185.46 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
Timed CPython Compilation Build Configuration: Released Build, PGO + LTO Optimized OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration: Released Build, PGO + LTO Optimized Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P 60 120 180 240 300 244.82 244.95 273.52 275.39 276.23 276.46 277.39 279.69
Appleseed Scene: Emily OpenBenchmarking.org Seconds, Fewer Is Better Appleseed 2.0 Beta Scene: Emily Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 30 60 90 120 150 119.80 120.75 128.60 129.96 130.62 132.13 137.00 137.46
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 100 200 300 400 500 SE +/- 0.74, N = 3 SE +/- 4.07, N = 3 SE +/- 0.94, N = 3 SE +/- 0.96, N = 3 SE +/- 1.73, N = 3 SE +/- 2.21, N = 3 SE +/- 5.57, N = 13 SE +/- 6.06, N = 3 302.27 327.88 329.04 352.74 380.90 382.11 460.67 475.25 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 0.7444 1.4888 2.2332 2.9776 3.722 SE +/- 0.00805, N = 3 SE +/- 0.03826, N = 3 SE +/- 0.00871, N = 3 SE +/- 0.00768, N = 3 SE +/- 0.01189, N = 3 SE +/- 0.01517, N = 3 SE +/- 0.02702, N = 13 SE +/- 0.02652, N = 3 3.30836 3.05085 3.03922 2.83498 2.62544 2.61721 2.17463 2.10480 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Bumper Beam Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P 20 40 60 80 100 SE +/- 0.23, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.22, N = 3 SE +/- 0.27, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.22, N = 3 78.27 78.71 79.54 80.32 81.30 81.72 83.44 86.11
Aircrack-ng OpenBenchmarking.org k/s, More Is Better Aircrack-ng 1.7 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 30K 60K 90K 120K 150K SE +/- 840.59, N = 3 SE +/- 1953.08, N = 3 SE +/- 122.31, N = 3 SE +/- 36.42, N = 3 SE +/- 1027.07, N = 15 SE +/- 1131.21, N = 15 SE +/- 773.70, N = 3 SE +/- 1197.41, N = 15 153584.20 147469.33 134048.96 117588.99 83665.76 65663.82 64181.29 53914.93 1. (CXX) g++ options: -std=gnu++17 -O3 -fvisibility=hidden -fcommon -rdynamic -lnl-3 -lnl-genl-3 -lpcre -lsqlite3 -lpthread -lz -lssl -lcrypto -lhwloc -ldl -lm -pthread
Helsing Digit Range: 14 digit OpenBenchmarking.org Seconds, Fewer Is Better Helsing 1.0-beta Digit Range: 14 digit Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.42, N = 3 SE +/- 0.11, N = 3 SE +/- 0.08, N = 3 SE +/- 0.26, N = 3 SE +/- 0.12, N = 3 SE +/- 0.53, N = 3 48.09 50.83 58.25 65.03 89.07 93.35 107.24 123.83 1. (CC) gcc options: -O2 -pthread
DaCapo Benchmark Java Test: Tradebeans OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Tradebeans Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 3K 6K 9K 12K 15K SE +/- 54.76, N = 15 SE +/- 51.68, N = 15 SE +/- 10.41, N = 3 SE +/- 66.27, N = 3 SE +/- 79.99, N = 3 SE +/- 64.94, N = 3 SE +/- 226.65, N = 15 SE +/- 16.01, N = 3 5994 6130 6672 6681 7270 8050 11004 12713
TensorFlow Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P 3 6 9 12 15 SE +/- 0.09, N = 4 SE +/- 0.05, N = 4 SE +/- 0.10, N = 4 SE +/- 0.05, N = 9 SE +/- 0.07, N = 3 SE +/- 0.06, N = 15 SE +/- 0.04, N = 15 SE +/- 0.03, N = 15 11.29 10.53 9.99 6.43 5.11 4.39 4.37 3.85
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 30 60 90 120 150 SE +/- 0.04, N = 3 SE +/- 1.12, N = 3 SE +/- 0.39, N = 3 SE +/- 1.28, N = 3 SE +/- 0.13, N = 3 SE +/- 0.93, N = 3 SE +/- 0.70, N = 3 SE +/- 0.50, N = 3 120.93 115.47 111.71 107.30 104.23 103.56 94.66 91.51
Blender Blend File: Pabellon Barcelona - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Pabellon Barcelona - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 20 40 60 80 100 SE +/- 0.06, N = 3 SE +/- 0.26, N = 3 SE +/- 0.20, N = 3 SE +/- 0.08, N = 3 SE +/- 0.09, N = 3 SE +/- 0.15, N = 3 SE +/- 0.44, N = 3 SE +/- 0.31, N = 3 41.85 46.38 51.29 55.26 80.29 87.92 97.80 106.96
libavif avifenc Encoder Speed: 0 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 0 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 20 40 60 80 100 SE +/- 0.03, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.32, N = 3 SE +/- 0.29, N = 3 SE +/- 0.32, N = 3 SE +/- 0.22, N = 3 SE +/- 0.15, N = 3 60.53 64.48 67.38 68.44 69.65 69.93 73.06 76.92 1. (CXX) g++ options: -O3 -fPIC -lm
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 500 1000 1500 2000 2500 SE +/- 0.00, N = 3 SE +/- 0.88, N = 3 SE +/- 0.33, N = 3 SE +/- 2.65, N = 3 SE +/- 1.45, N = 3 SE +/- 0.88, N = 3 SE +/- 1.20, N = 3 SE +/- 1.20, N = 3 898 1063 1143 1237 1709 1977 2123 2357
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: GoogLeNet Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 110 220 330 440 550 SE +/- 4.87, N = 3 SE +/- 2.68, N = 3 SE +/- 4.80, N = 3 SE +/- 0.24, N = 3 SE +/- 2.29, N = 3 SE +/- 2.30, N = 3 SE +/- 1.91, N = 3 SE +/- 1.67, N = 3 528.93 501.39 449.91 448.46 447.50 423.59 386.00 375.73
GraphicsMagick Operation: Rotate OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Rotate Xeon Platinum 8592+ Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 40 80 120 160 200 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 1.93, N = 6 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 203 197 196 194 182 172 148 143 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 400 800 1200 1600 2000 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 1.76, N = 3 SE +/- 0.88, N = 3 SE +/- 0.58, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 759 894 961 1049 1441 1657 1792 1988
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H 80 160 240 320 400 SE +/- 0.69, N = 3 SE +/- 0.33, N = 3 SE +/- 0.15, N = 3 SE +/- 0.40, N = 3 SE +/- 0.47, N = 3 SE +/- 0.35, N = 3 SE +/- 0.00, N = 3 SE +/- 0.28, N = 3 224.64 234.24 236.52 256.63 257.50 278.52 283.11 356.38 MIN: 153.29 / MAX: 553.64 MIN: 148.68 / MAX: 448.54 MIN: 172.47 / MAX: 265.77 MIN: 191.95 / MAX: 301.21 MIN: 187.62 / MAX: 295.06 MIN: 196.58 / MAX: 401.59 MIN: 203.37 / MAX: 332.08 MIN: 109.11 / MAX: 395.69 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 120 240 360 480 600 SE +/- 0.77, N = 3 SE +/- 0.01, N = 3 SE +/- 0.54, N = 3 SE +/- 0.58, N = 3 SE +/- 0.69, N = 3 SE +/- 0.41, N = 3 SE +/- 0.14, N = 3 SE +/- 0.12, N = 3 545.21 423.18 401.45 373.50 284.64 217.11 202.59 167.83 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 20K 40K 60K 80K 100K SE +/- 47.16, N = 3 SE +/- 125.33, N = 3 SE +/- 141.04, N = 3 SE +/- 155.80, N = 3 SE +/- 162.52, N = 3 SE +/- 58.68, N = 3 SE +/- 65.97, N = 3 SE +/- 41.33, N = 3 33391 38813 41971 45211 59522 68006 73366 80742
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 40 80 120 160 200 SE +/- 1.93, N = 15 SE +/- 0.99, N = 3 SE +/- 0.93, N = 3 SE +/- 1.48, N = 3 SE +/- 0.03, N = 3 SE +/- 0.31, N = 3 SE +/- 0.96, N = 4 SE +/- 0.31, N = 3 191.82 140.83 133.99 127.85 108.12 86.97 78.11 70.21 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM2 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1000 2000 3000 4000 5000 SE +/- 48.20, N = 15 SE +/- 24.63, N = 3 SE +/- 23.14, N = 3 SE +/- 36.96, N = 3 SE +/- 0.70, N = 3 SE +/- 7.77, N = 3 SE +/- 23.93, N = 4 SE +/- 7.81, N = 3 4795.46 3520.71 3349.76 3196.12 2703.09 2174.19 1952.61 1755.33 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 11 22 33 44 55 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.16, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 48.76 42.82 39.34 35.93 27.10 24.64 22.36 19.91
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 15K 30K 45K 60K 75K SE +/- 16.05, N = 3 SE +/- 64.24, N = 3 SE +/- 13.86, N = 3 SE +/- 37.55, N = 3 SE +/- 90.37, N = 3 SE +/- 102.40, N = 3 SE +/- 64.91, N = 3 SE +/- 134.33, N = 3 24249 33411 36179 38926 50798 58026 62540 68973
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 8K 16K 24K 32K 40K SE +/- 7.13, N = 3 SE +/- 34.10, N = 3 SE +/- 51.39, N = 3 SE +/- 72.42, N = 3 SE +/- 37.49, N = 3 SE +/- 62.46, N = 3 SE +/- 83.47, N = 3 SE +/- 28.06, N = 3 12124 14138 15357 16645 23125 31380 33790 37055
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H 0.8055 1.611 2.4165 3.222 4.0275 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 4 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 2.36 2.48 2.50 2.50 2.53 2.67 2.79 3.58 MIN: 2.02 / MAX: 21.33 MIN: 1.98 / MAX: 34.01 MIN: 2.28 / MAX: 40.8 MIN: 2.22 / MAX: 27.89 MIN: 2.23 / MAX: 31.44 MIN: 2.39 / MAX: 34.22 MIN: 2.44 / MAX: 34.21 MIN: 1.4 / MAX: 12.71 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 10K 20K 30K 40K 50K SE +/- 39.08, N = 3 SE +/- 53.98, N = 3 SE +/- 233.95, N = 3 SE +/- 80.58, N = 3 SE +/- 47.41, N = 3 SE +/- 21.27, N = 3 SE +/- 234.43, N = 4 SE +/- 2.71, N = 3 48122.16 47654.95 40032.81 37710.60 26943.42 20910.53 19183.83 15943.17 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 9.40 11.37 12.72 13.15 13.95 15.96 17.15 18.72 MIN: 7.66 / MAX: 25.07 MIN: 9.17 / MAX: 32.12 MIN: 9.56 / MAX: 30.66 MIN: 7.28 / MAX: 47.97 MIN: 8.67 / MAX: 65.92 MIN: 10.38 / MAX: 43.64 MIN: 10.81 / MAX: 59.34 MIN: 12.15 / MAX: 64.81 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Noise Suppression Poconet-Like FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Noise Suppression Poconet-Like FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2K 4K 6K 8K 10K SE +/- 24.76, N = 3 SE +/- 13.31, N = 3 SE +/- 10.14, N = 3 SE +/- 28.98, N = 3 SE +/- 37.79, N = 3 SE +/- 7.60, N = 3 SE +/- 1.87, N = 3 SE +/- 15.13, N = 3 9360.89 7356.63 6757.26 5933.65 5565.23 4386.48 4209.10 4208.49 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 9K 18K 27K 36K 45K SE +/- 8.00, N = 3 SE +/- 29.96, N = 3 SE +/- 10.97, N = 3 SE +/- 25.12, N = 3 SE +/- 26.00, N = 3 SE +/- 61.20, N = 3 SE +/- 74.33, N = 3 SE +/- 36.47, N = 3 14358 16837 18111 19701 31993 36649 39238 42837
ONNX Runtime Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 0.4698 0.9396 1.4094 1.8792 2.349 SE +/- 0.01491, N = 4 SE +/- 0.00936, N = 3 SE +/- 0.00884, N = 3 SE +/- 0.01053, N = 3 SE +/- 0.00701, N = 3 SE +/- 0.01492, N = 3 SE +/- 0.00720, N = 3 SE +/- 0.00871, N = 3 1.20298 1.27368 1.45280 1.47249 1.64919 1.76353 2.02659 2.08780 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 200 400 600 800 1000 SE +/- 10.06, N = 4 SE +/- 5.72, N = 3 SE +/- 4.16, N = 3 SE +/- 4.87, N = 3 SE +/- 2.57, N = 3 SE +/- 4.81, N = 3 SE +/- 1.77, N = 3 SE +/- 1.98, N = 3 830.73 784.30 687.67 678.48 605.59 566.38 492.89 478.47 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 11.17 11.69 12.54 13.34 13.59 14.42 15.04 16.50 MIN: 10.18 / MAX: 19.36 MIN: 10.28 / MAX: 42.12 MIN: 9.17 / MAX: 21.01 MIN: 9.67 / MAX: 39.84 MIN: 9.53 / MAX: 21.61 MIN: 9.74 / MAX: 43.95 MIN: 12.32 / MAX: 32.87 MIN: 11.95 / MAX: 28.87 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Vehicle Bike Detection FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2K 4K 6K 8K 10K SE +/- 3.37, N = 3 SE +/- 8.98, N = 3 SE +/- 3.66, N = 3 SE +/- 4.05, N = 3 SE +/- 4.97, N = 3 SE +/- 9.37, N = 3 SE +/- 7.17, N = 3 SE +/- 4.52, N = 3 10934.17 7862.58 7689.32 7127.28 5725.03 4093.73 3802.61 3606.12 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 6.72 6.95 7.13 7.32 7.72 7.76 7.97 9.79 MIN: 6.22 / MAX: 11.15 MIN: 6.28 / MAX: 20.42 MIN: 6.64 / MAX: 12.22 MIN: 6.78 / MAX: 18.72 MIN: 7.16 / MAX: 18.31 MIN: 6.86 / MAX: 12.92 MIN: 7.04 / MAX: 21.51 MIN: 4.37 / MAX: 18.18 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Re-Identification Retail FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Re-Identification Retail FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 4K 8K 12K 16K 20K SE +/- 7.74, N = 3 SE +/- 4.14, N = 3 SE +/- 7.22, N = 3 SE +/- 3.67, N = 3 SE +/- 5.57, N = 3 SE +/- 0.46, N = 3 SE +/- 3.72, N = 3 SE +/- 3.97, N = 3 18375.63 15519.92 14033.94 13102.28 9515.86 7207.74 6717.65 5943.66 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Platinum 8592+ Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H 2P 15 30 45 60 75 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 SE +/- 0.14, N = 3 SE +/- 0.05, N = 3 SE +/- 0.28, N = 3 SE +/- 0.06, N = 3 SE +/- 0.21, N = 3 SE +/- 0.03, N = 3 55.07 55.74 55.99 56.71 57.13 62.11 62.53 65.02 MIN: 46.78 / MAX: 80.73 MIN: 44.83 / MAX: 69.99 MIN: 27.63 / MAX: 76.45 MIN: 45.43 / MAX: 89.46 MIN: 39.58 / MAX: 104.91 MIN: 47.82 / MAX: 101.26 MIN: 48.23 / MAX: 78.43 MIN: 55.15 / MAX: 104.43 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 500 1000 1500 2000 2500 SE +/- 11.53, N = 3 SE +/- 0.66, N = 3 SE +/- 1.74, N = 3 SE +/- 1.56, N = 3 SE +/- 0.47, N = 3 SE +/- 2.65, N = 3 SE +/- 2.94, N = 3 SE +/- 2.29, N = 3 2237.69 1843.61 1801.89 1691.79 1159.66 1068.43 894.87 860.64 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
QuantLib Configuration: Multi-Threaded OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Multi-Threaded Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 80K 160K 240K 320K 400K SE +/- 248.00, N = 3 SE +/- 362.38, N = 3 SE +/- 160.59, N = 3 SE +/- 286.86, N = 3 SE +/- 63.14, N = 3 SE +/- 105.60, N = 3 SE +/- 40.48, N = 3 SE +/- 155.19, N = 3 380867.5 350187.5 316359.2 288129.1 195648.8 179647.5 162727.4 143755.3 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
ONNX Runtime Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P 8 16 24 32 40 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.31, N = 3 SE +/- 0.33, N = 3 SE +/- 0.40, N = 3 28.85 29.02 29.41 29.75 33.33 33.99 36.00 36.23 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P 8 16 24 32 40 SE +/- 0.11, N = 3 SE +/- 0.10, N = 3 SE +/- 0.05, N = 3 SE +/- 0.13, N = 3 SE +/- 0.09, N = 3 SE +/- 0.27, N = 3 SE +/- 0.26, N = 3 SE +/- 0.31, N = 3 34.66 34.46 34.00 33.61 30.00 29.43 27.78 27.61 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 9 18 27 36 45 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.13, N = 3 SE +/- 0.08, N = 3 SE +/- 0.55, N = 3 SE +/- 0.32, N = 3 29.96 30.92 31.53 33.29 35.07 35.11 40.45 40.52 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.07, N = 3 SE +/- 0.34, N = 3 SE +/- 0.19, N = 3 33.38 32.34 31.71 30.04 28.52 28.48 24.73 24.68 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
JPEG-XL libjxl Input: JPEG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: JPEG - Quality: 90 Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 2P 11 22 33 44 55 SE +/- 0.53, N = 15 SE +/- 0.21, N = 3 SE +/- 0.35, N = 3 SE +/- 0.67, N = 12 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 SE +/- 0.34, N = 8 SE +/- 0.36, N = 5 48.36 43.63 43.20 42.97 42.04 39.59 39.10 34.63 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 39.62 41.93 42.16 43.41 45.78 59.69 64.91 100.39 MIN: 26.71 / MAX: 62.24 MIN: 27.14 / MAX: 54.05 MIN: 32.47 / MAX: 70.84 MIN: 27.3 / MAX: 82.85 MIN: 33.94 / MAX: 85.21 MIN: 42.86 / MAX: 84.25 MIN: 49.88 / MAX: 107.03 MIN: 41.76 / MAX: 139.86 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Person Detection FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 160 320 480 640 800 SE +/- 1.42, N = 3 SE +/- 0.69, N = 3 SE +/- 0.55, N = 3 SE +/- 1.28, N = 3 SE +/- 0.95, N = 3 SE +/- 0.52, N = 3 SE +/- 0.04, N = 3 SE +/- 1.23, N = 3 736.23 654.84 569.60 568.81 403.20 301.30 298.56 285.95 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 2 4 6 8 10 SE +/- 0.00434, N = 3 SE +/- 0.02114, N = 3 SE +/- 0.01428, N = 3 SE +/- 0.02823, N = 3 SE +/- 0.07483, N = 3 SE +/- 0.03717, N = 3 SE +/- 0.01417, N = 3 SE +/- 0.08283, N = 3 4.01687 5.10948 5.21520 5.22781 5.29027 6.90619 7.30822 7.34848 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: GPT-2 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: GPT-2 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 50 100 150 200 250 SE +/- 0.27, N = 3 SE +/- 0.81, N = 3 SE +/- 0.53, N = 3 SE +/- 1.04, N = 3 SE +/- 2.63, N = 3 SE +/- 0.78, N = 3 SE +/- 0.26, N = 3 SE +/- 1.53, N = 3 248.68 195.45 191.56 191.11 188.93 144.64 136.69 135.98 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H 14 28 42 56 70 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.16, N = 3 SE +/- 0.34, N = 3 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 26.85 28.17 28.73 29.98 37.58 38.50 41.57 62.46 MIN: 20.18 / MAX: 307.38 MIN: 20.12 / MAX: 261.31 MIN: 19.52 / MAX: 209.26 MIN: 20.48 / MAX: 222.7 MIN: 20.58 / MAX: 347.67 MIN: 25.18 / MAX: 161.13 MIN: 28.11 / MAX: 155.06 MIN: 46.12 / MAX: 79.06 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Machine Translation EN To DE FP16 - Device: CPU Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 200 400 600 800 1000 SE +/- 0.85, N = 3 SE +/- 1.13, N = 3 SE +/- 1.99, N = 3 SE +/- 3.48, N = 3 SE +/- 0.54, N = 3 SE +/- 0.17, N = 3 SE +/- 4.09, N = 3 SE +/- 1.21, N = 3 1128.78 889.18 795.63 793.64 592.20 477.77 467.08 415.96 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
Node.js V8 Web Tooling Benchmark OpenBenchmarking.org runs/s, More Is Better Node.js V8 Web Tooling Benchmark Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 4 8 12 16 20 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 SE +/- 0.11, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 SE +/- 0.07, N = 3 17.42 17.02 15.76 15.62 15.59 15.49 14.99 14.51
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H 2P 5 10 15 20 25 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 13.73 14.67 16.33 17.19 17.84 19.44 20.24 21.73 MIN: 12.23 / MAX: 23.01 MIN: 12.73 / MAX: 41.28 MIN: 13.49 / MAX: 26.98 MIN: 13.16 / MAX: 42.02 MIN: 9.08 / MAX: 37.11 MIN: 15.1 / MAX: 32.19 MIN: 13.69 / MAX: 36.9 MIN: 15.08 / MAX: 39.82 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Vehicle Detection FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 2K 4K 6K 8K 10K SE +/- 6.25, N = 3 SE +/- 4.11, N = 3 SE +/- 8.70, N = 3 SE +/- 11.51, N = 3 SE +/- 0.73, N = 3 SE +/- 0.81, N = 3 SE +/- 8.09, N = 3 SE +/- 5.68, N = 3 8719.37 5576.86 5525.56 5483.81 4656.92 3325.90 2935.47 2877.32 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.30, N = 3 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.22, N = 3 SE +/- 0.57, N = 3 SE +/- 0.74, N = 3 SE +/- 0.09, N = 3 SE +/- 0.13, N = 3 47.90 55.12 61.01 61.83 70.44 76.42 78.40 79.38 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: yolov4 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: yolov4 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.13, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 SE +/- 0.13, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 20.88 18.14 16.39 16.17 14.20 13.09 12.75 12.60 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 16 32 48 64 80 SE +/- 0.57, N = 3 SE +/- 0.23, N = 3 SE +/- 0.18, N = 3 SE +/- 0.31, N = 3 SE +/- 0.12, N = 3 SE +/- 0.11, N = 3 SE +/- 0.50, N = 3 SE +/- 0.23, N = 3 50.83 61.25 62.13 63.54 64.79 68.83 72.80 73.97 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: bertsquad-12 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: bertsquad-12 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.22, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 19.68 16.33 16.10 15.74 15.43 14.53 13.74 13.52 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 5.18 5.19 5.27 5.55 5.72 5.77 6.02 6.43 MIN: 4.74 / MAX: 26.35 MIN: 4.72 / MAX: 11.02 MIN: 4.98 / MAX: 13.16 MIN: 5.12 / MAX: 24.99 MIN: 5.1 / MAX: 17.93 MIN: 5.26 / MAX: 13.86 MIN: 5.37 / MAX: 27.77 MIN: 3.84 / MAX: 15.83 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Face Detection Retail FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 5K 10K 15K 20K 25K SE +/- 17.69, N = 3 SE +/- 12.64, N = 3 SE +/- 3.89, N = 3 SE +/- 12.64, N = 3 SE +/- 4.30, N = 3 SE +/- 7.39, N = 3 SE +/- 18.13, N = 3 SE +/- 5.45, N = 3 24676.86 20937.58 18561.91 17252.27 12317.94 9686.39 9087.12 9004.23 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 8 16 24 32 40 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.17, N = 3 SE +/- 0.11, N = 3 SE +/- 0.28, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 16.55 21.34 23.66 24.55 30.47 31.79 34.25 34.31 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 14 28 42 56 70 SE +/- 0.27, N = 3 SE +/- 0.10, N = 3 SE +/- 0.21, N = 3 SE +/- 0.28, N = 3 SE +/- 0.12, N = 3 SE +/- 0.27, N = 3 SE +/- 0.11, N = 3 SE +/- 0.09, N = 3 60.41 46.85 42.27 40.73 32.81 31.46 29.20 29.15 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8490H 8 16 24 32 40 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 21.87 22.96 23.12 24.00 24.94 25.12 25.72 36.20 MIN: 20.16 / MAX: 32.36 MIN: 20.8 / MAX: 34.86 MIN: 18.74 / MAX: 31.08 MIN: 19.19 / MAX: 45.88 MIN: 19.75 / MAX: 33.18 MIN: 19.86 / MAX: 59.96 MIN: 20.7 / MAX: 44.98 MIN: 20.73 / MAX: 45.28 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2024.0 Model: Handwritten English Recognition FP16-INT8 - Device: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 1200 2400 3600 4800 6000 SE +/- 3.43, N = 3 SE +/- 2.46, N = 3 SE +/- 2.81, N = 3 SE +/- 1.09, N = 3 SE +/- 0.73, N = 3 SE +/- 4.55, N = 3 SE +/- 3.41, N = 3 SE +/- 1.46, N = 3 5570.63 4744.05 4351.59 3998.02 2924.66 2243.84 2074.30 1643.43 1. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl
GraphicsMagick Operation: Sharpen OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Sharpen Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 60 120 180 240 300 SE +/- 1.67, N = 3 SE +/- 1.67, N = 3 SE +/- 0.33, N = 3 SE +/- 1.20, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 284 265 227 199 167 157 130 114 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
GraphicsMagick Operation: Noise-Gaussian OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Noise-Gaussian Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9468 40 80 120 160 200 SE +/- 0.88, N = 3 SE +/- 1.15, N = 3 SE +/- 0.00, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 194 182 171 164 158 158 150 150 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
GraphicsMagick Operation: Resizing OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Resizing Xeon Max 9468 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P 50 100 150 200 250 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 245 230 229 213 108 97 96 95 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
ONNX Runtime Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P 2 4 6 8 10 SE +/- 0.01698, N = 3 SE +/- 0.00544, N = 3 SE +/- 0.02630, N = 3 SE +/- 0.03023, N = 3 SE +/- 0.01680, N = 3 SE +/- 0.02968, N = 3 SE +/- 0.06875, N = 3 SE +/- 0.03080, N = 3 3.13366 3.19298 3.23780 3.32030 6.00525 6.39031 6.49693 6.51744 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P 70 140 210 280 350 SE +/- 1.74, N = 3 SE +/- 0.53, N = 3 SE +/- 2.50, N = 3 SE +/- 2.72, N = 3 SE +/- 0.47, N = 3 SE +/- 0.73, N = 3 SE +/- 1.63, N = 3 SE +/- 0.73, N = 3 319.04 313.10 308.80 301.14 166.49 156.46 153.92 153.41 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
GraphicsMagick Operation: HWB Color Space OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: HWB Color Space Xeon Max 9468 Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 60 120 180 240 300 SE +/- 1.00, N = 3 SE +/- 0.67, N = 3 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 SE +/- 2.40, N = 3 SE +/- 1.20, N = 3 286 285 277 265 256 236 207 193 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
GraphicsMagick Operation: Enhanced OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Enhanced Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 80 160 240 320 400 SE +/- 1.15, N = 3 SE +/- 0.33, N = 3 SE +/- 1.00, N = 3 SE +/- 2.60, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 374 342 301 269 228 216 181 160 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 1.3244 2.6488 3.9732 5.2976 6.622 SE +/- 0.03569, N = 3 SE +/- 0.02988, N = 3 SE +/- 0.05586, N = 3 SE +/- 0.02534, N = 3 SE +/- 0.01694, N = 3 SE +/- 0.02062, N = 3 SE +/- 0.03854, N = 3 SE +/- 0.02155, N = 3 4.26352 4.65431 4.86604 5.10914 5.26075 5.29287 5.74921 5.88628 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
ONNX Runtime Model: super-resolution-10 - Device: CPU - Executor: Parallel OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.17 Model: super-resolution-10 - Device: CPU - Executor: Parallel Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 50 100 150 200 250 SE +/- 1.98, N = 3 SE +/- 1.38, N = 3 SE +/- 2.34, N = 3 SE +/- 0.98, N = 3 SE +/- 0.61, N = 3 SE +/- 0.74, N = 3 SE +/- 1.17, N = 3 SE +/- 0.62, N = 3 234.54 214.81 205.53 195.71 190.06 188.89 173.91 169.85 1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt
GraphicsMagick Operation: Swirl OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.43 Operation: Swirl Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 150 300 450 600 750 SE +/- 0.58, N = 3 SE +/- 1.76, N = 3 SE +/- 0.67, N = 3 SE +/- 0.88, N = 3 SE +/- 1.33, N = 3 SE +/- 1.15, N = 3 SE +/- 0.67, N = 3 SE +/- 0.58, N = 3 689 617 558 529 509 502 432 394 1. (CC) gcc options: -fopenmp -O2 -ltiff -ljbig -lsharpyuv -lwebp -lwebpmux -lfreetype -ljpeg -lXext -lSM -lICE -lX11 -lxml2 -lzstd -llzma -lbz2 -lz -lm -lpthread -lgomp
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 9.0 Test: Random Read Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 120M 240M 360M 480M 600M SE +/- 82996.27, N = 3 SE +/- 1411218.60, N = 3 SE +/- 785893.13, N = 3 SE +/- 1120857.00, N = 3 SE +/- 1119855.47, N = 3 SE +/- 3338569.32, N = 3 SE +/- 86315.43, N = 3 SE +/- 81327.78, N = 3 578392800 525049998 473755946 405533173 297517946 265366170 234469939 205346154 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Classroom - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 20 40 60 80 100 SE +/- 0.22, N = 3 SE +/- 0.05, N = 3 SE +/- 0.25, N = 3 SE +/- 0.38, N = 3 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.40, N = 3 SE +/- 0.20, N = 3 33.61 35.91 40.38 44.71 63.61 68.61 76.87 86.67
PyTorch Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 256 - Model: ResNet-50 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 14 28 42 56 70 SE +/- 0.64, N = 3 SE +/- 0.52, N = 3 SE +/- 0.76, N = 3 SE +/- 0.62, N = 3 SE +/- 0.52, N = 3 SE +/- 0.29, N = 3 SE +/- 0.45, N = 3 SE +/- 0.49, N = 3 63.60 54.84 52.97 51.56 41.68 41.45 37.91 37.44 MIN: 37.79 / MAX: 65.67 MIN: 46.5 / MAX: 58.5 MIN: 33.28 / MAX: 55.78 MIN: 30.49 / MAX: 54.7 MIN: 37.38 / MAX: 44.02 MIN: 38.42 / MAX: 42.93 MIN: 16.15 / MAX: 40.53 MIN: 26.88 / MAX: 41.26
PyTorch Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 64 - Model: ResNet-50 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 14 28 42 56 70 SE +/- 0.12, N = 3 SE +/- 0.24, N = 3 SE +/- 0.71, N = 3 SE +/- 0.62, N = 3 SE +/- 0.51, N = 3 SE +/- 0.12, N = 3 SE +/- 0.46, N = 4 SE +/- 0.50, N = 3 63.06 56.01 51.55 51.35 42.35 40.77 38.30 37.08 MIN: 33.2 / MAX: 65.54 MIN: 51.84 / MAX: 59.12 MIN: 37.49 / MAX: 54.33 MIN: 41.6 / MAX: 53.81 MIN: 36.76 / MAX: 44.4 MIN: 16.88 / MAX: 42.06 MIN: 27.11 / MAX: 40.39 MIN: 26.46 / MAX: 40.15
CloverLeaf Input: clover_bm64_short OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm64_short Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 10 20 30 40 50 SE +/- 0.24, N = 3 SE +/- 0.45, N = 3 SE +/- 0.31, N = 15 SE +/- 0.40, N = 4 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.15, N = 3 SE +/- 0.17, N = 3 26.58 31.90 32.25 32.44 39.38 39.48 41.43 42.22 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
Llamafile Test: llava-v1.5-7b-q4 - Acceleration: CPU OpenBenchmarking.org Tokens Per Second, More Is Better Llamafile 0.7 Test: llava-v1.5-7b-q4 - Acceleration: CPU Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Max 9480 2P 5 10 15 20 25 SE +/- 0.15, N = 4 SE +/- 0.17, N = 4 SE +/- 0.09, N = 15 SE +/- 0.02, N = 3 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 SE +/- 1.08, N = 12 SE +/- 0.04, N = 3 20.95 16.61 10.44 8.13 7.77 7.67 7.49 7.26
srsRAN Project Test: PDSCH Processor Benchmark, Throughput Total OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Total Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P 7K 14K 21K 28K 35K SE +/- 356.81, N = 15 SE +/- 175.78, N = 4 SE +/- 312.17, N = 3 SE +/- 298.34, N = 15 SE +/- 236.27, N = 4 SE +/- 938.95, N = 15 SE +/- 281.72, N = 15 SE +/- 490.54, N = 15 30547.6 30236.0 30108.7 26378.1 24688.5 21286.6 15081.0 11866.7 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
RawTherapee Total Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better RawTherapee Total Benchmark Time Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 2P 13 26 39 52 65 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.05, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.19, N = 3 42.78 46.76 46.96 47.09 52.69 53.76 55.44 56.78 1. RawTherapee, version 5.10, command line.
GPAW Input: Carbon Nanotube OpenBenchmarking.org Seconds, Fewer Is Better GPAW 23.6 Input: Carbon Nanotube Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 12 24 36 48 60 SE +/- 0.10, N = 3 SE +/- 0.55, N = 3 SE +/- 0.08, N = 3 SE +/- 0.12, N = 3 SE +/- 0.27, N = 3 SE +/- 0.24, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 38.05 41.56 42.87 43.05 43.91 47.78 48.49 54.38 1. (CC) gcc options: -shared -lxc -lblas -lmpi
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Faster Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 4 8 12 16 20 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.13, N = 3 SE +/- 0.05, N = 3 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 SE +/- 0.13, N = 3 SE +/- 0.11, N = 3 15.97 15.06 14.36 14.10 13.26 12.54 11.97 11.90 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
Coremark CoreMark Size 666 - Iterations Per Second OpenBenchmarking.org Iterations/Sec, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1.1M 2.2M 3.3M 4.4M 5.5M SE +/- 9700.21, N = 3 SE +/- 12743.41, N = 3 SE +/- 20649.43, N = 3 SE +/- 7219.73, N = 3 SE +/- 4635.95, N = 3 SE +/- 9256.47, N = 3 SE +/- 5202.86, N = 3 SE +/- 1747.99, N = 3 4966250.78 3902076.24 3279262.53 2993136.60 2369998.36 2194630.60 1855135.33 1614763.70 1. (CC) gcc options: -O2 -lrt" -lrt
miniFE Problem Size: Small OpenBenchmarking.org CG Mflops, More Is Better miniFE 2.2 Problem Size: Small Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 10K 20K 30K 40K 50K SE +/- 467.78, N = 4 SE +/- 1633.92, N = 15 SE +/- 11.14, N = 4 SE +/- 135.77, N = 4 SE +/- 283.44, N = 3 SE +/- 601.03, N = 12 SE +/- 1097.75, N = 15 SE +/- 572.00, N = 12 46877.5 42114.6 35230.1 31830.2 21583.2 20091.1 19876.5 18621.2 1. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi
Timed PHP Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed PHP Compilation 8.3.4 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 11 22 33 44 55 SE +/- 0.09, N = 3 SE +/- 0.31, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.16, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 40.38 41.85 46.57 46.64 46.87 47.95 48.01 48.71
John The Ripper Test: WPA PSK OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: WPA PSK Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 200K 400K 600K 800K 1000K SE +/- 15579.94, N = 15 SE +/- 2519.00, N = 3 SE +/- 788.50, N = 3 SE +/- 5122.51, N = 3 SE +/- 864.17, N = 3 SE +/- 1599.31, N = 3 SE +/- 1274.00, N = 3 SE +/- 987.33, N = 3 797093 793253 657889 562875 428116 401278 334076 286552 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 120K 240K 360K 480K 600K SE +/- 28320.74, N = 3 SE +/- 185.14, N = 3 SE +/- 6276.88, N = 3 SE +/- 2598.93, N = 3 SE +/- 119.21, N = 3 SE +/- 61.74, N = 3 SE +/- 374.59, N = 3 SE +/- 916.22, N = 3 573410 557054 469131 401707 338146 287862 243347 207738 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 140K 280K 420K 560K 700K SE +/- 709.87, N = 3 SE +/- 4200.62, N = 3 SE +/- 3924.87, N = 3 SE +/- 5127.15, N = 3 SE +/- 1982.97, N = 3 SE +/- 1535.53, N = 3 SE +/- 2258.81, N = 3 SE +/- 1836.55, N = 3 674239 592729 525514 491729 441636 388190 342363 314716 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
LuxCoreRender Scene: Rainbow Colors and Prism - Acceleration: CPU OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Rainbow Colors and Prism - Acceleration: CPU Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P 4 8 12 16 20 SE +/- 0.15, N = 4 SE +/- 0.05, N = 4 SE +/- 0.06, N = 4 SE +/- 0.12, N = 7 SE +/- 0.07, N = 15 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.10, N = 15 14.28 13.54 12.97 12.80 9.64 7.22 6.51 5.96 MIN: 12.85 / MAX: 14.54 MIN: 13.42 / MAX: 13.68 MIN: 12.11 / MAX: 13.11 MIN: 11.39 / MAX: 13.21 MIN: 8.98 / MAX: 10.13 MIN: 7.13 / MAX: 7.4 MIN: 6.27 / MAX: 6.67 MIN: 5.5 / MAX: 7.04
Liquid-DSP Threads: 1 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P 4M 8M 12M 16M 20M SE +/- 9492.69, N = 3 SE +/- 162096.41, N = 15 SE +/- 5238.74, N = 3 SE +/- 17457.89, N = 3 SE +/- 30179.10, N = 3 SE +/- 7571.88, N = 3 SE +/- 8685.88, N = 3 SE +/- 38670.98, N = 3 18774333 18200533 16906333 16904667 16885333 16884000 16882333 16843333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 10 20 30 40 50 SE +/- 0.23, N = 7 SE +/- 0.43, N = 3 SE +/- 0.31, N = 5 SE +/- 0.40, N = 4 SE +/- 0.39, N = 4 SE +/- 0.55, N = 3 SE +/- 0.57, N = 3 SE +/- 0.59, N = 3 25.87 29.98 30.53 32.14 34.59 39.45 40.50 43.42
WebP Image Encode Encode Settings: Quality 100, Lossless, Highest Compression OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless, Highest Compression Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P 0.135 0.27 0.405 0.54 0.675 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.60 0.59 0.55 0.55 0.54 0.54 0.52 0.51 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 512 - Model: AlexNet Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 400 800 1200 1600 2000 SE +/- 19.23, N = 3 SE +/- 18.52, N = 3 SE +/- 8.55, N = 3 SE +/- 17.88, N = 4 SE +/- 1.84, N = 3 SE +/- 0.51, N = 3 SE +/- 5.13, N = 3 SE +/- 3.89, N = 3 2039.63 1899.64 1677.62 1604.11 1486.12 1278.45 1108.95 1047.96
JPEG-XL libjxl Input: PNG - Quality: 90 OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: PNG - Quality: 90 Xeon Platinum 8592+ Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P 11 22 33 44 55 SE +/- 0.49, N = 14 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 SE +/- 0.04, N = 3 SE +/- 0.12, N = 3 SE +/- 0.50, N = 3 SE +/- 0.05, N = 3 SE +/- 0.32, N = 3 46.32 43.36 42.91 40.35 40.08 39.52 34.83 33.27 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
Primesieve Length: 1e13 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e13 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 15 30 45 60 75 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.07, N = 3 25.02 27.11 30.20 33.92 48.41 51.82 58.16 67.32 1. (CXX) g++ options: -O3
Graph500 Scale: 26 OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 100M 200M 300M 400M 500M 484977000 416523000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 140M 280M 420M 560M 700M 667365000 539613000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 300M 600M 900M 1200M 1500M 1244300000 1204520000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 300M 600M 900M 1200M 1500M 1299170000 1267480000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Liquid-DSP Threads: 1 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P 16M 32M 48M 64M 80M SE +/- 599433.09, N = 9 SE +/- 68119.99, N = 3 SE +/- 4910.31, N = 3 SE +/- 5364.49, N = 3 SE +/- 666.67, N = 3 SE +/- 4163.33, N = 3 SE +/- 3844.19, N = 3 SE +/- 822374.71, N = 4 73140667 70499000 67130333 67127667 67074667 67064000 66991333 66266000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
srsRAN Project Test: PUSCH Processor Benchmark, Throughput Total OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Total Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1200 2400 3600 4800 6000 SE +/- 0.12, N = 3 SE +/- 47.68, N = 6 SE +/- 0.15, N = 3 SE +/- 26.47, N = 3 SE +/- 18.09, N = 3 SE +/- 18.43, N = 3 SE +/- 18.30, N = 3 SE +/- 0.09, N = 3 5493.4 4853.6 4386.6 3787.0 3088.7 2616.9 2514.0 2170.7 MIN: 3703.4 / MAX: 5493.6 MIN: 3181.8 / MAX: 4929.4 MIN: 2970.2 / MAX: 4386.9 MIN: 2545.7 / MAX: 3839.9 MIN: 1852.6 / MAX: 3124.9 MIN: 1591.7 / MAX: 2653.8 MIN: 1550.4 / MAX: 2532.5 MIN: 1388.2 / MAX: 2170.8 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
libavif avifenc Encoder Speed: 2 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 2 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 9 18 27 36 45 SE +/- 0.09, N = 3 SE +/- 0.05, N = 3 SE +/- 0.16, N = 3 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 SE +/- 0.22, N = 3 SE +/- 0.31, N = 3 SE +/- 0.21, N = 3 33.65 34.79 37.31 37.75 38.14 38.65 39.88 41.13 1. (CXX) g++ options: -O3 -fPIC -lm
ASKAP Test: tConvolve MPI - Gridding OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Gridding Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 15K 30K 45K 60K 75K SE +/- 1080.03, N = 3 SE +/- 802.88, N = 3 SE +/- 194.30, N = 3 SE +/- 412.68, N = 4 SE +/- 219.20, N = 3 SE +/- 0.00, N = 3 SE +/- 99.83, N = 3 SE +/- 76.67, N = 3 72004.0 45195.1 42939.2 41773.0 37265.9 23250.2 21766.5 21314.2 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
ASKAP Test: tConvolve MPI - Degridding OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Degridding Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 13K 26K 39K 52K 65K SE +/- 480.95, N = 3 SE +/- 0.00, N = 3 SE +/- 143.60, N = 3 SE +/- 378.22, N = 4 SE +/- 153.57, N = 3 SE +/- 76.47, N = 3 SE +/- 0.00, N = 3 SE +/- 93.91, N = 3 59139.2 40368.6 36900.5 34614.1 31177.2 20561.4 18522.0 17891.6 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
OpenRadioss Model: Cell Phone Drop Test OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2023.09.15 Model: Cell Phone Drop Test Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 8 16 24 32 40 SE +/- 0.32, N = 3 SE +/- 0.01, N = 3 SE +/- 0.05, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 26.88 27.51 27.63 27.90 28.22 31.49 31.92 33.75
Liquid-DSP Threads: 64 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 200M 400M 600M 800M 1000M SE +/- 7562646.32, N = 8 SE +/- 3717554.45, N = 3 SE +/- 1515552.70, N = 3 SE +/- 6141471.96, N = 3 SE +/- 940265.92, N = 3 SE +/- 4432294.36, N = 3 SE +/- 1289603.73, N = 3 SE +/- 1611276.24, N = 3 883701250 799496667 783770000 757176667 744410000 732560000 689003333 632396667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 1 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8490H 2P 9M 18M 27M 36M 45M SE +/- 417042.80, N = 5 SE +/- 419600.12, N = 5 SE +/- 3000.00, N = 3 SE +/- 1666.67, N = 3 SE +/- 1452.97, N = 3 SE +/- 1527.53, N = 3 SE +/- 1201.85, N = 3 SE +/- 1154.70, N = 3 40244000 38950600 36539000 36537667 36521333 36506000 36497667 36461000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Timed Wasmer Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Wasmer Compilation 2.3 Time To Compile Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 8 16 24 32 40 SE +/- 0.05, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.16, N = 3 SE +/- 0.11, N = 3 SE +/- 0.16, N = 3 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 30.17 30.47 34.93 35.20 35.46 35.66 35.70 36.20 1. (CC) gcc options: -m64 -ldl -lgcc_s -lutil -lrt -lpthread -lm -lc -pie -nodefaultlibs
PyTorch Device: CPU - Batch Size: 1 - Model: ResNet-50 OpenBenchmarking.org batches/sec, More Is Better PyTorch 2.2.1 Device: CPU - Batch Size: 1 - Model: ResNet-50 Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P 20 40 60 80 100 SE +/- 0.16, N = 3 SE +/- 0.03, N = 3 SE +/- 0.28, N = 3 SE +/- 0.36, N = 3 SE +/- 0.38, N = 8 SE +/- 0.52, N = 3 SE +/- 0.49, N = 3 SE +/- 0.44, N = 3 77.52 51.46 50.99 48.59 46.49 45.69 35.53 35.46 MIN: 36.51 / MAX: 79.65 MIN: 35.78 / MAX: 55.29 MIN: 11.73 / MAX: 59.01 MIN: 4.58 / MAX: 55.2 MIN: 15.6 / MAX: 50.65 MIN: 13.24 / MAX: 48.92 MIN: 16.36 / MAX: 38.41 MIN: 0.7 / MAX: 41
Appleseed Scene: Disney Material OpenBenchmarking.org Seconds, Fewer Is Better Appleseed 2.0 Beta Scene: Disney Material Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 13 26 39 52 65 43.70 48.43 48.56 49.14 51.25 53.49 56.40 58.38
ASTC Encoder Preset: Very Thorough OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Very Thorough Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 4 8 12 16 20 SE +/- 0.0007, N = 3 SE +/- 0.0379, N = 3 SE +/- 0.0022, N = 3 SE +/- 0.0055, N = 3 SE +/- 0.0294, N = 3 SE +/- 0.0054, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0016, N = 3 14.6334 13.7518 11.8875 10.2051 7.6240 7.0885 5.9702 5.1342 1. (CXX) g++ options: -O3 -flto -pthread
Liquid-DSP Threads: 64 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 600M 1200M 1800M 2400M 3000M SE +/- 28500058.48, N = 3 SE +/- 32405829.38, N = 3 SE +/- 7076957.92, N = 3 SE +/- 28812627.44, N = 4 SE +/- 27382304.50, N = 5 SE +/- 11426868.92, N = 3 SE +/- 5493127.02, N = 3 SE +/- 2629533.12, N = 3 2655500000 2620066667 2539200000 2494050000 2491340000 2475500000 2308966667 2138766667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
uvg266 Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 6 12 18 24 30 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 27.11 24.71 22.14 19.75 16.06 15.71 13.89 13.36
ASTC Encoder Preset: Exhaustive OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Exhaustive Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2 4 6 8 10 SE +/- 0.0157, N = 3 SE +/- 0.0164, N = 3 SE +/- 0.0016, N = 3 SE +/- 0.0033, N = 3 SE +/- 0.0072, N = 3 SE +/- 0.0024, N = 3 SE +/- 0.0011, N = 3 SE +/- 0.0003, N = 3 8.9091 8.3701 7.2075 6.2126 4.6303 4.2689 3.6276 3.1204 1. (CXX) g++ options: -O3 -flto -pthread
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 300M 600M 900M 1200M 1500M SE +/- 4790383.89, N = 3 SE +/- 2123152.79, N = 3 SE +/- 2313246.88, N = 3 SE +/- 6842108.19, N = 3 SE +/- 11560043.25, N = 5 SE +/- 1740596.96, N = 3 SE +/- 1345523.44, N = 3 SE +/- 681281.47, N = 3 1493833333 1206066667 1152933333 1126466667 1091460000 918566667 882200000 800186667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 13 - Input: Bosphorus 4K Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 40 80 120 160 200 SE +/- 2.83, N = 15 SE +/- 2.84, N = 15 SE +/- 2.31, N = 15 SE +/- 2.18, N = 15 SE +/- 1.62, N = 15 SE +/- 1.44, N = 15 SE +/- 1.67, N = 15 SE +/- 1.63, N = 15 174.83 162.98 162.47 154.50 150.00 144.70 124.26 122.62 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
QuantLib Configuration: Single-Threaded OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Single-Threaded Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9468 2P 800 1600 2400 3200 4000 SE +/- 33.58, N = 3 SE +/- 30.36, N = 12 SE +/- 25.35, N = 3 SE +/- 22.17, N = 3 SE +/- 28.57, N = 3 SE +/- 25.40, N = 3 SE +/- 28.42, N = 3 SE +/- 28.11, N = 3 3600.5 3586.3 3229.1 3225.7 3222.8 3210.1 3209.6 3207.0 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1000M 2000M 3000M 4000M 5000M SE +/- 51282832.98, N = 4 SE +/- 14772609.79, N = 3 SE +/- 13655808.69, N = 3 SE +/- 25888414.40, N = 3 SE +/- 5260228.13, N = 3 SE +/- 3116800.35, N = 3 SE +/- 3119294.79, N = 3 SE +/- 2030052.00, N = 3 4450525000 3896500000 3723666667 3596400000 3503200000 3181266667 2972400000 2670033333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
nginx Connections: 1000 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 1000 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 90K 180K 270K 360K 450K SE +/- 142.71, N = 3 SE +/- 576.43, N = 2 SE +/- 125.38, N = 3 399698.78 381352.69 367199.06 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 512 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 400M 800M 1200M 1600M 2000M SE +/- 14465476.14, N = 3 SE +/- 5630373.98, N = 3 SE +/- 6728628.72, N = 3 SE +/- 4238841.56, N = 3 SE +/- 240370.09, N = 3 SE +/- 1722723.94, N = 3 SE +/- 740202.67, N = 3 SE +/- 569766.03, N = 3 2027000000 1616966667 1518933333 1444066667 1178766667 1020833333 944550000 838530000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Blender Blend File: Junkshop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Junkshop - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 10 20 30 40 50 SE +/- 0.09, N = 3 SE +/- 0.04, N = 3 SE +/- 0.19, N = 3 SE +/- 0.06, N = 3 SE +/- 0.10, N = 3 SE +/- 0.24, N = 3 SE +/- 0.10, N = 3 SE +/- 0.04, N = 3 18.31 21.15 23.45 24.99 32.08 35.96 39.17 42.85
NAS Parallel Benchmarks Test / Class: EP.D OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: EP.D Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 3K 6K 9K 12K 15K SE +/- 30.19, N = 4 SE +/- 100.23, N = 4 SE +/- 10.93, N = 4 SE +/- 4.83, N = 4 SE +/- 22.33, N = 3 SE +/- 6.77, N = 3 SE +/- 6.53, N = 3 SE +/- 155.10, N = 12 16004.07 14946.76 12793.01 10970.45 8089.14 7562.80 6445.09 5366.69 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
John The Ripper Test: bcrypt OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 40K 80K 120K 160K 200K SE +/- 288.38, N = 3 SE +/- 292.24, N = 3 SE +/- 576.80, N = 3 SE +/- 866.68, N = 3 SE +/- 46.28, N = 3 SE +/- 10.67, N = 3 SE +/- 8.67, N = 3 SE +/- 8.84, N = 3 206778 183603 155959 133866 105781 94551 79144 67875 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 40K 80K 120K 160K 200K SE +/- 649.08, N = 3 SE +/- 348.45, N = 3 SE +/- 169.28, N = 3 SE +/- 116.69, N = 3 SE +/- 79.75, N = 3 SE +/- 11.39, N = 3 SE +/- 8.67, N = 3 SE +/- 17.33, N = 3 205499 183583 156658 134562 105831 94513 79152 67893 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 57 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1300M 2600M 3900M 5200M 6500M SE +/- 61971606.40, N = 3 SE +/- 2331189.49, N = 3 SE +/- 28453880.81, N = 3 SE +/- 17558125.69, N = 3 SE +/- 3555434.03, N = 3 SE +/- 5292237.50, N = 3 SE +/- 1976810.00, N = 3 SE +/- 4088330.28, N = 3 6284300000 5361266667 5036000000 4825133333 3806833333 3500833333 3222533333 2848933333 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 256 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 256 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 1300M 2600M 3900M 5200M 6500M SE +/- 10496401.50, N = 3 SE +/- 6711433.03, N = 3 SE +/- 895048.11, N = 3 SE +/- 2447674.63, N = 3 SE +/- 4021608.30, N = 3 SE +/- 2516611.48, N = 3 SE +/- 1338323.99, N = 3 SE +/- 1320353.49, N = 3 6116566667 6077300000 5367033333 4670966667 3243800000 3167200000 2769066667 2381800000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
uvg266 Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 7 14 21 28 35 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.16, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 30.37 27.65 24.65 22.25 17.85 16.64 15.68 15.17
Liquid-DSP Threads: 128 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 128 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 800M 1600M 2400M 3200M 4000M SE +/- 26633124.74, N = 3 SE +/- 13813198.20, N = 3 SE +/- 2403700.85, N = 3 SE +/- 4598671.31, N = 3 SE +/- 1858314.65, N = 3 SE +/- 2236316.42, N = 3 SE +/- 1342054.81, N = 3 SE +/- 400000.00, N = 3 3558600000 3520766667 3337066667 3254033333 3200600000 3148233333 2739633333 2351900000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Google SynthMark Test: VoiceMark_100 OpenBenchmarking.org Voices, More Is Better Google SynthMark 20201109 Test: VoiceMark_100 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9468 2P 200 400 600 800 1000 SE +/- 0.13, N = 3 SE +/- 0.38, N = 3 SE +/- 1.51, N = 3 SE +/- 0.48, N = 3 SE +/- 0.24, N = 3 SE +/- 0.22, N = 3 SE +/- 0.26, N = 3 SE +/- 0.30, N = 3 799.72 799.49 712.70 712.09 712.01 711.38 711.10 710.92 1. (CXX) g++ options: -lm -lpthread -std=c++11 -Ofast
Liquid-DSP Threads: 64 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 32 Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 500M 1000M 1500M 2000M 2500M SE +/- 17236814.61, N = 3 SE +/- 3017909.50, N = 3 SE +/- 3300505.01, N = 3 SE +/- 2206304.10, N = 3 SE +/- 27191440.65, N = 3 SE +/- 3167192.94, N = 3 SE +/- 692820.32, N = 3 SE +/- 688799.28, N = 3 2154633333 2090466667 2025000000 1963233333 1927766667 1890566667 1679700000 1640266667 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Blender Blend File: Fishy Cat - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: Fishy Cat - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 10 20 30 40 50 SE +/- 0.04, N = 3 SE +/- 0.08, N = 3 SE +/- 0.18, N = 3 SE +/- 0.13, N = 3 SE +/- 0.06, N = 3 SE +/- 0.11, N = 3 SE +/- 0.04, N = 3 SE +/- 0.17, N = 3 17.29 19.13 21.45 23.17 31.91 34.83 38.48 42.78
TensorFlow Device: CPU - Batch Size: 1 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: GoogLeNet Xeon Max 9468 Xeon Platinum 8490H Xeon Max 9480 Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 8 16 24 32 40 SE +/- 0.27, N = 7 SE +/- 0.19, N = 6 SE +/- 0.27, N = 6 SE +/- 0.21, N = 6 SE +/- 0.20, N = 15 SE +/- 0.23, N = 12 SE +/- 0.23, N = 15 SE +/- 0.12, N = 6 36.13 33.56 31.47 21.67 18.24 14.67 13.50 12.69
DaCapo Benchmark Java Test: Apache Lucene Search Index OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Apache Lucene Search Index Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9468 Xeon Max 9480 Xeon Max 9480 2P Xeon Platinum 8490H Xeon Max 9468 2P Xeon Platinum 8490H 2P 800 1600 2400 3200 4000 SE +/- 18.19, N = 3 SE +/- 12.44, N = 3 SE +/- 33.41, N = 3 SE +/- 42.24, N = 4 SE +/- 11.86, N = 3 SE +/- 11.79, N = 3 SE +/- 10.84, N = 3 SE +/- 41.09, N = 5 3242 3345 3378 3396 3537 3581 3643 3689
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 40 80 120 160 200 SE +/- 0.29, N = 4 SE +/- 0.22, N = 4 SE +/- 0.89, N = 15 SE +/- 0.76, N = 3 SE +/- 0.35, N = 3 SE +/- 0.09, N = 3 SE +/- 0.09, N = 3 SE +/- 0.08, N = 3 173.22 132.28 112.72 104.84 97.19 79.38 71.83 64.96 MIN: 164.07 / MAX: 187.8 MIN: 125 / MAX: 146.52 MIN: 102 / MAX: 125.96 MIN: 101.05 / MAX: 112.02 MIN: 92.96 / MAX: 102.04 MIN: 76.07 / MAX: 85.98 MIN: 69.55 / MAX: 76.73 MIN: 63.12 / MAX: 67.81
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 5 10 15 20 25 SE +/- 0.046, N = 3 SE +/- 0.019, N = 3 SE +/- 0.032, N = 3 SE +/- 0.025, N = 3 SE +/- 0.009, N = 3 SE +/- 0.010, N = 3 SE +/- 0.007, N = 3 SE +/- 0.019, N = 3 18.540 15.450 14.127 13.392 10.477 8.762 8.282 7.545 1. (CXX) g++ options: -O3 -lm
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 4 - Input: Bosphorus 4K Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 2 4 6 8 10 SE +/- 0.005, N = 3 SE +/- 0.044, N = 3 SE +/- 0.030, N = 3 SE +/- 0.049, N = 3 SE +/- 0.047, N = 3 SE +/- 0.027, N = 3 SE +/- 0.042, N = 3 SE +/- 0.015, N = 3 7.876 7.360 7.061 6.698 6.572 6.490 6.052 5.991 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: GoogLeNet Xeon Platinum 8490H Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8592+ 2P 80 160 240 320 400 SE +/- 1.62, N = 3 SE +/- 3.52, N = 5 SE +/- 0.83, N = 3 SE +/- 1.94, N = 3 SE +/- 2.37, N = 3 SE +/- 1.12, N = 3 SE +/- 2.38, N = 3 SE +/- 0.21, N = 3 380.14 341.51 335.58 333.73 331.76 319.76 308.95 291.37
ASKAP Test: tConvolve OpenMP - Degridding OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve OpenMP - Degridding Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P 11K 22K 33K 44K 55K SE +/- 948.80, N = 15 SE +/- 1365.55, N = 15 SE +/- 677.85, N = 15 SE +/- 131.12, N = 15 SE +/- 955.08, N = 5 SE +/- 69.31, N = 5 SE +/- 41.81, N = 5 SE +/- 0.00, N = 4 51476.20 48686.80 30471.50 16936.80 7304.58 7046.56 6758.81 4437.60 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
ASKAP Test: tConvolve OpenMP - Gridding OpenBenchmarking.org Million Grid Points Per Second, More Is Better ASKAP 1.0 Test: tConvolve OpenMP - Gridding Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 2P 4K 8K 12K 16K 20K SE +/- 221.77, N = 15 SE +/- 195.05, N = 15 SE +/- 211.64, N = 15 SE +/- 139.77, N = 15 SE +/- 33.09, N = 5 SE +/- 13.21, N = 5 SE +/- 40.14, N = 4 SE +/- 13.50, N = 5 20204.90 19798.50 19141.80 17010.80 4438.58 4173.46 3916.78 3836.73 1. (CXX) g++ options: -O3 -fstrict-aliasing -fopenmp
Kvazaar Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 9 18 27 36 45 SE +/- 0.04, N = 4 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.03, N = 3 40.92 31.24 28.96 26.00 24.23 20.23 18.24 17.52 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Kvazaar Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 9 18 27 36 45 SE +/- 0.27, N = 4 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 41.58 32.04 29.62 26.69 24.80 20.97 18.84 18.13 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 8 - Input: Bosphorus 4K Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 20 40 60 80 100 SE +/- 0.22, N = 5 SE +/- 0.20, N = 5 SE +/- 0.79, N = 5 SE +/- 0.29, N = 4 SE +/- 0.46, N = 4 SE +/- 0.26, N = 4 SE +/- 0.44, N = 15 SE +/- 0.58, N = 5 79.44 70.91 70.43 65.36 65.22 62.75 55.98 54.82 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8592+ 14 28 42 56 70 SE +/- 0.07, N = 5 SE +/- 0.17, N = 5 SE +/- 0.58, N = 5 SE +/- 0.13, N = 4 SE +/- 0.06, N = 4 SE +/- 0.50, N = 5 SE +/- 0.36, N = 15 SE +/- 0.04, N = 4 60.87 57.13 55.26 50.09 48.91 46.13 45.79 39.31
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 256 - Model: AlexNet Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 400 800 1200 1600 2000 SE +/- 5.06, N = 3 SE +/- 1.86, N = 3 SE +/- 5.81, N = 3 SE +/- 1.15, N = 3 SE +/- 4.27, N = 3 SE +/- 0.54, N = 3 SE +/- 6.82, N = 3 SE +/- 1.21, N = 3 1730.25 1681.44 1528.41 1479.53 1277.46 1205.30 1058.99 986.04
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 40 80 120 160 200 SE +/- 1.02, N = 8 SE +/- 0.81, N = 7 SE +/- 1.85, N = 12 SE +/- 1.28, N = 12 SE +/- 0.20, N = 6 SE +/- 0.61, N = 5 SE +/- 0.84, N = 15 SE +/- 0.12, N = 4 199.73 133.63 114.90 108.40 106.40 82.85 70.84 63.62 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1100 2200 3300 4400 5500 SE +/- 25.44, N = 8 SE +/- 20.15, N = 7 SE +/- 46.19, N = 12 SE +/- 32.01, N = 12 SE +/- 5.07, N = 6 SE +/- 15.23, N = 5 SE +/- 21.10, N = 15 SE +/- 2.91, N = 4 4993.34 3340.69 2872.56 2709.93 2659.88 2071.19 1771.07 1590.50 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
TensorFlow Device: CPU - Batch Size: 1 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 1 - Model: AlexNet Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8592+ 2P 13 26 39 52 65 SE +/- 0.08, N = 8 SE +/- 0.76, N = 15 SE +/- 1.22, N = 15 SE +/- 0.57, N = 15 SE +/- 0.44, N = 15 SE +/- 0.66, N = 15 SE +/- 0.52, N = 15 SE +/- 0.45, N = 15 56.53 48.28 43.67 37.76 37.57 35.50 33.21 30.76
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.1 Blend File: BMW27 - Compute: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 7 14 21 28 35 SE +/- 0.03, N = 4 SE +/- 0.08, N = 4 SE +/- 0.08, N = 4 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 SE +/- 0.15, N = 3 SE +/- 0.24, N = 3 SE +/- 0.11, N = 3 12.76 13.74 15.29 16.55 23.72 25.89 28.49 31.66
Y-Cruncher Pi Digits To Calculate: 1B OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 1B Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2 4 6 8 10 SE +/- 0.007, N = 6 SE +/- 0.010, N = 6 SE +/- 0.142, N = 12 SE +/- 0.122, N = 15 SE +/- 0.030, N = 5 SE +/- 0.005, N = 5 SE +/- 0.026, N = 5 SE +/- 0.045, N = 5 5.008 5.110 6.266 6.334 6.701 7.047 7.959 8.300
OpenFOAM Input: drivaerFastback, Small Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 10 20 30 40 50 23.56 27.58 28.56 28.99 33.07 41.75 42.22 45.95 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Small Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Xeon Max 9480 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8490H 2P 8 16 24 32 40 28.84 29.33 31.38 31.70 31.78 32.00 32.48 35.60 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
NAS Parallel Benchmarks Test / Class: IS.D OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: IS.D Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 1600 3200 4800 6400 8000 SE +/- 155.00, N = 15 SE +/- 8.92, N = 4 SE +/- 23.92, N = 4 SE +/- 4.96, N = 4 SE +/- 12.99, N = 4 SE +/- 18.08, N = 4 SE +/- 15.55, N = 4 SE +/- 6.56, N = 3 7437.81 4059.70 3960.28 3819.83 3816.70 3076.66 3050.16 2865.72 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Kvazaar Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 Xeon Max 9468 2P Xeon Platinum 8592+ 15 30 45 60 75 SE +/- 0.50, N = 5 SE +/- 0.21, N = 5 SE +/- 0.07, N = 5 SE +/- 0.20, N = 5 SE +/- 0.49, N = 15 SE +/- 0.12, N = 5 SE +/- 0.49, N = 5 SE +/- 0.09, N = 4 69.05 66.78 66.74 54.47 54.19 53.13 52.63 39.20 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Algebraic Multi-Grid Benchmark OpenBenchmarking.org Figure Of Merit, More Is Better Algebraic Multi-Grid Benchmark 1.2 Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 800M 1600M 2400M 3200M 4000M SE +/- 9014927.20, N = 3 SE +/- 9164253.67, N = 3 SE +/- 7233468.75, N = 3 SE +/- 2438223.49, N = 3 SE +/- 4000850.45, N = 3 SE +/- 468935.32, N = 3 SE +/- 1778769.08, N = 3 SE +/- 3359086.30, N = 3 3609646333 3205161000 3156261667 3124402667 1814760000 1605097000 1597993333 1588496667 1. (CC) gcc options: -lparcsr_ls -lparcsr_mv -lseq_mv -lIJ_mv -lkrylov -lHYPRE_utilities -lm -fopenmp -lmpi
Xcompact3d Incompact3d Input: input.i3d 193 Cells Per Direction OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: input.i3d 193 Cells Per Direction Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 4 8 12 16 20 SE +/- 0.03329814, N = 5 SE +/- 0.04312801, N = 5 SE +/- 0.05695382, N = 15 SE +/- 0.01741826, N = 5 SE +/- 0.02923582, N = 4 SE +/- 0.01708632, N = 4 SE +/- 0.01004100, N = 4 SE +/- 0.04445674, N = 4 5.39125967 6.39169817 6.66387510 7.29349117 10.19670660 12.79975820 12.92934130 13.96923760 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
Timed FFmpeg Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 7.0 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 6 12 18 24 30 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 SE +/- 0.09, N = 3 SE +/- 0.03, N = 3 17.39 19.51 20.01 20.79 21.36 24.06 24.84 26.46
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 0.54 1.08 1.62 2.16 2.7 SE +/- 0.01, N = 4 SE +/- 0.01, N = 4 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.40 2.18 1.74 1.72 1.58 1.29 1.14 1.08
oneDNN Harness: Deconvolution Batch shapes_1d - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_1d - Engine: CPU Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P 9 18 27 36 45 SE +/- 0.00876, N = 3 SE +/- 0.02700, N = 3 SE +/- 0.00627, N = 3 SE +/- 0.08324, N = 3 SE +/- 0.10586, N = 3 SE +/- 0.09318, N = 3 SE +/- 0.10023, N = 3 SE +/- 0.32768, N = 3 5.30953 6.09747 6.15856 6.69692 13.45000 16.09010 16.55070 38.08130 MIN: 3.74 MIN: 11.97 MIN: 9.89 MIN: 14.58 MIN: 9.76 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better x265 3.6 Video Input: Bosphorus 4K Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 9 18 27 36 45 SE +/- 0.09, N = 4 SE +/- 0.06, N = 4 SE +/- 0.11, N = 4 SE +/- 0.20, N = 4 SE +/- 0.39, N = 3 SE +/- 0.08, N = 3 SE +/- 0.10, N = 3 SE +/- 0.12, N = 3 39.31 38.93 37.86 37.04 31.40 29.05 27.90 27.26 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
uvg266 Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 12 24 36 48 60 SE +/- 0.50, N = 5 SE +/- 0.16, N = 5 SE +/- 0.01, N = 4 SE +/- 0.38, N = 9 SE +/- 0.39, N = 4 SE +/- 0.02, N = 4 SE +/- 0.12, N = 4 SE +/- 0.08, N = 3 54.88 53.66 49.42 46.25 44.75 40.82 39.56 35.10
LULESH OpenBenchmarking.org z/s, More Is Better LULESH 2.0.3 Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 15K 30K 45K 60K 75K SE +/- 359.29, N = 3 SE +/- 207.54, N = 5 SE +/- 206.20, N = 5 SE +/- 272.44, N = 4 SE +/- 437.51, N = 4 SE +/- 217.67, N = 6 SE +/- 211.12, N = 6 SE +/- 182.38, N = 15 70826.73 53269.47 52102.67 43724.06 38433.97 25831.84 23848.54 23072.30 1. (CXX) g++ options: -O3 -fopenmp -lm -lmpi_cxx -lmpi
oneDNN Harness: IP Shapes 1D - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 1D - Engine: CPU Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Max 9480 2P Xeon Platinum 8490H 2P 0.1762 0.3524 0.5286 0.7048 0.881 SE +/- 0.000767, N = 4 SE +/- 0.000915, N = 4 SE +/- 0.004443, N = 4 SE +/- 0.000666, N = 4 SE +/- 0.004822, N = 4 SE +/- 0.001869, N = 4 SE +/- 0.003500, N = 4 SE +/- 0.004208, N = 4 0.398446 0.539467 0.580664 0.617190 0.662387 0.725974 0.759434 0.783180 MIN: 0.37 MIN: 0.5 MIN: 0.51 MIN: 0.55 MIN: 0.58 MIN: 0.67 MIN: 0.67 MIN: 0.69 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.16.1 Device: CPU - Batch Size: 64 - Model: AlexNet Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 200 400 600 800 1000 SE +/- 7.98, N = 5 SE +/- 0.51, N = 5 SE +/- 7.35, N = 5 SE +/- 6.39, N = 13 SE +/- 2.22, N = 5 SE +/- 2.31, N = 5 SE +/- 1.95, N = 5 SE +/- 6.22, N = 5 996.47 969.62 940.40 932.59 858.84 852.36 841.68 819.89
NAS Parallel Benchmarks Test / Class: SP.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: SP.C Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 50K 100K 150K 200K 250K SE +/- 1528.09, N = 5 SE +/- 560.20, N = 4 SE +/- 420.81, N = 4 SE +/- 679.14, N = 4 SE +/- 31.76, N = 4 SE +/- 150.79, N = 3 SE +/- 9.58, N = 3 SE +/- 67.02, N = 3 228184.68 147311.14 141954.15 135939.25 109416.42 71245.26 69776.41 58815.36 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Pennant Test: sedovbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 5 10 15 20 25 SE +/- 0.018471, N = 4 SE +/- 0.016400, N = 4 SE +/- 0.003253, N = 4 SE +/- 0.003237, N = 4 SE +/- 0.002987, N = 3 SE +/- 0.002400, N = 3 SE +/- 0.013353, N = 3 SE +/- 0.001847, N = 3 9.964526 11.284380 12.106900 13.211250 16.030800 16.969100 19.882460 21.021120 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
Kvazaar Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ 20 40 60 80 100 SE +/- 0.75, N = 15 SE +/- 0.39, N = 6 SE +/- 0.54, N = 6 SE +/- 0.32, N = 5 SE +/- 0.13, N = 5 SE +/- 0.56, N = 5 SE +/- 0.55, N = 5 SE +/- 0.17, N = 4 74.57 73.81 72.01 63.99 63.10 58.14 54.98 47.07 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 Xeon Platinum 8592+ 12 24 36 48 60 SE +/- 0.05, N = 5 SE +/- 0.16, N = 5 SE +/- 0.21, N = 5 SE +/- 0.15, N = 4 SE +/- 0.43, N = 4 SE +/- 0.41, N = 7 SE +/- 0.15, N = 4 SE +/- 0.07, N = 3 55.54 55.40 54.95 45.32 45.09 44.40 44.05 35.56
DaCapo Benchmark Java Test: Jython OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Jython Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 800 1600 2400 3200 4000 SE +/- 21.99, N = 4 SE +/- 9.71, N = 4 SE +/- 38.86, N = 5 SE +/- 20.55, N = 4 SE +/- 7.09, N = 4 SE +/- 24.09, N = 4 SE +/- 24.34, N = 4 SE +/- 28.30, N = 4 3424 3466 3707 3785 3801 3892 3921 3926
JPEG-XL libjxl Input: PNG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: PNG - Quality: 100 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9468 7 14 21 28 35 SE +/- 0.07, N = 4 SE +/- 0.08, N = 4 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 SE +/- 0.04, N = 3 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 31.35 30.97 28.10 27.66 27.09 26.99 26.84 26.25 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
Timed Mesa Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Mesa Compilation 24.0 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 5 10 15 20 25 SE +/- 0.05, N = 4 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 0.12, N = 3 SE +/- 0.07, N = 3 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 16.18 17.26 18.14 18.29 18.47 19.23 19.65 20.18
PyBench Total For Average Test Times OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P 170 340 510 680 850 SE +/- 0.41, N = 4 SE +/- 0.48, N = 4 SE +/- 0.58, N = 3 SE +/- 0.33, N = 3 SE +/- 0.67, N = 3 SE +/- 0.67, N = 3 SE +/- 0.33, N = 3 SE +/- 1.15, N = 3 691 692 762 763 763 763 765 767
DaCapo Benchmark Java Test: Apache Kafka OpenBenchmarking.org msec, Fewer Is Better DaCapo Benchmark 23.11 Java Test: Apache Kafka Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8592+ 2P 1200 2400 3600 4800 6000 SE +/- 4.06, N = 3 SE +/- 2.03, N = 3 SE +/- 3.51, N = 3 SE +/- 1.20, N = 3 SE +/- 6.44, N = 3 SE +/- 1.76, N = 3 SE +/- 31.50, N = 3 SE +/- 10.11, N = 3 5088 5101 5102 5106 5108 5113 5560 5611
WebP Image Encode Encode Settings: Quality 100, Lossless OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P 0.3375 0.675 1.0125 1.35 1.6875 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 1.50 1.50 1.40 1.39 1.39 1.39 1.31 1.30 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
Timed ImageMagick Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed ImageMagick Compilation 6.9.0 Time To Compile Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 4 8 12 16 20 SE +/- 0.03, N = 4 SE +/- 0.10, N = 4 SE +/- 0.13, N = 4 SE +/- 0.07, N = 4 SE +/- 0.11, N = 4 SE +/- 0.10, N = 4 SE +/- 0.06, N = 4 SE +/- 0.15, N = 4 11.49 12.60 13.26 14.09 14.40 14.72 15.38 16.08
JPEG-XL libjxl Input: JPEG - Quality: 100 OpenBenchmarking.org MP/s, More Is Better JPEG-XL libjxl 0.10.1 Input: JPEG - Quality: 100 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9468 7 14 21 28 35 SE +/- 0.04, N = 4 SE +/- 0.07, N = 4 SE +/- 0.02, N = 3 SE +/- 0.08, N = 3 SE +/- 0.03, N = 3 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.03, N = 3 32.24 31.61 28.75 28.16 27.75 27.33 27.26 26.86 1. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm
ASTC Encoder Preset: Thorough OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Thorough Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 20 40 60 80 100 SE +/- 0.55, N = 5 SE +/- 0.19, N = 5 SE +/- 0.03, N = 5 SE +/- 0.05, N = 4 SE +/- 0.05, N = 4 SE +/- 0.01, N = 4 SE +/- 0.03, N = 4 SE +/- 0.01, N = 3 97.94 86.98 83.34 72.33 54.45 51.30 42.98 37.01 1. (CXX) g++ options: -O3 -flto -pthread
NAS Parallel Benchmarks Test / Class: LU.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: LU.C Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 100K 200K 300K 400K 500K SE +/- 726.00, N = 5 SE +/- 398.40, N = 5 SE +/- 411.20, N = 5 SE +/- 441.66, N = 5 SE +/- 213.44, N = 5 SE +/- 130.20, N = 4 SE +/- 37.04, N = 4 SE +/- 71.37, N = 3 455312.09 261127.09 257384.55 246822.52 232012.77 135125.15 131606.86 126171.52 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
m-queens Time To Solve OpenBenchmarking.org Seconds, Fewer Is Better m-queens 1.2 Time To Solve Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 5 10 15 20 25 SE +/- 0.028, N = 6 SE +/- 0.021, N = 6 SE +/- 0.028, N = 5 SE +/- 0.021, N = 5 SE +/- 0.030, N = 4 SE +/- 0.025, N = 4 SE +/- 0.035, N = 3 SE +/- 0.031, N = 3 7.402 7.881 9.285 10.840 14.257 15.211 18.102 21.030 1. (CXX) g++ options: -fopenmp -O2 -march=native
srsRAN Project Test: PUSCH Processor Benchmark, Throughput Thread OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PUSCH Processor Benchmark, Throughput Thread Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Platinum 8592+ 2P Xeon Platinum 8592+ 30 60 90 120 150 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 129.7 129.7 129.7 129.7 129.7 129.7 129.5 129.5 MIN: 105.9 MIN: 105.9 MIN: 105.9 MIN: 105.9 MIN: 105.9 MIN: 105.9 MIN: 105.7 MIN: 105.7 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
Y-Cruncher Pi Digits To Calculate: 500M OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 500M Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 0.8507 1.7014 2.5521 3.4028 4.2535 SE +/- 0.002, N = 8 SE +/- 0.004, N = 7 SE +/- 0.074, N = 15 SE +/- 0.064, N = 15 SE +/- 0.003, N = 7 SE +/- 0.008, N = 7 SE +/- 0.023, N = 15 SE +/- 0.010, N = 7 2.364 2.659 2.961 3.110 3.267 3.391 3.704 3.781
NAS Parallel Benchmarks Test / Class: CG.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: CG.C Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 20K 40K 60K 80K 100K SE +/- 271.54, N = 6 SE +/- 560.41, N = 15 SE +/- 545.92, N = 15 SE +/- 328.18, N = 8 SE +/- 178.23, N = 8 SE +/- 260.16, N = 15 SE +/- 313.88, N = 7 SE +/- 243.41, N = 12 98764.93 66492.44 65396.22 63760.45 58128.24 35234.06 35116.55 33811.63 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Kvazaar Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8592+ 15 30 45 60 75 SE +/- 0.45, N = 5 SE +/- 0.36, N = 5 SE +/- 0.29, N = 4 SE +/- 0.33, N = 4 SE +/- 0.08, N = 4 SE +/- 0.08, N = 4 SE +/- 0.06, N = 4 SE +/- 0.04, N = 4 67.64 65.38 52.23 51.91 50.03 41.34 40.23 38.02 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 40 80 120 160 200 SE +/- 0.26, N = 8 SE +/- 0.13, N = 7 SE +/- 1.20, N = 15 SE +/- 0.63, N = 6 SE +/- 0.13, N = 6 SE +/- 0.05, N = 5 SE +/- 0.11, N = 5 SE +/- 0.04, N = 5 199.61 152.75 129.75 125.75 112.66 91.99 83.49 75.47 MIN: 185.98 / MAX: 216.64 MIN: 143.8 / MAX: 168.98 MIN: 110.67 / MAX: 151.91 MIN: 120.06 / MAX: 135.13 MIN: 107.88 / MAX: 117.19 MIN: 88.57 / MAX: 98.54 MIN: 80.58 / MAX: 88.97 MIN: 72.93 / MAX: 78.77
GNU Octave Benchmark OpenBenchmarking.org Seconds, Fewer Is Better GNU Octave Benchmark 8.4.0 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Max 9468 Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 3 6 9 12 15 SE +/- 0.020, N = 6 SE +/- 0.019, N = 6 SE +/- 0.015, N = 6 SE +/- 0.015, N = 6 SE +/- 0.024, N = 6 SE +/- 0.019, N = 6 SE +/- 0.082, N = 5 SE +/- 0.096, N = 5 6.458 6.856 7.532 7.622 7.748 8.036 12.578 12.617
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1.1318 2.2636 3.3954 4.5272 5.659 SE +/- 0.03, N = 6 SE +/- 0.03, N = 6 SE +/- 0.04, N = 5 SE +/- 0.01, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 5.03 4.41 3.65 3.51 3.31 2.71 2.38 2.26
Pennant Test: leblancbig OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: leblancbig Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1.3345 2.669 4.0035 5.338 6.6725 SE +/- 0.013568, N = 6 SE +/- 0.008354, N = 7 SE +/- 0.019069, N = 15 SE +/- 0.010204, N = 7 SE +/- 0.022698, N = 7 SE +/- 0.022393, N = 7 SE +/- 0.023904, N = 7 SE +/- 0.025580, N = 6 2.159459 2.527363 2.529807 2.881099 4.182707 4.955865 5.114161 5.930957 1. (CXX) g++ options: -fopenmp -lmpi_cxx -lmpi
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 1.1453 2.2906 3.4359 4.5812 5.7265 SE +/- 0.03, N = 6 SE +/- 0.01, N = 6 SE +/- 0.02, N = 5 SE +/- 0.02, N = 5 SE +/- 0.00, N = 5 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 SE +/- 0.00, N = 4 5.09 4.48 3.66 3.49 3.32 2.71 2.39 2.27
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 30 60 90 120 150 SE +/- 0.07, N = 7 SE +/- 0.12, N = 6 SE +/- 0.48, N = 6 SE +/- 0.14, N = 6 SE +/- 0.05, N = 5 SE +/- 0.07, N = 5 SE +/- 0.02, N = 4 SE +/- 0.05, N = 4 153.16 124.71 116.61 107.63 82.97 70.05 65.33 58.42 MIN: 143.78 / MAX: 166.08 MIN: 115.3 / MAX: 143.82 MIN: 107.47 / MAX: 129.72 MIN: 102.22 / MAX: 114.8 MIN: 79.09 / MAX: 87.11 MIN: 63.26 / MAX: 79.13 MIN: 60.89 / MAX: 69.91 MIN: 55.81 / MAX: 61.43
WebP Image Encode Encode Settings: Quality 100, Highest Compression OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P 0.7808 1.5616 2.3424 3.1232 3.904 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 SE +/- 0.00, N = 6 3.47 3.46 3.10 3.10 3.09 3.09 3.08 3.07 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
oneDNN Harness: IP Shapes 3D - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: IP Shapes 3D - Engine: CPU Xeon Platinum 8490H 2P Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 2P Xeon Max 9480 Xeon Max 9468 2P Xeon Max 9468 0.973 1.946 2.919 3.892 4.865 SE +/- 0.005935, N = 5 SE +/- 0.004380, N = 5 SE +/- 0.003025, N = 5 SE +/- 0.001432, N = 5 SE +/- 0.005278, N = 5 SE +/- 0.010419, N = 5 SE +/- 0.004988, N = 5 SE +/- 0.003490, N = 5 0.714699 0.738442 0.771506 0.841608 4.175530 4.274810 4.283990 4.324650 MIN: 0.81 MIN: 4.06 MIN: 4.18 MIN: 4.18 MIN: 4.21 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
Google Draco Model: Church Facade OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Church Facade Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 1500 3000 4500 6000 7500 SE +/- 30.70, N = 7 SE +/- 20.74, N = 7 SE +/- 14.74, N = 6 SE +/- 18.12, N = 6 SE +/- 9.53, N = 6 SE +/- 7.18, N = 6 SE +/- 22.13, N = 6 SE +/- 7.99, N = 6 4565 4693 5670 5672 6693 6707 6777 6821 1. (CXX) g++ options: -O3
oneDNN Harness: Convolution Batch Shapes Auto - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Convolution Batch Shapes Auto - Engine: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 2P Xeon Max 9468 2P Xeon Max 9480 Xeon Max 9468 3 6 9 12 15 SE +/- 0.001169, N = 7 SE +/- 0.001522, N = 7 SE +/- 0.002339, N = 7 SE +/- 0.001388, N = 7 SE +/- 0.015670, N = 7 SE +/- 0.039215, N = 7 SE +/- 0.017741, N = 7 SE +/- 0.005800, N = 7 0.306795 0.438154 0.585804 0.650618 7.060430 7.754310 8.751050 9.194340 MIN: 6.83 MIN: 6.74 MIN: 7.59 MIN: 6.88 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
ACES DGEMM Sustained Floating-Point Rate OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 13 26 39 52 65 SE +/- 0.11, N = 8 SE +/- 0.28, N = 7 SE +/- 0.04, N = 7 SE +/- 0.06, N = 7 SE +/- 0.08, N = 6 SE +/- 0.09, N = 5 SE +/- 0.09, N = 5 SE +/- 0.04, N = 4 58.25 45.97 44.67 39.35 29.14 23.54 22.54 19.77 1. (CC) gcc options: -O3 -march=native -fopenmp
ASTC Encoder Preset: Medium OpenBenchmarking.org MT/s, More Is Better ASTC Encoder 4.7 Preset: Medium Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 120 240 360 480 600 SE +/- 1.56, N = 7 SE +/- 2.79, N = 6 SE +/- 0.77, N = 6 SE +/- 0.52, N = 6 SE +/- 0.16, N = 6 SE +/- 1.17, N = 6 SE +/- 0.08, N = 6 SE +/- 0.03, N = 6 550.02 484.55 483.10 441.65 333.99 327.78 284.33 247.30 1. (CXX) g++ options: -O3 -flto -pthread
libavif avifenc Encoder Speed: 6, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6, Lossless Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 2 4 6 8 10 SE +/- 0.031, N = 7 SE +/- 0.025, N = 7 SE +/- 0.022, N = 7 SE +/- 0.013, N = 7 SE +/- 0.033, N = 6 SE +/- 0.045, N = 6 SE +/- 0.035, N = 6 SE +/- 0.027, N = 6 5.613 5.784 6.172 6.278 6.605 6.836 7.038 7.121 1. (CXX) g++ options: -O3 -fPIC -lm
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.0 Encoder Mode: Preset 12 - Input: Bosphorus 4K Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 40 80 120 160 200 SE +/- 0.20, N = 7 SE +/- 0.42, N = 7 SE +/- 0.41, N = 7 SE +/- 0.25, N = 7 SE +/- 0.40, N = 7 SE +/- 0.61, N = 7 SE +/- 0.97, N = 6 SE +/- 0.83, N = 5 177.86 165.50 164.25 156.52 151.72 146.10 127.55 122.09 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Google Draco Model: Lion OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Lion Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 1100 2200 3300 4400 5500 SE +/- 22.92, N = 8 SE +/- 21.09, N = 7 SE +/- 23.47, N = 7 SE +/- 25.25, N = 7 SE +/- 15.47, N = 6 SE +/- 21.44, N = 6 SE +/- 25.38, N = 6 SE +/- 18.24, N = 6 3861 3894 4731 4733 5188 5217 5322 5342 1. (CXX) g++ options: -O3
LAMMPS Molecular Dynamics Simulator Model: Rhodopsin Protein OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: Rhodopsin Protein Xeon Platinum 8592+ 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Platinum 8490H Xeon Max 9468 12 24 36 48 60 SE +/- 0.97, N = 15 SE +/- 0.09, N = 8 SE +/- 0.11, N = 9 SE +/- 0.33, N = 8 SE +/- 0.29, N = 15 SE +/- 0.04, N = 11 SE +/- 0.36, N = 15 SE +/- 0.05, N = 11 55.50 52.24 47.51 42.28 34.30 30.84 28.72 27.63 1. (CXX) g++ options: -O3 -lm -ldl
libavif avifenc Encoder Speed: 10, Lossless OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 10, Lossless Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 1.1963 2.3926 3.5889 4.7852 5.9815 SE +/- 0.008, N = 8 SE +/- 0.015, N = 8 SE +/- 0.015, N = 7 SE +/- 0.005, N = 7 SE +/- 0.006, N = 7 SE +/- 0.014, N = 7 SE +/- 0.028, N = 7 SE +/- 0.019, N = 7 4.456 4.579 4.867 4.916 4.923 5.074 5.311 5.317 1. (CXX) g++ options: -O3 -fPIC -lm
srsRAN Project Test: PDSCH Processor Benchmark, Throughput Thread OpenBenchmarking.org Mbps, More Is Better srsRAN Project 23.10.1-20240325 Test: PDSCH Processor Benchmark, Throughput Thread Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 160 320 480 640 800 SE +/- 1.89, N = 8 SE +/- 1.34, N = 8 SE +/- 1.27, N = 8 SE +/- 1.64, N = 8 SE +/- 1.17, N = 8 SE +/- 2.57, N = 8 SE +/- 5.02, N = 8 SE +/- 3.86, N = 8 755.5 742.9 705.5 702.6 680.2 675.5 663.8 651.9 1. (CXX) g++ options: -O3 -march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq -fno-trapping-math -fno-math-errno -ldl
Primesieve Length: 1e12 OpenBenchmarking.org Seconds, Fewer Is Better Primesieve 12.1 Length: 1e12 Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P Xeon Platinum 8592+ Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 2 4 6 8 10 SE +/- 0.008, N = 11 SE +/- 0.006, N = 10 SE +/- 0.005, N = 10 SE +/- 0.004, N = 9 SE +/- 0.007, N = 8 SE +/- 0.019, N = 8 SE +/- 0.010, N = 7 SE +/- 0.006, N = 7 2.187 2.325 2.691 3.121 4.250 4.576 5.332 6.160 1. (CXX) g++ options: -O3
libavif avifenc Encoder Speed: 6 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 1.0 Encoder Speed: 6 Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Platinum 8490H 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 Xeon Max 9480 2P Xeon Max 9468 2P 0.8496 1.6992 2.5488 3.3984 4.248 SE +/- 0.009, N = 10 SE +/- 0.016, N = 9 SE +/- 0.008, N = 9 SE +/- 0.022, N = 9 SE +/- 0.011, N = 9 SE +/- 0.017, N = 9 SE +/- 0.022, N = 9 SE +/- 0.029, N = 8 2.805 2.971 3.044 3.169 3.550 3.730 3.738 3.776 1. (CXX) g++ options: -O3 -fPIC -lm
NAS Parallel Benchmarks Test / Class: MG.C OpenBenchmarking.org Total Mop/s, More Is Better NAS Parallel Benchmarks 3.4 Test / Class: MG.C Xeon Platinum 8592+ 2P Xeon Max 9468 2P Xeon Max 9480 2P Xeon Platinum 8490H 2P Xeon Platinum 8592+ Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H 50K 100K 150K 200K 250K SE +/- 1422.07, N = 7 SE +/- 1415.96, N = 9 SE +/- 1298.67, N = 9 SE +/- 1262.04, N = 9 SE +/- 406.29, N = 9 SE +/- 382.59, N = 10 SE +/- 436.97, N = 10 SE +/- 152.92, N = 9 220893.78 172614.10 171436.47 163333.21 107321.89 86407.46 85910.95 83448.70 1. (F9X) gfortran options: -O3 -march=native -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 2. Open MPI 4.1.6
Parallel BZIP2 Compression FreeBSD-13.0-RELEASE-amd64-memstick.img Compression OpenBenchmarking.org Seconds, Fewer Is Better Parallel BZIP2 Compression 1.1.13 FreeBSD-13.0-RELEASE-amd64-memstick.img Compression Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 0.5922 1.1844 1.7766 2.3688 2.961 SE +/- 0.024402, N = 15 SE +/- 0.017240, N = 15 SE +/- 0.028863, N = 15 SE +/- 0.023842, N = 15 SE +/- 0.030907, N = 15 SE +/- 0.007749, N = 10 SE +/- 0.020941, N = 15 SE +/- 0.023295, N = 15 1.432362 1.469210 1.711296 1.847537 1.982932 2.144857 2.287766 2.632077 1. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread
oneDNN Harness: Deconvolution Batch shapes_3d - Engine: CPU OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.4 Harness: Deconvolution Batch shapes_3d - Engine: CPU Xeon Platinum 8592+ 2P Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Platinum 8490H Xeon Max 9480 Xeon Max 9468 0.2844 0.5688 0.8532 1.1376 1.422 SE +/- 0.000902, N = 9 SE +/- 0.001274, N = 9 SE +/- 0.001240, N = 9 SE +/- 0.000392, N = 9 SE +/- 0.000806, N = 9 SE +/- 0.000805, N = 9 SE +/- 0.000927, N = 9 SE +/- 0.000508, N = 9 0.624250 0.736170 0.864358 0.907161 0.945075 1.077430 1.196430 1.264070 MIN: 0.58 MIN: 0.66 MIN: 0.81 MIN: 0.87 MIN: 0.9 MIN: 1.06 MIN: 1.16 MIN: 1.21 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
WebP Image Encode Encode Settings: Quality 100 OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100 Xeon Platinum 8592+ Xeon Platinum 8592+ 2P Xeon Max 9480 Xeon Max 9468 Xeon Platinum 8490H Xeon Platinum 8490H 2P Xeon Max 9480 2P Xeon Max 9468 2P 3 6 9 12 15 SE +/- 0.00, N = 10 SE +/- 0.01, N = 10 SE +/- 0.00, N = 10 SE +/- 0.00, N = 10 SE +/- 0.01, N = 10 SE +/- 0.01, N = 10 SE +/- 0.00, N = 10 SE +/- 0.00, N = 10 11.36 11.31 10.13 10.13 10.11 10.05 10.03 10.01 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
Timed CPython Compilation Build Configuration: Default OpenBenchmarking.org Seconds, Fewer Is Better Timed CPython Compilation 3.10.6 Build Configuration: Default Xeon Platinum 8592+ 2P Xeon Platinum 8592+ Xeon Max 9468 2P Xeon Max 9480 2P Xeon Max 9480 Xeon Platinum 8490H 2P Xeon Max 9468 Xeon Platinum 8490H 5 10 15 20 25 16.93 17.08 18.81 18.82 18.85 18.93 19.12 19.20
Phoronix Test Suite v10.8.4