2 x Intel Xeon Max 9480 benchmarks for a future article.
Linux 6.8 Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro SYS-221H-TNR X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb
OS: Ubuntu 23.10, Kernel: 6.8.0-060800-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290Python Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Linux 6.9-rc2 OS: Ubuntu 23.10, Kernel: 6.9.0-060900rc2-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290Python Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Xeon Max Linux 6.9 Kernel Benchmarks OpenBenchmarking.org Phoronix Test Suite 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads) Supermicro SYS-221H-TNR X13DEM v1.10 (1.3 BIOS) Intel Device 1bce 512GB 7682GB INTEL SSDPF2KX076TZ ASPEED 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ubuntu 23.10 6.8.0-060800-generic (x86_64) 6.9.0-060900rc2-generic (x86_64) GNOME Shell 45.0 X Server 1.21.1.7 GCC 13.2.0 ext4 1024x768 Processor Motherboard Chipset Memory Disk Graphics Network OS Kernels Desktop Display Server Compiler File-System Screen Resolution Xeon Max Linux 6.9 Kernel Benchmarks Performance System Logs - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290 - Python 3.11.6 - Linux 6.8: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Linux 6.9-rc2: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Linux 6.8 vs. Linux 6.9-rc2 Comparison Phoronix Test Suite Baseline +27.9% +27.9% +55.8% +55.8% +83.7% +83.7% 22% 13.9% 10.5% 9.9% 9.9% 8.8% 8.3% 8% 6.6% 6.1% 5.9% 5.9% 5.8% 5.7% 5.4% 5.4% 5% 5% 4.9% 4.9% 4.9% 4.6% 4.5% 4.2% 4.1% 4.1% 4.1% 4% 3.9% 3.9% 3.8% 3.7% 3.4% 3.4% 3.4% 3.3% 3.2% 3.2% 3.1% 3% 2.8% 2.8% 2.8% 2.8% 2.7% 2.7% 2.5% 2.2% 2.2% 2.2% 2.1% 2.1% 2% 2% 2% 3.6% 8.7% 6% 16.6% 7.5% 5.6% 11.7% 25.2% 4.7% 3.1% 9.5% 4.4% 5.9% R.N.N.T - CPU 111.5% fcn-resnet101-11 - CPU - Standard T5 Encoder - CPU - Standard 32 - Process 13.1% fcn-resnet101-11 - CPU - Parallel Pthread 10.2% R.v.1.i - CPU - Standard A.G.R.R.0.F - CPU Pathtracer - Asian Dragon Obj 9.1% A.G.R.R.0.F - CPU Pathtracer ISPC - Crown 8.7% yolov4 - CPU - Standard bertsquad-12 - CPU - Standard D.B.s - CPU libx265 - Platform 6.3% CPU - 1 - AlexNet 1024 F.R.C.R.5.F.i - CPU - Standard T5 Encoder - CPU - Parallel SENDFILE G.C.S.F CaffeNet 12-int8 - CPU - Standard CPU - 64 - AlexNet 5.1% CPU - 64 - GoogLeNet 5% V.D.F - CPU V.D.F - CPU S.V.M.P Q.7.C.E.7 4.9% Context Switching 4.9% P.D.F - CPU P.D.F - CPU ArcFace ResNet-100 - CPU - Parallel 500M RT.ldr_alb_nrm.3840x2160 - CPU-Only 4.5% Default 4.4% Pathtracer - Crown 4.3% MMAP particle_volume/pathtracer/real_time 4.1% W.P.D.F.I - CPU JPEG - 90 super-resolution-10 - CPU - Standard W.P.D.F.I - CPU Chess Benchmark Socket Activity 3.9% Pathtracer ISPC - Asian Dragon 2 - 1080p - 32 - Path Tracer - CPU 3.9% GPT-2 - CPU - Parallel SHA256 3.7% gravity_spheres_volume/dim_512/pathtracer/real_time IO_uring 3.7% P.D.F - CPU Bosphorus 4K - Faster 3.4% llama-2-13b.Q4_0.gguf P.D.F - CPU Fishy Cat - CPU-Only 3.4% ArcFace ResNet-100 - CPU - Standard R.S.A.F - CPU R.S.A.F - CPU 3 - 1080p - 32 - Path Tracer - CPU Semaphores 3.1% gravity_spheres_volume/dim_512/scivis/real_time Q.9.C.E.7 3% particle_volume/ao/real_time 3% Barbershop - CPU-Only 2.8% CPU - 16 - ResNet-50 RSA4096 PNG - 90 2.8% Crypto llama-2-70b-chat.Q5_0.gguf Pathtracer ISPC - Asian Dragon Obj MPI CPU - water_GMX50_bare 2.7% Bosphorus 1080p - Faster 2.7% 16 - Thread 3 - 4K - 1 - Path Tracer - CPU 2.7% wizardcoder-python-34b-v1.0.Q6_K - CPU 2.6% 1 - 1080p - 1 - Path Tracer - CPU 2.6% R.R.W.R 2.5% 2 - 1080p - 1 - Path Tracer - CPU Zlib 2.4% Memory Copying 2.3% RT.hdr_alb_nrm.3840x2160 - CPU-Only 2.2% C.B.S.A - CPU V.P.M 3 - 4K - 16 - Path Tracer - CPU Junkshop - CPU-Only 2.1% 3 - 1080p - 16 - Path Tracer - CPU Matrix Math defconfig Monero - 1M H.E.R.F.I - CPU 2% CPU - 64 - ResNet-50 H.E.R.F.I - CPU 2% GPT-2 - CPU - Parallel yolov4 - CPU - Standard T5 Encoder - CPU - Parallel T5 Encoder - CPU - Standard bertsquad-12 - CPU - Standard CaffeNet 12-int8 - CPU - Standard fcn-resnet101-11 - CPU - Parallel fcn-resnet101-11 - CPU - Standard ArcFace ResNet-100 - CPU - Parallel ArcFace ResNet-100 - CPU - Standard R.v.1.i - CPU - Standard super-resolution-10 - CPU - Standard F.R.C.R.5.F.i - CPU - Standard oneDNN ONNX Runtime ONNX Runtime Hackbench ONNX Runtime Stress-NG ONNX Runtime OpenVINO Embree OpenVINO Embree ONNX Runtime ONNX Runtime oneDNN FFmpeg TensorFlow MariaDB mariadb-slap ONNX Runtime ONNX Runtime Stress-NG Stress-NG ONNX Runtime TensorFlow TensorFlow OpenVINO OpenVINO Stress-NG WebP2 Image Encode Stress-NG OpenVINO OpenVINO ONNX Runtime Y-Cruncher Intel Open Image Denoise WebP2 Image Encode Embree Stress-NG OSPRay OpenVINO JPEG-XL libjxl ONNX Runtime OpenVINO Stockfish Stress-NG Embree OSPRay Studio ONNX Runtime OpenSSL OSPRay Stress-NG OpenVINO VVenC Llama.cpp OpenVINO Blender ONNX Runtime OpenVINO OpenVINO OSPRay Studio Stress-NG OSPRay WebP2 Image Encode OSPRay Blender TensorFlow OpenSSL JPEG-XL libjxl Stress-NG Llama.cpp Embree GROMACS VVenC Hackbench OSPRay Studio Llamafile OSPRay Studio RocksDB OSPRay Studio Stress-NG Stress-NG Intel Open Image Denoise oneDNN BRL-CAD OSPRay Studio Blender OSPRay Studio Stress-NG Timed Linux Kernel Compilation Xmrig OpenVINO TensorFlow OpenVINO ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime ONNX Runtime Linux 6.8 Linux 6.9-rc2
Xeon Max Linux 6.9 Kernel Benchmarks stress-ng: Hash stress-ng: MMAP stress-ng: NUMA stress-ng: Pipe stress-ng: Poll stress-ng: Zlib stress-ng: MEMFD stress-ng: Mutex stress-ng: Crypto stress-ng: Malloc stress-ng: Pthread stress-ng: AVL Tree stress-ng: IO_uring stress-ng: SENDFILE stress-ng: CPU Stress stress-ng: Semaphores stress-ng: Matrix Math stress-ng: Floating Point stress-ng: Matrix 3D Math stress-ng: Memory Copying stress-ng: Vector Shuffle stress-ng: Mixed Scheduler stress-ng: Socket Activity stress-ng: Wide Vector Math stress-ng: Context Switching stress-ng: Fused Multiply-Add stress-ng: Vector Floating Point stress-ng: Glibc C String Functions stress-ng: Glibc Qsort Data Sorting stress-ng: System V Message Passing openssl: SHA256 openssl: SHA512 quicksilver: CORAL2 P1 quicksilver: CORAL2 P2 ffmpeg: libx264 - Live ffmpeg: libx265 - Live ffmpeg: libx264 - Upload ffmpeg: libx265 - Upload ffmpeg: libx264 - Platform ffmpeg: libx265 - Platform ffmpeg: libx264 - Video On Demand ffmpeg: libx265 - Video On Demand openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU embree: Pathtracer - Crown embree: Pathtracer ISPC - Crown embree: Pathtracer - Asian Dragon embree: Pathtracer - Asian Dragon Obj embree: Pathtracer ISPC - Asian Dragon embree: Pathtracer ISPC - Asian Dragon Obj svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 4 - Bosphorus 1080p vvenc: Bosphorus 4K - Fast vvenc: Bosphorus 4K - Faster vvenc: Bosphorus 1080p - Fast vvenc: Bosphorus 1080p - Faster xmrig: KawPow - 1M xmrig: Monero - 1M xmrig: Wownero - 1M xmrig: GhostRider - 1M xmrig: CryptoNight-Heavy - 1M xmrig: CryptoNight-Femto UPX2 - 1M oidn: RT.hdr_alb_nrm.3840x2160 - CPU-Only oidn: RT.ldr_alb_nrm.3840x2160 - CPU-Only oidn: RTLightmap.hdr.4096x4096 - CPU-Only tensorflow: CPU - 1 - AlexNet tensorflow: CPU - 16 - AlexNet tensorflow: CPU - 32 - AlexNet tensorflow: CPU - 64 - AlexNet tensorflow: CPU - 1 - GoogLeNet tensorflow: CPU - 1 - ResNet-50 tensorflow: CPU - 256 - AlexNet tensorflow: CPU - 16 - GoogLeNet tensorflow: CPU - 16 - ResNet-50 tensorflow: CPU - 32 - GoogLeNet tensorflow: CPU - 32 - ResNet-50 tensorflow: CPU - 64 - GoogLeNet tensorflow: CPU - 64 - ResNet-50 tensorflow: CPU - 256 - GoogLeNet tensorflow: CPU - 256 - ResNet-50 onnx: GPT-2 - CPU - Parallel onnx: yolov4 - CPU - Parallel onnx: yolov4 - CPU - Standard onnx: T5 Encoder - CPU - Parallel onnx: T5 Encoder - CPU - Standard onnx: bertsquad-12 - CPU - Parallel onnx: bertsquad-12 - CPU - Standard onnx: CaffeNet 12-int8 - CPU - Parallel onnx: CaffeNet 12-int8 - CPU - Standard onnx: fcn-resnet101-11 - CPU - Parallel onnx: fcn-resnet101-11 - CPU - Standard onnx: ArcFace ResNet-100 - CPU - Parallel onnx: ArcFace ResNet-100 - CPU - Standard onnx: ResNet50 v1-12-int8 - CPU - Parallel onnx: ResNet50 v1-12-int8 - CPU - Standard onnx: super-resolution-10 - CPU - Parallel onnx: super-resolution-10 - CPU - Standard onnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallel onnx: Faster R-CNN R-50-FPN-int8 - CPU - Standard ospray: particle_volume/ao/real_time ospray: particle_volume/scivis/real_time ospray: particle_volume/pathtracer/real_time ospray: gravity_spheres_volume/dim_512/ao/real_time ospray: gravity_spheres_volume/dim_512/scivis/real_time ospray: gravity_spheres_volume/dim_512/pathtracer/real_time cachebench: Read cachebench: Write cachebench: Read / Modify / Write compress-lz4: 1 - Compression Speed compress-lz4: 1 - Decompression Speed compress-lz4: 3 - Compression Speed compress-lz4: 3 - Decompression Speed compress-lz4: 9 - Compression Speed compress-lz4: 9 - Decompression Speed srsran: PDSCH Processor Benchmark, Throughput Total jpegxl: PNG - 80 jpegxl: PNG - 90 jpegxl: JPEG - 80 jpegxl: JPEG - 90 jpegxl: PNG - 100 jpegxl: JPEG - 100 jpegxl-decode: All webp2: Default webp2: Quality 75, Compression Effort 7 webp2: Quality 95, Compression Effort 7 webp2: Quality 100, Compression Effort 5 webp2: Quality 100, Lossless Compression stockfish: Chess Benchmark gromacs: MPI CPU - water_GMX50_bare rocksdb: Overwrite rocksdb: Rand Read rocksdb: Update Rand rocksdb: Read Rand Write Rand speedb: Rand Fill speedb: Rand Read speedb: Update Rand speedb: Seq Fill speedb: Rand Fill Sync speedb: Read Rand Write Rand mysqlslap: 512 mysqlslap: 1024 openssl: RSA4096 llama-cpp: llama-2-13b.Q4_0.gguf llama-cpp: llama-2-70b-chat.Q5_0.gguf llamafile: mistral-7b-instruct-v0.2.Q8_0 - CPU llamafile: wizardcoder-python-34b-v1.0.Q6_K - CPU openssl: RSA4096 brl-cad: VGR Performance Metric v-ray: CPU onnx: GPT-2 - CPU - Parallel onnx: yolov4 - CPU - Parallel onnx: yolov4 - CPU - Standard onnx: T5 Encoder - CPU - Parallel onnx: T5 Encoder - CPU - Standard onnx: bertsquad-12 - CPU - Parallel onnx: bertsquad-12 - CPU - Standard onnx: CaffeNet 12-int8 - CPU - Parallel onnx: CaffeNet 12-int8 - CPU - Standard onnx: fcn-resnet101-11 - CPU - Parallel onnx: fcn-resnet101-11 - CPU - Standard onnx: ArcFace ResNet-100 - CPU - Parallel onnx: ArcFace ResNet-100 - CPU - Standard onnx: ResNet50 v1-12-int8 - CPU - Parallel onnx: ResNet50 v1-12-int8 - CPU - Standard onnx: super-resolution-10 - CPU - Parallel onnx: super-resolution-10 - CPU - Standard onnx: Faster R-CNN R-50-FPN-int8 - CPU - Parallel onnx: Faster R-CNN R-50-FPN-int8 - CPU - Standard onednn: IP Shapes 1D - CPU onednn: IP Shapes 3D - CPU onednn: Convolution Batch Shapes Auto - CPU onednn: Deconvolution Batch shapes_1d - CPU onednn: Deconvolution Batch shapes_3d - CPU onednn: Recurrent Neural Network Training - CPU onednn: Recurrent Neural Network Inference - CPU ospray-studio: 1 - 4K - 1 - Path Tracer - CPU ospray-studio: 2 - 4K - 1 - Path Tracer - CPU ospray-studio: 3 - 4K - 1 - Path Tracer - CPU ospray-studio: 1 - 4K - 16 - Path Tracer - CPU ospray-studio: 1 - 4K - 32 - Path Tracer - CPU ospray-studio: 2 - 4K - 16 - Path Tracer - CPU ospray-studio: 2 - 4K - 32 - Path Tracer - CPU ospray-studio: 3 - 4K - 16 - Path Tracer - CPU ospray-studio: 3 - 4K - 32 - Path Tracer - CPU ospray-studio: 1 - 1080p - 1 - Path Tracer - CPU ospray-studio: 2 - 1080p - 1 - Path Tracer - CPU ospray-studio: 3 - 1080p - 1 - Path Tracer - CPU ospray-studio: 1 - 1080p - 16 - Path Tracer - CPU ospray-studio: 1 - 1080p - 32 - Path Tracer - CPU ospray-studio: 2 - 1080p - 16 - Path Tracer - CPU ospray-studio: 2 - 1080p - 32 - Path Tracer - CPU ospray-studio: 3 - 1080p - 16 - Path Tracer - CPU ospray-studio: 3 - 1080p - 32 - Path Tracer - CPU draco: Lion draco: Church Facade openvino: Face Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16 - CPU openvino: Road Segmentation ADAS FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Noise Suppression Poconet-Like FP16 - CPU openvino: Handwritten English Recognition FP16 - CPU openvino: Person Re-Identification Retail FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU build-ffmpeg: Time To Compile build-linux-kernel: defconfig build-linux-kernel: allmodconfig build-mesa: Time To Compile primesieve: 1e12 primesieve: 1e13 y-cruncher: 1B y-cruncher: 500M hackbench: 16 - Thread hackbench: 16 - Process hackbench: 32 - Process blender: BMW27 - CPU-Only blender: Junkshop - CPU-Only blender: Classroom - CPU-Only blender: Fishy Cat - CPU-Only blender: Barbershop - CPU-Only blender: Pabellon Barcelona - CPU-Only encode-wavpack: WAV To WavPack Linux 6.8 Linux 6.9-rc2 17071694.52 6169.36 482.62 30377557.97 10389186.02 9670.37 688.26 28490133.28 143967.24 163551396.40 39599.26 810.19 3468957.59 1798203.12 202073.08 154589461.19 384748.54 29600.02 31442.69 21085.10 576905.92 70407.96 47927.75 5874353.63 20343491.52 204365411.59 234669.74 80643523.24 1866.58 17859304.38 84678420667 29940735740 6814667 6677333 181.51 112.43 11.50 22.31 42.76 42.74 42.94 44.80 119.92 451.13 445.90 2530.04 331.23 11260.98 1018.47 5067.40 16147.57 15532.54 1446.42 671.66 26732.88 6336.78 4621.32 3626.41 11638.51 67789.25 3777.56 121702.12 36.6011 38.8350 35.4033 39.8177 31.5957 36.4359 5.865 48.943 127.202 123.246 18.662 4.902 9.847 15.913 33.986 32860.8 32361.2 36096.6 9592.3 32856.3 33002.2 2.28 2.32 1.06 17.23 213.35 346.10 495.72 6.05 1.88 723.16 58.50 24.12 96.31 35.30 135.18 47.03 202.37 70.10 101.901 7.91321 8.22351 185.294 353.573 10.7817 14.2656 292.173 541.827 1.35994 4.43649 16.7832 23.4613 94.2487 111.5706 152.635 205.414 23.4276 32.4503 29.7336 29.2815 102.9501 10.70212 10.50412 24.2805 13344.699620 93036.302415 99112.699260 602.69 3601.0 98.43 3364.8 32.61 3537.0 17006.8 32.477 30.969 34.604 32.562 25.666 26.002 386.232 5.90 0.64 0.34 8.35 0.07 61999717 12.085 388010 360498518 359825 2120844 326499 380419389 292180 327637 257446 1181758 86 34 38204.6 1.48 0.36 4.50 0.79 1358616.4 3906839 59852 9.80514 126.384 122.236 5.41191 2.89501 92.7467 70.9566 3.42357 1.84807 747.084 231.284 59.6021 42.7819 10.6098 9.01538 6.55011 4.88181 42.6833 30.8209 4.50055 4.79853 9.00621 18.3377 6.16576 4821.32 748.495 1801 1861 2108 34412 61363 35317 63514 40657 72172 466 501 569 6909 13867 7402 14836 8732 17204 6129 7747 307.74 81.90 82.87 14.58 337.21 9.92 36.28 22.06 6.85 7.17 77.34 54.98 4.05 17.52 23.68 30.85 9.59 0.78 29.61 0.38 17.245 38.462 307.502 19.511 3.356 39.619 13.416 6.483 14.679 13.112 24.748 21.82 45.60 53.98 38.09 271.99 76.20 6.349 17199190.09 6427.33 487.60 29814480.67 10232390.41 9446.07 688.76 28934422.16 147978.33 161652700.09 35919.64 808.99 3346567.80 1900682.08 200671.70 150005776.47 392750.09 29139.60 31460.42 20605.39 569593.00 70036.20 46123.32 5908316.03 19390362.90 200468629.32 230503.34 85035507.55 1858.70 18740350.56 81678284176 29665499053 6916667 6689667 182.12 113.99 11.51 22.24 42.77 40.20 42.88 44.24 121.93 466.45 467.79 2656.42 330.73 11295.92 1051.30 5052.71 16349.05 15589.59 1442.21 673.46 27790.24 6306.42 4600.95 3608.21 11564.78 73754.74 3704.38 119735.57 35.0788 35.7348 35.6507 36.5030 32.8297 37.4335 5.760 48.568 126.187 123.098 18.934 4.936 9.524 16.152 33.094 33072.5 33015.5 36180.7 9602.7 32826.1 32993.8 2.23 2.22 1.04 18.28 210.71 341.97 471.88 5.98 1.90 711.74 58.83 24.80 97.53 34.86 128.71 47.96 203.63 70.53 105.7827 8.04142 8.90936 196.076 402.669 10.6006 15.4110 293.029 571.190 1.50300 5.41259 17.5623 24.2328 95.1441 122.601 153.564 213.737 23.1727 34.3512 28.8754 29.0693 98.8690 10.5090 10.8236 25.1712 13341.467325 93862.763311 98711.076947 602.54 3628.0 98.41 3349.6 32.66 3492.0 16877.6 33.045 30.128 34.187 33.888 25.607 25.960 381.657 5.65 0.61 0.33 8.45 0.07 64443099 11.764 391968 361586083 361502 2068588 322816 375837479 293414 330167 259603 1175562 86 36 38147.4 1.53 0.37 4.58 0.77 1396904.0 3991802 58995 9.46496 124.376 112.428 5.10755 2.48234 94.3330 65.9960 3.40972 1.74973 668.699 184.785 56.9478 41.5048 10.5119 8.23121 6.51127 4.67811 43.1511 29.1107 4.51166 4.84245 8.81043 18.0275 5.78202 10195.75 753.364 1774 1839 2164 34953 61162 35422 63529 39794 73367 478 489 570 6804 13807 7506 15415 8552 16687 6054 7762 302.77 79.23 79.00 13.89 337.78 9.89 35.14 22.12 6.76 7.14 77.57 54.83 3.89 17.58 23.97 31.01 9.65 0.71 30.20 0.38 17.283 37.698 311.745 19.888 3.299 39.461 13.335 6.202 14.298 13.357 27.994 22.02 46.56 53.82 39.37 279.74 75.56 6.340 OpenBenchmarking.org
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. The system/openssl test profiles relies on benchmarking the system/OS-supplied openssl binary rather than the pts/openssl test profile that uses the locally-built OpenSSL for benchmarking. Learn more via the OpenBenchmarking.org test page.
Quicksilver Quicksilver is a proxy application that represents some elements of the Mercury workload by solving a simplified dynamic Monte Carlo particle transport problem. Quicksilver is developed by Lawrence Livermore National Laboratory (LLNL) and this test profile currently makes use of the OpenMP CPU threaded code path. Learn more via the OpenBenchmarking.org test page.
FFmpeg This is a benchmark of the FFmpeg multimedia framework. The FFmpeg test profile is making use of a modified version of vbench from Columbia University's Architecture and Design Lab (ARCADE) [http://arcade.cs.columbia.edu/vbench/] that is a benchmark for video-as-a-service workloads. The test profile offers the options of a range of vbench scenarios based on freely distributable video content and offers the options of using the x264 or x265 video encoders for transcoding. Learn more via the OpenBenchmarking.org test page.
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
ONNX Runtime ONNX Runtime is developed by Microsoft and partners as a open-source, cross-platform, high performance machine learning inferencing and training accelerator. This test profile runs the ONNX Runtime with various models available from the ONNX Model Zoo. Learn more via the OpenBenchmarking.org test page.
WebP2 Image Encode This is a test of Google's libwebp2 library with the WebP2 image encode utility and using a sample 6000x4000 pixel JPEG image as the input, similar to the WebP/libwebp test profile. WebP2 is currently experimental and under heavy development as ultimately the successor to WebP. WebP2 supports 10-bit HDR, more efficienct lossy compression, improved lossless compression, animation support, and full multi-threading support compared to WebP. Learn more via the OpenBenchmarking.org test page.
GROMACS The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. The system/openssl test profiles relies on benchmarking the system/OS-supplied openssl binary rather than the pts/openssl test profile that uses the locally-built OpenSSL for benchmarking. Learn more via the OpenBenchmarking.org test page.
Llama.cpp Llama.cpp is a port of Facebook's LLaMA model in C/C++ developed by Georgi Gerganov. Llama.cpp allows the inference of LLaMA and other supported models in C/C++. For CPU inference Llama.cpp supports AVX2/AVX-512, ARM NEON, and other modern ISAs along with features like OpenBLAS usage. Learn more via the OpenBenchmarking.org test page.
Llamafile Mozilla's Llamafile allows distributing and running large language models (LLMs) as a single file. Llamafile aims to make open-source LLMs more accessible to developers and users. Llamafile supports a variety of models, CPUs and GPUs, and other options. Learn more via the OpenBenchmarking.org test page.
OpenSSL OpenSSL is an open-source toolkit that implements SSL (Secure Sockets Layer) and TLS (Transport Layer Security) protocols. The system/openssl test profiles relies on benchmarking the system/OS-supplied openssl binary rather than the pts/openssl test profile that uses the locally-built OpenSSL for benchmarking. Learn more via the OpenBenchmarking.org test page.
BRL-CAD OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.38.2 VGR Performance Metric Linux 6.8 Linux 6.9-rc2 900K 1800K 2700K 3600K 4500K 3906839 3991802 1. (CXX) g++ options: -std=c++17 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lnetpbm -lregex_brl -lz_brl -lassimp -ldl -lm -ltk8.6
Timed Linux Kernel Compilation
Geometric Mean Of All Test Results OpenBenchmarking.org Geometric Mean, More Is Better Geometric Mean Of All Test Results Result Composite - Xeon Max Linux 6.9 Kernel Benchmarks Linux 6.8 Linux 6.9-rc2 30 60 90 120 150 146.99 147.76
Hide Result
Linux 6.8 Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro SYS-221H-TNR X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb
OS: Ubuntu 23.10, Kernel: 6.8.0-060800-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290Python Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 29 March 2024 19:39 by user phoronix.
Linux 6.9-rc2 Processor: 2 x Intel Xeon Max 9480 @ 3.50GHz (112 Cores / 224 Threads), Motherboard: Supermicro SYS-221H-TNR X13DEM v1.10 (1.3 BIOS), Chipset: Intel Device 1bce, Memory: 512GB, Disk: 7682GB INTEL SSDPF2KX076TZ, Graphics: ASPEED, Network: 2 x Broadcom BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb
OS: Ubuntu 23.10, Kernel: 6.9.0-060900rc2-generic (x86_64), Desktop: GNOME Shell 45.0, Display Server: X Server 1.21.1.7, Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_cpufreq performance - CPU Microcode: 0x2c000290Python Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 1 April 2024 10:41 by user phoronix.