Benchmarks for a future article.
Ubuntu Linux 23.10 Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 23.10, Kernel: 6.5.0-17-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Python Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
CentOS Stream 9 Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive , Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: CentOS Stream 9, Kernel: 5.14.0-419.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.4.1 20231218, File-System: xfs, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Python Notes: Python 3.9.18Security Notes: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Fedora Server 39 OS: Fedora Linux 39, Kernel: 6.7.6-200.fc39.x86_64 (x86_64), Compiler: GCC 13.2.1 20231205, File-System: xfs, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driverProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Python Notes: Python 3.12.2Security Notes: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Graph500 This is a benchmark of the reference implementation of Graph500, an HPC benchmark focused on data intensive loads and commonly tested on supercomputers for complex data problems. Graph500 primarily stresses the communication subsystem of the hardware under test. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 300M 600M 900M 1200M 1500M 1289580000 1499600000 1253250000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 300M 600M 900M 1200M 1500M 1226550000 1464120000 1195510000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Quicksilver Quicksilver is a proxy application that represents some elements of the Mercury workload by solving a simplified dynamic Monte Carlo particle transport problem. Quicksilver is developed by Lawrence Livermore National Laboratory (LLNL) and this test profile currently makes use of the OpenMP CPU threaded code path. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CTS2 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 1.6M 3.2M 4.8M 6.4M 8M SE +/- 80526.35, N = 9 SE +/- 121572.66, N = 6 SE +/- 90618.71, N = 4 7680222 7398333 7367500 1. (CXX) g++ options: -fopenmp -O3 -march=native
OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CORAL2 P1 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 1.3M 2.6M 3.9M 5.2M 6.5M SE +/- 65941.38, N = 12 SE +/- 105910.76, N = 12 SE +/- 42699.12, N = 11 5931500 5800833 5835818 1. (CXX) g++ options: -fopenmp -O3 -march=native
OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CORAL2 P2 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 1.4M 2.8M 4.2M 5.6M 7M SE +/- 81512.06, N = 9 SE +/- 51868.42, N = 3 SE +/- 74346.22, N = 5 6744778 6381000 6759600 1. (CXX) g++ options: -fopenmp -O3 -march=native
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 80 160 240 320 400 SE +/- 0.48, N = 3 SE +/- 2.69, N = 3 SE +/- 0.63, N = 3 375.75 328.37 340.97 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 110 220 330 440 550 SE +/- 5.90, N = 4 SE +/- 1.20, N = 3 SE +/- 6.06, N = 4 519.83 528.79 529.14 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 2K 4K 6K 8K 10K SE +/- 20.48, N = 3 SE +/- 7.04, N = 3 SE +/- 9.74, N = 3 8901.61 8908.74 8862.07 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 5K 10K 15K 20K 25K SE +/- 208.25, N = 3 SE +/- 36.89, N = 3 SE +/- 130.19, N = 3 24570.10 24295.71 24296.54 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 500 1000 1500 2000 2500 SE +/- 15.67, N = 3 SE +/- 10.50, N = 3 SE +/- 4.46, N = 3 2377.90 2412.51 2383.22 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 200 400 600 800 1000 SE +/- 4.60, N = 3 SE +/- 13.25, N = 15 SE +/- 8.04, N = 9 1143.25 617.45 978.70 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 9K 18K 27K 36K 45K SE +/- 43.54, N = 3 SE +/- 347.22, N = 3 SE +/- 194.22, N = 3 43516.98 40187.34 42419.89 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 2K 4K 6K 8K 10K SE +/- 140.94, N = 3 SE +/- 104.96, N = 5 SE +/- 124.93, N = 4 10033.95 10113.47 10082.93 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 700 1400 2100 2800 3500 SE +/- 1.65, N = 3 SE +/- 1.03, N = 3 SE +/- 4.78, N = 3 3217.84 3196.47 3255.16 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 13K 26K 39K 52K 65K SE +/- 827.51, N = 15 SE +/- 478.67, N = 3 SE +/- 271.02, N = 3 61020.16 60429.54 56624.98 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 30 60 90 120 150 SE +/- 0.25, N = 3 SE +/- 1.24, N = 15 SE +/- 1.32, N = 15 100.34 105.62 142.17 MIN: 95.92 / MAX: 109.46 MIN: 95.01 / MAX: 132.75 MIN: 115.81 / MAX: 164.58
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 40 80 120 160 200 SE +/- 0.50, N = 3 SE +/- 3.90, N = 15 SE +/- 0.73, N = 3 144.92 177.80 179.54 MIN: 137.85 / MAX: 155.04 MIN: 142.88 / MAX: 210.57 MIN: 145.33 / MAX: 207.47
SVT-AV1 This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 4 - Input: Bosphorus 4K Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 0.5306 1.0612 1.5918 2.1224 2.653 SE +/- 0.007, N = 3 SE +/- 0.009, N = 3 SE +/- 0.008, N = 3 2.307 2.358 2.346 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 8 - Input: Bosphorus 4K Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 5 10 15 20 25 SE +/- 0.19, N = 3 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 21.32 21.56 21.16 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 12 - Input: Bosphorus 4K Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 16 32 48 64 80 SE +/- 0.48, N = 15 SE +/- 0.39, N = 3 SE +/- 0.99, N = 3 66.86 69.87 71.52 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 13 - Input: Bosphorus 4K Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 16 32 48 64 80 SE +/- 0.74, N = 5 SE +/- 0.99, N = 3 SE +/- 0.53, N = 3 66.43 69.72 70.87 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
VVenC VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under the Clear BSD License. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Fast Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 0.6377 1.2754 1.9131 2.5508 3.1885 SE +/- 0.035, N = 3 SE +/- 0.026, N = 3 SE +/- 0.017, N = 3 2.785 2.823 2.834 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Faster Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 1.3068 2.6136 3.9204 5.2272 6.534 SE +/- 0.061, N = 4 SE +/- 0.013, N = 3 SE +/- 0.035, N = 3 5.611 5.808 5.804 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
High Performance Conjugate Gradient HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 104 104 104 - RT: 60 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 16 32 48 64 80 SE +/- 0.19, N = 3 SE +/- 0.12, N = 3 SE +/- 0.14, N = 3 71.14 71.13 72.46 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 16 32 48 64 80 SE +/- 0.52, N = 3 SE +/- 0.83, N = 4 SE +/- 0.27, N = 3 69.34 69.17 70.38 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 1.1025 2.205 3.3075 4.41 5.5125 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 15 4.54 4.90 4.70
OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 0.5648 1.1296 1.6944 2.2592 2.824 SE +/- 0.01, N = 3 SE +/- 0.03, N = 4 SE +/- 0.01, N = 15 2.18 2.51 2.25
TensorFlow This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 Ubuntu Linux 23.10 CentOS Stream 9 20 40 60 80 100 SE +/- 0.84, N = 3 SE +/- 0.83, N = 4 73.12 76.68
Device: CPU - Batch Size: 512 - Model: ResNet-50
Fedora Server 39: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'absl'
OpenVKL OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 600 1200 1800 2400 3000 SE +/- 20.99, N = 3 SE +/- 33.05, N = 3 SE +/- 22.66, N = 3 2821 2815 2821 MIN: 175 / MAX: 34505 MIN: 186 / MAX: 35204 MIN: 178 / MAX: 36193
OSPRay Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/ao/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 5 10 15 20 25 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 20.65 20.50 20.44
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/scivis/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 5 10 15 20 25 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 20.77 20.44 20.54
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/pathtracer/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 20 40 60 80 100 SE +/- 0.35, N = 3 SE +/- 0.23, N = 3 SE +/- 0.58, N = 3 82.97 83.57 82.14
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 7 14 21 28 35 SE +/- 0.05, N = 3 SE +/- 0.26, N = 15 SE +/- 0.10, N = 3 28.61 29.76 28.66
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 7 14 21 28 35 SE +/- 0.11, N = 3 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 28.92 29.51 28.43
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 8 16 24 32 40 SE +/- 0.05, N = 3 SE +/- 0.48, N = 15 SE +/- 0.12, N = 3 32.32 33.29 31.70
Neural Magic DeepSparse This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 30 60 90 120 150 SE +/- 0.29, N = 3 SE +/- 0.30, N = 3 132.68 132.91
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 1000 2000 3000 4000 5000 SE +/- 40.60, N = 7 SE +/- 40.12, N = 7 4547.54 4462.53
Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 400 800 1200 1600 2000 SE +/- 7.36, N = 3 SE +/- 4.86, N = 3 1837.11 1863.34
Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 2K 4K 6K 8K 10K SE +/- 102.73, N = 7 SE +/- 43.63, N = 3 11099.64 11022.30
Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 200 400 600 800 1000 SE +/- 5.31, N = 3 SE +/- 4.43, N = 3 829.51 827.99
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 30 60 90 120 150 SE +/- 0.87, N = 3 SE +/- 0.32, N = 3 155.82 152.57
Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 400 800 1200 1600 2000 SE +/- 16.26, N = 3 SE +/- 3.56, N = 3 1826.04 1866.52
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 200 400 600 800 1000 SE +/- 6.05, N = 3 SE +/- 8.06, N = 3 853.21 853.34
Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 300 600 900 1200 1500 SE +/- 14.85, N = 3 SE +/- 15.64, N = 3 1223.16 1223.65
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 40 80 120 160 200 SE +/- 1.16, N = 3 SE +/- 0.21, N = 3 176.57 173.95
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 400 800 1200 1600 2000 SE +/- 20.52, N = 3 SE +/- 16.06, N = 3 1866.23 1810.95
Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 30 60 90 120 150 SE +/- 0.24, N = 3 SE +/- 0.09, N = 3 133.21 133.28
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 100K 200K 300K 400K 500K SE +/- 39319.74, N = 3 SE +/- 2615.74, N = 15 SE +/- 14994.49, N = 7 455056 434200 428601 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
LeelaChessZero LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.30 Backend: BLAS Ubuntu Linux 23.10 4 8 12 16 20 SE +/- 1.18, N = 9 15 1. (CXX) g++ options: -flto -pthread
Backend: BLAS
CentOS Stream 9: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory
Fedora Server 39: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory
OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.30 Backend: Eigen Ubuntu Linux 23.10 80 160 240 320 400 SE +/- 4.52, N = 4 380 1. (CXX) g++ options: -flto -pthread
Backend: Eigen
CentOS Stream 9: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory
Fedora Server 39: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory
GROMACS The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 3 6 9 12 15 SE +/- 1.403, N = 7 SE +/- 0.323, N = 12 SE +/- 0.850, N = 12 9.630 5.939 7.180 1. (CXX) g++ options: -O3 -lm
NAMD NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 1.2166 2.4332 3.6498 4.8664 6.083 SE +/- 0.33618, N = 15 SE +/- 0.30866, N = 12 SE +/- 0.33952, N = 15 4.70711 3.20328 5.40706
OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 0.4342 0.8684 1.3026 1.7368 2.171 SE +/- 0.14829, N = 15 SE +/- 0.04889, N = 12 SE +/- 0.05361, N = 15 1.49004 0.50251 1.92977
RocksDB This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Random Read Ubuntu Linux 23.10 Fedora Server 39 140M 280M 420M 560M 700M SE +/- 7527805.83, N = 15 SE +/- 3865049.53, N = 3 599822046 652854125 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
Test: Random Read
CentOS Stream 9: The test quit with a non-zero exit status. E: rocksdb: line 4: ./db_bench: No such file or directory
OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Update Random Ubuntu Linux 23.10 Fedora Server 39 30K 60K 90K 120K 150K SE +/- 440.29, N = 3 SE +/- 1187.74, N = 3 125560 123092 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
Test: Update Random
CentOS Stream 9: The test quit with a non-zero exit status. E: rocksdb: line 4: ./db_bench: No such file or directory
OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Read While Writing Ubuntu Linux 23.10 Fedora Server 39 2M 4M 6M 8M 10M SE +/- 81611.31, N = 8 SE +/- 133209.05, N = 14 9775989 8567006 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
Test: Read While Writing
CentOS Stream 9: The test quit with a non-zero exit status. E: rocksdb: line 4: ./db_bench: No such file or directory
OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Read Random Write Random Ubuntu Linux 23.10 Fedora Server 39 300K 600K 900K 1200K 1500K SE +/- 5328.60, N = 3 SE +/- 13512.70, N = 15 955461 1184837 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
Test: Read Random Write Random
CentOS Stream 9: The test quit with a non-zero exit status. E: rocksdb: line 4: ./db_bench: No such file or directory
Speedb Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read Ubuntu Linux 23.10 Fedora Server 39 130M 260M 390M 520M 650M SE +/- 5282775.06, N = 8 SE +/- 8524314.28, N = 3 600703384 626261826 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
Test: Random Read
CentOS Stream 9: The test quit with a non-zero exit status. E: speedb: line 4: ./db_bench: No such file or directory
Memcached Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:10 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 1.1M 2.2M 3.3M 4.4M 5.5M SE +/- 36897.17, N = 5 SE +/- 43085.73, N = 13 SE +/- 65254.44, N = 3 3370014.38 3337339.10 5054518.76 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:100 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 2M 4M 6M 8M 10M SE +/- 20632.12, N = 3 SE +/- 20448.57, N = 10 SE +/- 380886.14, N = 12 3477137.28 2615816.73 8983240.52 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
ClickHouse ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 50 100 150 200 250 SE +/- 2.70, N = 3 SE +/- 0.84, N = 3 SE +/- 2.54, N = 3 205.20 183.62 188.71 MIN: 35.4 / MAX: 1818.18 MIN: 34.56 / MAX: 1714.29 MIN: 30.08 / MAX: 1428.57
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 50 100 150 200 250 SE +/- 1.67, N = 3 SE +/- 3.30, N = 3 SE +/- 1.90, N = 3 214.31 200.18 202.14 MIN: 36.39 / MAX: 1764.71 MIN: 37.41 / MAX: 2000 MIN: 36.41 / MAX: 1463.41
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 50 100 150 200 250 SE +/- 3.81, N = 3 SE +/- 2.16, N = 3 SE +/- 3.01, N = 3 215.62 201.05 206.83 MIN: 37.43 / MAX: 1714.29 MIN: 36.08 / MAX: 1500 MIN: 35.91 / MAX: 1935.48
Redis Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Requests Per Second, More Is Better Redis 7.0.4 Test: GET - Parallel Connections: 500 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 400K 800K 1200K 1600K 2000K SE +/- 15103.72, N = 15 SE +/- 19161.91, N = 15 SE +/- 30474.05, N = 15 1541713.80 1821521.39 1838671.43 1. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
OpenBenchmarking.org Requests Per Second, More Is Better Redis 7.0.4 Test: SET - Parallel Connections: 500 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 500K 1000K 1500K 2000K 2500K SE +/- 48178.71, N = 15 SE +/- 47416.25, N = 15 SE +/- 73166.31, N = 15 2134872.89 1978937.18 2125843.97 1. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
Graph500 This is a benchmark of the reference implementation of Graph500, an HPC benchmark focused on data intensive loads and commonly tested on supercomputers for complex data problems. Graph500 primarily stresses the communication subsystem of the hardware under test. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 140M 280M 420M 560M 700M 664991000 640794000 663412000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 110M 220M 330M 440M 550M 483534000 466398000 493031000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
PostgreSQL This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Ubuntu Linux 23.10 150K 300K 450K 600K 750K SE +/- 22056.84, N = 12 679317 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Scaling Factor: 100 - Clients: 1000 - Mode: Read Only
CentOS Stream 9: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory
Fedora Server 39: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory
OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Ubuntu Linux 23.10 8K 16K 24K 32K 40K SE +/- 1662.84, N = 9 39542 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Scaling Factor: 100 - Clients: 1000 - Mode: Read Write
CentOS Stream 9: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory
Fedora Server 39: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Ubuntu Linux 23.10 0.335 0.67 1.005 1.34 1.675 SE +/- 0.047, N = 12 1.489 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency
CentOS Stream 9: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory
Fedora Server 39: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Ubuntu Linux 23.10 6 12 18 24 30 SE +/- 0.97, N = 9 25.62 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency
CentOS Stream 9: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory
Fedora Server 39: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 0.81, N = 3 SE +/- 0.18, N = 3 85.06 97.34 93.74 -pie - MIN: 39.38 / MAX: 260.96 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.82 / MAX: 325.84 -pie - MIN: 34.75 / MAX: 283.24 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 50 100 150 200 250 SE +/- 2.84, N = 4 SE +/- 0.55, N = 3 SE +/- 2.84, N = 4 245.98 241.67 241.70 -pie - MIN: 176.44 / MAX: 390.61 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 160.04 / MAX: 556.9 -pie - MIN: 163.92 / MAX: 559.83 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 14.37 14.36 14.43 -pie - MIN: 12.05 / MAX: 72.49 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 12.55 / MAX: 76.83 -pie - MIN: 12.18 / MAX: 71.66 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 1.1813 2.3626 3.5439 4.7252 5.9065 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 5.20 5.25 5.25 -pie - MIN: 4.59 / MAX: 31.78 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 4.69 / MAX: 58.72 -pie - MIN: 4.62 / MAX: 31.26 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 12 24 36 48 60 SE +/- 0.36, N = 3 SE +/- 0.23, N = 3 SE +/- 0.10, N = 3 53.79 53.02 53.67 -pie - MIN: 44.62 / MAX: 198.12 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 42.98 / MAX: 178.63 -pie - MIN: 43.29 / MAX: 161.25 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 12 24 36 48 60 SE +/- 0.11, N = 3 SE +/- 1.14, N = 15 SE +/- 0.27, N = 9 27.93 52.09 32.67 -pie - MIN: 19.99 / MAX: 261.46 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 17.25 / MAX: 578.83 -pie - MIN: 19.33 / MAX: 484.58 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 0.6795 1.359 2.0385 2.718 3.3975 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 2.85 3.02 2.86 -pie - MIN: 2.08 / MAX: 32.04 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 2.07 / MAX: 29.73 -pie - MIN: 1.94 / MAX: 41.9 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 3 6 9 12 15 SE +/- 0.18, N = 3 SE +/- 0.14, N = 5 SE +/- 0.16, N = 4 12.74 12.65 12.69 -pie - MIN: 10.88 / MAX: 73.62 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 10.9 / MAX: 74.36 -pie - MIN: 10.9 / MAX: 75.69 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 39.76 40.02 39.30 -pie - MIN: 37.84 / MAX: 104.98 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.6 / MAX: 102.02 -pie - MIN: 33.26 / MAX: 101.52 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 0.1868 0.3736 0.5604 0.7472 0.934 SE +/- 0.00, N = 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 0.80 0.83 0.83 -pie - MIN: 0.2 / MAX: 28.24 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 0.21 / MAX: 20.36 -pie - MIN: 0.2 / MAX: 31.65 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OSPRay Studio Intel OSPRay Studio is an open-source, interactive visualization and ray-tracing software package. OSPRay Studio makes use of Intel OSPRay, a portable ray-tracing engine for high-performance, high-fidelity visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 200 400 600 800 1000 SE +/- 3.48, N = 3 SE +/- 9.82, N = 4 914 902
Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 200 400 600 800 1000 SE +/- 3.53, N = 3 SE +/- 2.03, N = 3 911 897
Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 200 400 600 800 1000 SE +/- 2.40, N = 3 SE +/- 2.96, N = 3 1079 1058
Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 3K 6K 9K 12K 15K SE +/- 3.51, N = 3 SE +/- 22.15, N = 3 12086 12187
Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 7K 14K 21K 28K 35K SE +/- 481.26, N = 15 SE +/- 1257.60, N = 15 32279 28035
Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 3K 6K 9K 12K 15K SE +/- 25.12, N = 3 SE +/- 36.03, N = 3 12243 12262
Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 7K 14K 21K 28K 35K SE +/- 600.94, N = 15 SE +/- 1255.46, N = 15 33174 27524
Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 3K 6K 9K 12K 15K SE +/- 177.62, N = 4 SE +/- 37.95, N = 3 14508 14422
Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 8K 16K 24K 32K 40K SE +/- 564.37, N = 15 SE +/- 119.27, N = 3 37285 34698
Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.88, N = 3 234 235
Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 233 233
Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 60 120 180 240 300 SE +/- 0.00, N = 3 SE +/- 1.45, N = 3 276 276
Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 800 1600 2400 3200 4000 SE +/- 3.21, N = 3 SE +/- 16.22, N = 3 3718 3683
Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 1400 2800 4200 5600 7000 SE +/- 77.79, N = 4 SE +/- 13.35, N = 3 6448 6314
Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 800 1600 2400 3200 4000 SE +/- 7.45, N = 3 SE +/- 43.59, N = 3 3694 3655
Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 1400 2800 4200 5600 7000 SE +/- 60.98, N = 6 SE +/- 28.01, N = 3 6324 6303
Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 900 1800 2700 3600 4500 SE +/- 47.59, N = 4 SE +/- 21.55, N = 3 4353 4377
Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 1600 3200 4800 6400 8000 SE +/- 31.90, N = 3 SE +/- 91.12, N = 4 7321 7424
Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU
CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)
Neural Magic DeepSparse This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 100 200 300 400 500 SE +/- 0.91, N = 3 SE +/- 0.62, N = 3 478.76 478.03
Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 4 8 12 16 20 SE +/- 0.13, N = 7 SE +/- 0.13, N = 7 14.06 14.32
Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 8 16 24 32 40 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 34.76 34.29
Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 1.3012 2.6024 3.9036 5.2048 6.506 SE +/- 0.0557, N = 7 SE +/- 0.0226, N = 3 5.7515 5.7833
Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 20 40 60 80 100 SE +/- 0.46, N = 3 SE +/- 0.41, N = 3 77.02 77.17
Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 90 180 270 360 450 SE +/- 2.51, N = 3 SE +/- 0.86, N = 3 409.01 416.68
Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 8 16 24 32 40 SE +/- 0.31, N = 3 SE +/- 0.07, N = 3 34.99 34.23
Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 20 40 60 80 100 SE +/- 0.50, N = 3 SE +/- 0.70, N = 3 74.88 74.80
Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 12 24 36 48 60 SE +/- 0.63, N = 3 SE +/- 0.70, N = 3 52.28 52.24
Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 80 160 240 320 400 SE +/- 2.37, N = 3 SE +/- 0.14, N = 3 361.29 366.38
Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 8 16 24 32 40 SE +/- 0.38, N = 3 SE +/- 0.32, N = 3 34.25 35.28
Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 100 200 300 400 500 SE +/- 0.78, N = 3 SE +/- 0.34, N = 3 477.14 476.58
Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream
Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory
CloverLeaf CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm16 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 70 140 210 280 350 SE +/- 3.60, N = 3 SE +/- 1.51, N = 3 SE +/- 1.01, N = 3 279.21 314.49 255.39 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm64_short Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 7 14 21 28 35 SE +/- 0.23, N = 11 SE +/- 0.12, N = 3 SE +/- 0.40, N = 3 32.10 25.01 31.63 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
NWChem NWChem is an open-source high performance computational chemistry package. Per NWChem's documentation, "NWChem aims to provide its users with computational chemistry tools that are scalable both in their ability to treat large scientific computational chemistry problems efficiently, and in their use of available parallel computing resources from high-performance parallel supercomputers to conventional workstation clusters." Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better NWChem 7.0.2 Input: C240 Buckyball Ubuntu Linux 23.10 400 800 1200 1600 2000 1750.3 1. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2
Input: C240 Buckyball
CentOS Stream 9: The test quit with a non-zero exit status. E: mpirun was unable to launch the specified application as it could not access
Fedora Server 39: The test run did not produce a result. E: /nwchem-7.0.2/bin/LINUX64/nwchem: error while loading shared libraries: libmpi_usempif08.so.40: cannot open shared object file: No such file or directory
Xcompact3d Incompact3d Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 40 80 120 160 200 SE +/- 0.44, N = 3 SE +/- 0.56, N = 3 SE +/- 0.67, N = 3 169.18 184.19 168.67 -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
easyWave The easyWave software allows simulating tsunami generation and propagation in the context of early warning systems. EasyWave supports making use of OpenMP for CPU multi-threading and there are also GPU ports available but not currently incorporated as part of this test profile. The easyWave tsunami generation software is run with one of the example/reference input files for measuring the CPU execution time. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 40 80 120 160 200 SE +/- 8.98, N = 12 SE +/- 10.40, N = 12 SE +/- 15.88, N = 12 177.75 205.01 156.24 1. (CXX) g++ options: -O3 -fopenmp
OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 5B Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 8 16 24 32 40 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 0.43, N = 3 29.82 32.85 33.73
RawTherapee RawTherapee is a cross-platform, open-source multi-threaded RAW image processing program. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better RawTherapee Total Benchmark Time Ubuntu Linux 23.10 Fedora Server 39 30 60 90 120 150 SE +/- 0.65, N = 3 SE +/- 0.45, N = 3 129.08 118.23 1. Ubuntu Linux 23.10: RawTherapee, version 5.9, command line. 2. Fedora Server 39: RawTherapee, version 5.10, command line.
Total Benchmark Time
CentOS Stream 9: The test run did not produce a result.
GPAW GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better GPAW 23.6 Input: Carbon Nanotube Ubuntu Linux 23.10 Fedora Server 39 40 80 120 160 200 SE +/- 0.35, N = 15 SE +/- 0.94, N = 3 38.64 194.51 -fwrapv -O2 -fno-strict-overflow -fcf-protection -fexceptions -fPIC -UNDEBUG -std=c99 1. (CC) gcc options: -shared -lxc -lblas -lmpi
Input: Carbon Nanotube
CentOS Stream 9: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'gpaw'
Ubuntu Linux 23.10 Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 23.10, Kernel: 6.5.0-17-generic (x86_64), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Python Notes: Python 3.11.6Security Notes: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 25 February 2024 15:32 by user phoronix.
CentOS Stream 9 Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: CentOS Stream 9, Kernel: 5.14.0-419.el9.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server, Compiler: GCC 11.4.1 20231218, File-System: xfs, Screen Resolution: 1920x1200
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Python Notes: Python 3.9.18Security Notes: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 26 February 2024 12:41 by user .
Fedora Server 39 Processor: 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads), Motherboard: Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS), Chipset: Intel Device 1bce, Memory: 1008GB, Disk: 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive, Graphics: ASPEED, Network: 2 x Intel X710 for 10GBASE-T
OS: Fedora Linux 39, Kernel: 6.7.6-200.fc39.x86_64 (x86_64), Compiler: GCC 13.2.1 20231205, File-System: xfs, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driverProcessor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Python Notes: Python 3.12.2Security Notes: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 2 March 2024 02:02 by user .