2 x Intel Xeon Platinum 8490H testing with a Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.
Linux 6.1.10 Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS), Chipset: Intel Device 1bce, Memory: 16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96, Graphics: ASPEED, Monitor: VGA HDMI, Network: 4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 22.04, Kernel: 6.1.10-060110-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3, Vulkan: 1.2.204, Compiler: GCC 11.3.0 + Clang 14.0.0-1ubuntu1, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0Python Notes: Python 3.10.6Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Linux 6.2 8 Feb OS: Ubuntu 22.04, Kernel: 6.2.0-060200rc7daily20230208-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3, Vulkan: 1.2.204, Compiler: GCC 11.3.0 + Clang 14.0.0-1ubuntu1, File-System: ext4, Screen Resolution: 1920x1080
Linux 6.2 Kernel Benchmarking Intel SPR OpenBenchmarking.org Phoronix Test Suite 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads) Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) Intel Device 1bce 16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96 ASPEED VGA HDMI 4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T Ubuntu 22.04 6.1.10-060110-generic (x86_64) 6.2.0-060200rc7daily20230208-generic (x86_64) GNOME Shell 42.2 X Server 1.21.1.3 1.2.204 GCC 11.3.0 + Clang 14.0.0-1ubuntu1 ext4 1920x1080 Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernels Desktop Display Server Vulkan Compiler File-System Screen Resolution Linux 6.2 Kernel Benchmarking Intel SPR Performance System Logs - Transparent Huge Pages: madvise - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0 - Python 3.10.6 - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Linux 6.1.10 vs. Linux 6.2 8 Feb Comparison Phoronix Test Suite Baseline +9.1% +9.1% +18.2% +18.2% +27.3% +27.3% +36.4% +36.4% 30.8% 13.8% 10.7% 4.8% 4.7% 3.3% CPU Stress 36.5% Mutex Socket Activity 20.4% 100 - 800 - Read Only - Average Latency 17.1% 100 - 800 - Read Only 15.2% 100 - 1000 - Read Only Context Switching 13.7% 100 - 1000 - Read Only - Average Latency ATPase Simulation - 327,506 Atoms 7.9% Atomic 7.3% Speed 6 Realtime - Bosphorus 4K 5.6% Bosphorus 1080p 1:5 MMAP Semaphores 2.7% NUMA 2.6% 100 - 1000 - Read Write - Average Latency 2.4% 100 - 1000 - Read Write 2.4% 100 - 800 - Read Write - Average Latency 2% 100 - 800 - Read Write 2% Stress-NG Stress-NG Stress-NG PostgreSQL PostgreSQL PostgreSQL Stress-NG PostgreSQL NAMD Stress-NG AOM AV1 x265 Memcached Stress-NG Stress-NG Stress-NG PostgreSQL PostgreSQL PostgreSQL PostgreSQL Linux 6.1.10 Linux 6.2 8 Feb
NAMD NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org days/ns, Fewer Is Better NAMD 2.14 ATPase Simulation - 327,506 Atoms Linux 6.2 8 Feb Linux 6.1.10 0.0594 0.1188 0.1782 0.2376 0.297 SE +/- 0.00152, N = 3 SE +/- 0.00256, N = 15 0.26420 0.24487
nekRS nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FLOP/s, More Is Better nekRS 22.0 Input: TurboPipe Periodic Linux 6.2 8 Feb Linux 6.1.10 110000M 220000M 330000M 440000M 550000M SE +/- 1225626778.43, N = 3 SE +/- 1046863091.97, N = 3 527807000000 526288000000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi
AOM AV1 This is a test of the AOMedia AV1 encoder (libaom) developed by AOMedia and Google as the AV1 Codec Library. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 16 32 48 64 80 SE +/- 0.83, N = 15 SE +/- 0.13, N = 3 66.86 70.60 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 14 28 42 56 70 SE +/- 0.60, N = 15 SE +/- 0.73, N = 15 61.56 62.61 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 15 30 45 60 75 SE +/- 0.82, N = 15 SE +/- 0.49, N = 3 69.64 68.67 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 16 32 48 64 80 SE +/- 0.62, N = 15 SE +/- 0.60, N = 8 69.83 70.48 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
SVT-AV1 This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.81, N = 12 SE +/- 0.67, N = 15 78.07 78.14
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 40 80 120 160 200 SE +/- 1.12, N = 3 SE +/- 2.37, N = 3 200.98 201.37
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 50 100 150 200 250 SE +/- 1.24, N = 3 SE +/- 1.54, N = 3 208.71 208.41
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Linux 6.2 8 Feb Linux 6.1.10 7 14 21 28 35 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 28.06 28.09
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Linux 6.2 8 Feb Linux 6.1.10 12 24 36 48 60 SE +/- 0.25, N = 3 SE +/- 0.28, N = 3 53.39 52.45
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Linux 6.2 8 Feb Linux 6.1.10 13 26 39 52 65 SE +/- 0.26, N = 3 SE +/- 0.63, N = 3 55.64 55.98
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Linux 6.2 8 Feb Linux 6.1.10 13 26 39 52 65 SE +/- 0.45, N = 3 SE +/- 0.64, N = 3 56.15 56.00
VVenC VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under The Clear BSD License. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast Linux 6.2 8 Feb Linux 6.1.10 1.0845 2.169 3.2535 4.338 5.4225 SE +/- 0.029, N = 3 SE +/- 0.046, N = 3 4.793 4.820 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster Linux 6.2 8 Feb Linux 6.1.10 3 6 9 12 15 SE +/- 0.039, N = 3 SE +/- 0.097, N = 3 9.131 9.120 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
x265 This is a simple test of the x265 encoder run on the CPU with 1080p and 4K options for H.265 video encode performance with x265. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better x265 3.4 Video Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 6 12 18 24 30 SE +/- 0.29, N = 3 SE +/- 0.14, N = 3 27.28 27.49 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OpenBenchmarking.org Frames Per Second, More Is Better x265 3.4 Video Input: Bosphorus 1080p Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.82, N = 15 SE +/- 0.82, N = 3 85.16 81.28 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
OSPRay Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/ao/real_time Linux 6.2 8 Feb Linux 6.1.10 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 34.67 34.72
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/pathtracer/real_time Linux 6.2 8 Feb Linux 6.1.10 40 80 120 160 200 SE +/- 0.67, N = 3 SE +/- 1.62, N = 3 176.61 177.67
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Linux 6.2 8 Feb Linux 6.1.10 8 16 24 32 40 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 36.48 36.45
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Linux 6.2 8 Feb Linux 6.1.10 120K 240K 360K 480K 600K SE +/- 318.16, N = 3 SE +/- 2141.74, N = 3 564497 564063 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
ClickHouse ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Linux 6.2 8 Feb Linux 6.1.10 100 200 300 400 500 SE +/- 3.02, N = 3 SE +/- 3.45, N = 3 443.69 452.20 MIN: 24.63 / MAX: 4615.38 MIN: 26.58 / MAX: 4615.38
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Linux 6.2 8 Feb Linux 6.1.10 110 220 330 440 550 SE +/- 2.84, N = 3 SE +/- 4.45, N = 3 492.61 486.73 MIN: 57.64 / MAX: 5454.55 MIN: 58.77 / MAX: 4615.38
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Linux 6.2 8 Feb Linux 6.1.10 110 220 330 440 550 SE +/- 1.26, N = 3 SE +/- 1.94, N = 3 511.41 505.85 MIN: 62.31 / MAX: 5454.55 MIN: 64.66 / MAX: 6000
Memcached Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:5 Linux 6.2 8 Feb Linux 6.1.10 300K 600K 900K 1200K 1500K SE +/- 71770.95, N = 12 SE +/- 27371.85, N = 12 1183430.44 1129986.80 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:10 Linux 6.2 8 Feb Linux 6.1.10 200K 400K 600K 800K 1000K SE +/- 34560.71, N = 15 SE +/- 38865.28, N = 12 918906.70 925855.29 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:100 Linux 6.2 8 Feb Linux 6.1.10 120K 240K 360K 480K 600K SE +/- 11341.32, N = 15 SE +/- 5530.48, N = 3 566029.60 556683.75 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
GROMACS The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare Linux 6.2 8 Feb Linux 6.1.10 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 14.80 14.72 1. (CXX) g++ options: -O3
PostgreSQL This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only Linux 6.2 8 Feb Linux 6.1.10 200K 400K 600K 800K 1000K SE +/- 48886.22, N = 12 SE +/- 40184.05, N = 12 859012 989367 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency Linux 6.2 8 Feb Linux 6.1.10 0.2171 0.4342 0.6513 0.8684 1.0855 SE +/- 0.055, N = 12 SE +/- 0.034, N = 12 0.965 0.824 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Linux 6.2 8 Feb Linux 6.1.10 200K 400K 600K 800K 1000K SE +/- 46919.14, N = 12 SE +/- 6076.06, N = 3 878515 771740 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Linux 6.2 8 Feb Linux 6.1.10 0.2916 0.5832 0.8748 1.1664 1.458 SE +/- 0.056, N = 12 SE +/- 0.010, N = 3 1.171 1.296 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Scaling Factor: 100 - Clients: 5000 - Mode: Read Only
Linux 6.1.10: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024
Linux 6.2 8 Feb: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write Linux 6.2 8 Feb Linux 6.1.10 15K 30K 45K 60K 75K SE +/- 74.72, N = 3 SE +/- 156.03, N = 3 70837 72276 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency Linux 6.2 8 Feb Linux 6.1.10 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 11.29 11.07 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Linux 6.2 8 Feb Linux 6.1.10 14K 28K 42K 56K 70K SE +/- 139.09, N = 3 SE +/- 232.63, N = 3 65191 66739 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Linux 6.2 8 Feb Linux 6.1.10 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 15.34 14.98 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Scaling Factor: 100 - Clients: 5000 - Mode: Read Write
Linux 6.1.10: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024
Linux 6.2 8 Feb: The test run did not produce a result. E: pgbench: error: need at least 5003 open files, but system limit is 1024
Neural Magic DeepSparse This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.27, N = 3 SE +/- 0.29, N = 3 91.96 91.96
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 140 280 420 560 700 SE +/- 1.07, N = 3 SE +/- 1.70, N = 3 649.57 648.77
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 300 600 900 1200 1500 SE +/- 5.52, N = 3 SE +/- 2.07, N = 3 1200.41 1204.63
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 11 22 33 44 55 SE +/- 0.22, N = 3 SE +/- 0.08, N = 3 49.91 49.75
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 80 160 240 320 400 SE +/- 1.10, N = 3 SE +/- 3.07, N = 3 360.59 358.57
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 40 80 120 160 200 SE +/- 0.42, N = 3 SE +/- 1.35, N = 3 166.21 166.97
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 300 600 900 1200 1500 SE +/- 1.24, N = 3 SE +/- 1.95, N = 3 1485.99 1483.33
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 200 400 600 800 1000 SE +/- 3.10, N = 3 SE +/- 1.04, N = 3 877.96 875.21
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 30 60 90 120 150 SE +/- 0.30, N = 3 SE +/- 0.27, N = 3 143.80 143.59
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 90 180 270 360 450 SE +/- 1.02, N = 3 SE +/- 0.86, N = 3 415.51 416.54
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 90 180 270 360 450 SE +/- 0.09, N = 3 SE +/- 0.45, N = 3 423.38 424.46
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 30 60 90 120 150 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 141.48 141.20
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 92.32 91.77
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 140 280 420 560 700 SE +/- 1.20, N = 3 SE +/- 0.26, N = 3 648.15 649.01
Stress-NG Stress-NG is a Linux stress tool developed by Colin King of Canonical. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MMAP Linux 6.2 8 Feb Linux 6.1.10 1000 2000 3000 4000 5000 SE +/- 12.46, N = 3 SE +/- 12.03, N = 3 4594.34 4446.69 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: NUMA Linux 6.2 8 Feb Linux 6.1.10 200 400 600 800 1000 SE +/- 0.65, N = 3 SE +/- 1.67, N = 3 802.96 823.73 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Futex Linux 6.2 8 Feb Linux 6.1.10 20K 40K 60K 80K 100K SE +/- 2751.08, N = 12 SE +/- 3894.69, N = 12 86702.87 85353.10 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MEMFD Linux 6.2 8 Feb Linux 6.1.10 700 1400 2100 2800 3500 SE +/- 2.20, N = 3 SE +/- 4.75, N = 3 3124.14 3069.37 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Mutex Linux 6.2 8 Feb Linux 6.1.10 300K 600K 900K 1200K 1500K SE +/- 190782.11, N = 15 SE +/- 3233.27, N = 3 1201873.84 918817.43 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Atomic Linux 6.2 8 Feb Linux 6.1.10 5K 10K 15K 20K 25K SE +/- 327.04, N = 3 SE +/- 1573.75, N = 12 22779.25 24444.51 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Crypto Linux 6.2 8 Feb Linux 6.1.10 30K 60K 90K 120K 150K SE +/- 56.34, N = 3 SE +/- 101.77, N = 3 156524.58 156594.14 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Malloc Linux 6.2 8 Feb Linux 6.1.10 60M 120M 180M 240M 300M SE +/- 602446.22, N = 3 SE +/- 244537.72, N = 3 299262596.45 295983025.53 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Forking Linux 6.2 8 Feb Linux 6.1.10 12K 24K 36K 48K 60K SE +/- 499.08, N = 3 SE +/- 802.76, N = 3 55255.59 56227.91 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: IO_uring Linux 6.2 8 Feb Linux 6.1.10 10K 20K 30K 40K 50K SE +/- 59.90, N = 3 SE +/- 107.10, N = 3 47925.54 47408.70 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: SENDFILE Linux 6.2 8 Feb Linux 6.1.10 400K 800K 1200K 1600K 2000K SE +/- 3872.08, N = 3 SE +/- 6709.63, N = 3 2014102.18 2013997.03 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: CPU Cache Linux 6.2 8 Feb Linux 6.1.10 4 8 12 16 20 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 15.90 15.90 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: CPU Stress Linux 6.2 8 Feb Linux 6.1.10 40K 80K 120K 160K 200K SE +/- 443.88, N = 3 SE +/- 19184.46, N = 15 127960.65 174656.38 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Semaphores Linux 6.2 8 Feb Linux 6.1.10 2M 4M 6M 8M 10M SE +/- 19775.62, N = 3 SE +/- 9813.90, N = 3 8411372.27 8636757.37 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Matrix Math Linux 6.2 8 Feb Linux 6.1.10 130K 260K 390K 520K 650K SE +/- 326.52, N = 3 SE +/- 956.79, N = 3 587129.80 587722.85 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Vector Math Linux 6.2 8 Feb Linux 6.1.10 130K 260K 390K 520K 650K SE +/- 392.81, N = 3 SE +/- 229.10, N = 3 591711.95 591428.07 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: x86_64 RdRand Linux 6.2 8 Feb Linux 6.1.10 140K 280K 420K 560K 700K SE +/- 50.78, N = 3 SE +/- 14.30, N = 3 669071.60 668883.47 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Memory Copying Linux 6.2 8 Feb Linux 6.1.10 2K 4K 6K 8K 10K SE +/- 30.89, N = 3 SE +/- 44.38, N = 3 11382.46 11600.05 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Socket Activity Linux 6.2 8 Feb Linux 6.1.10 16K 32K 48K 64K 80K SE +/- 304.61, N = 3 SE +/- 9156.51, N = 15 63762.09 76754.34 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Context Switching Linux 6.2 8 Feb Linux 6.1.10 600K 1200K 1800K 2400K 3000K SE +/- 4157.76, N = 3 SE +/- 398.70, N = 3 2396641.33 2724155.67 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc C String Functions Linux 6.1.10 4M 8M 12M 16M 20M SE +/- 113403.85, N = 3 16667098.52 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc Qsort Data Sorting Linux 6.1.10 400 800 1200 1600 2000 SE +/- 1.57, N = 3 1733.71 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: System V Message Passing Linux 6.1.10 4M 8M 12M 16M 20M SE +/- 135205.89, N = 3 19548475.12 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Blender Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only Linux 6.1.10 4 8 12 16 20 SE +/- 0.18, N = 3 14.07
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU Linux 6.1.10 30 60 90 120 150 SE +/- 1.60, N = 3 128.73 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU Linux 6.1.10 100 200 300 400 500 SE +/- 5.81, N = 3 465.02 MIN: 174.45 / MAX: 1220.77 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU Linux 6.1.10 9 18 27 36 45 SE +/- 0.19, N = 3 39.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU Linux 6.1.10 300 600 900 1200 1500 SE +/- 7.49, N = 3 1521.31 MIN: 764.65 / MAX: 3475.74 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU Linux 6.1.10 9 18 27 36 45 SE +/- 0.13, N = 3 39.34 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU Linux 6.1.10 300 600 900 1200 1500 SE +/- 4.98, N = 3 1513.58 MIN: 827.53 / MAX: 3243.59 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU Linux 6.1.10 400 800 1200 1600 2000 SE +/- 10.79, N = 3 1774.66 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU Linux 6.1.10 8 16 24 32 40 SE +/- 0.21, N = 3 33.79 MIN: 10.56 / MAX: 128.62 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU Linux 6.1.10 60 120 180 240 300 SE +/- 1.41, N = 3 287.42 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU Linux 6.1.10 90 180 270 360 450 SE +/- 2.00, N = 3 416.63 MIN: 162.2 / MAX: 599.62 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU Linux 6.1.10 1300 2600 3900 5200 6500 SE +/- 2.67, N = 3 6073.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU Linux 6.1.10 5 10 15 20 25 SE +/- 0.01, N = 3 19.73 MIN: 8.72 / MAX: 152.2 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU Linux 6.1.10 3K 6K 9K 12K 15K SE +/- 116.05, N = 3 15301.88 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU Linux 6.1.10 2 4 6 8 10 SE +/- 0.06, N = 3 7.82 MIN: 2.22 / MAX: 100.14 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU Linux 6.1.10 160 320 480 640 800 SE +/- 7.46, N = 3 735.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU Linux 6.1.10 20 40 60 80 100 SE +/- 0.81, N = 3 81.55 MIN: 31.38 / MAX: 2204.77 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Linux 6.1.10 5K 10K 15K 20K 25K SE +/- 141.00, N = 3 23212.12 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Linux 6.1.10 1.1588 2.3176 3.4764 4.6352 5.794 SE +/- 0.03, N = 3 5.15 MIN: 1.43 / MAX: 102.95 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU Linux 6.1.10 1000 2000 3000 4000 5000 SE +/- 10.52, N = 3 4833.68 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU Linux 6.1.10 6 12 18 24 30 SE +/- 0.05, N = 3 24.81 MIN: 12.19 / MAX: 126.11 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Linux 6.1.10 20K 40K 60K 80K 100K SE +/- 287.95, N = 3 106848.95 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Linux 6.1.10 0.2363 0.4726 0.7089 0.9452 1.1815 SE +/- 0.00, N = 3 1.05 MIN: 0.28 / MAX: 92.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Linux 6.1.10 14K 28K 42K 56K 70K SE +/- 362.34, N = 3 64547.57 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Linux 6.1.10 0.414 0.828 1.242 1.656 2.07 SE +/- 0.01, N = 3 1.84 MIN: 0.56 / MAX: 105.91 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read Linux 6.1.10 120M 240M 360M 480M 600M SE +/- 1279720.50, N = 3 579300652 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Update Random Linux 6.1.10 100K 200K 300K 400K 500K SE +/- 304.35, N = 3 488635 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Sequential Fill Linux 6.1.10 110K 220K 330K 440K 550K SE +/- 107.17, N = 3 498671 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill Sync Linux 6.1.10 100K 200K 300K 400K 500K SE +/- 689.81, N = 3 448145 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read While Writing Linux 6.1.10 2M 4M 6M 8M 10M SE +/- 219959.46, N = 15 9981816 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read Random Write Random Linux 6.1.10 400K 800K 1200K 1600K 2000K SE +/- 14631.68, N = 3 2079783 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
BRL-CAD BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.34 VGR Performance Metric Linux 6.1.10 900K 1800K 2700K 3600K 4500K 4132367 1. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6
GROMACS The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare Linux 6.1.10 4 8 12 16 20 SE +/- 0.05, N = 3 14.56 1. (CXX) g++ options: -O3
OpenFOAM OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.
Input: drivaerFastback, Medium Mesh Size
Linux 6.1.10: The test quit with a non-zero exit status. E: [0] --> FOAM FATAL ERROR:
Input: drivaerFastback, Large Mesh Size
Linux 6.1.10: The test quit with a non-zero exit status. E: [0] --> FOAM FATAL ERROR:
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Crown Linux 6.1.10 20 40 60 80 100 SE +/- 0.04, N = 3 110.74 MIN: 99.51 / MAX: 128.5
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Crown Linux 6.1.10 30 60 90 120 150 SE +/- 0.67, N = 3 126.83 MIN: 114.94 / MAX: 144.11
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon Linux 6.1.10 30 60 90 120 150 SE +/- 0.08, N = 3 129.92 MIN: 122.68 / MAX: 142.47
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon Obj Linux 6.1.10 30 60 90 120 150 SE +/- 0.04, N = 3 117.33 MIN: 111.28 / MAX: 131.46
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon Linux 6.1.10 30 60 90 120 150 SE +/- 0.15, N = 3 158.29 MIN: 148.72 / MAX: 175.63
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Linux 6.1.10 30 60 90 120 150 SE +/- 0.24, N = 3 137.35 MIN: 129.6 / MAX: 154.23
Linux 6.1.10 Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS), Chipset: Intel Device 1bce, Memory: 16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96, Graphics: ASPEED, Monitor: VGA HDMI, Network: 4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 22.04, Kernel: 6.1.10-060110-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3, Vulkan: 1.2.204, Compiler: GCC 11.3.0 + Clang 14.0.0-1ubuntu1, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0Python Notes: Python 3.10.6Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 8 February 2023 06:29 by user root.
Linux 6.2 8 Feb Processor: 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads), Motherboard: Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS), Chipset: Intel Device 1bce, Memory: 16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96, Graphics: ASPEED, Monitor: VGA HDMI, Network: 4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T
OS: Ubuntu 22.04, Kernel: 6.2.0-060200rc7daily20230208-generic (x86_64), Desktop: GNOME Shell 42.2, Display Server: X Server 1.21.1.3, Vulkan: 1.2.204, Compiler: GCC 11.3.0 + Clang 14.0.0-1ubuntu1, File-System: ext4, Screen Resolution: 1920x1080
Kernel Notes: Transparent Huge Pages: madviseCompiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -vProcessor Notes: Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0Python Notes: Python 3.10.6Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 8 February 2023 15:16 by user root.