AMD EPYC 9334 32-Core testing with a Supermicro H13SSW (1.1 BIOS) and astdrmfb on AlmaLinux 9.2 via the Phoronix Test Suite.
a Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113eJava Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
b c Processor: 2 x AMD EPYC 9254 24-Core @ 2.90GHz (48 Cores / 96 Threads), Motherboard: Supermicro H13DSH (1.5 BIOS), Memory: 24 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET, Disk: 2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07, Graphics: astdrmfb
OS: AlmaLinux 9.2, Kernel: 5.14.0-284.25.1.el9_2.x86_64 (x86_64), Compiler: GCC 11.3.1 20221121, File-System: ext4, Screen Resolution: 1024x768
d Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
e f g Changed Processor to AMD EPYC 9124 16-Core @ 3.00GHz (16 Cores / 32 Threads) .
Changed Motherboard to Supermicro H13SSW (1.1 BIOS) .
Changed Memory to 12 x 64 GB DDR5-4800MT/s HMCG94MEBRA123N .
h i j Processor: AMD EPYC 9334 32-Core @ 2.70GHz (32 Cores / 64 Threads)Motherboard: Supermicro H13SSW (1.1 BIOS), Memory: 12 x 64 GB DDR5-4800MT/s HMCG94MEBRA123N, Disk: 2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07, Graphics: astdrmfb, Monitor: DELL E207WFP
OS: AlmaLinux 9.2, Kernel: 5.14.0-284.25.1.el9_2.x86_64 (x86_64), Compiler: GCC 11.3.1 20221121, File-System: ext4, Screen Resolution: 1680x1050
OpenRadioss OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.
Model: Bumper Beam
a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
Model: Chrysler Neon 1M
a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
Model: Cell Phone Drop Test
a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
Model: Bird Strike on Windshield
a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
Model: Rubber O-Ring Seal Installation
a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
Model: INIVOL and Fluid Structure Interaction Drop Container
a: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
b: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
c: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
d: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
e: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
f: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
g: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
h: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
i: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
j: The test run did not produce a result. E: ./engine_linux64_gf_ompi: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory
Remhos Remhos (REMap High-Order Solver) is a miniapp that solves the pure advection equations that are used to perform monotonic and conservative discontinuous field interpolation (remap) as part of the Eulerian phase in Arbitrary Lagrangian Eulerian (ALE) simulations. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better Remhos 1.0 Test: Sample Remap Example e d g f h j i b a c 7 14 21 28 35 30.85 30.76 30.75 30.73 20.44 20.36 20.30 16.79 16.35 16.24 1. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi
SPECFEM3D simulates acoustic (fluid), elastic (solid), coupled acoustic/elastic, poroelastic or seismic wave propagation in any type of conforming mesh of hexahedra. This test profile currently relies on CPU-based execution for SPECFEM3D and using a variety of their built-in examples/models for benchmarking. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Mount St. Helens g f e d i j h c b a 7 14 21 28 35 27.70 26.87 26.80 26.74 15.19 15.10 15.03 11.33 11.32 11.02 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Layered Halfspace d f e g h j i b c a 16 32 48 64 80 71.61 70.54 70.19 69.96 40.33 39.87 39.83 28.65 27.49 26.89 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Tomographic Model g e d f h j i a b c 7 14 21 28 35 27.75 27.46 27.33 26.97 15.99 15.84 15.59 12.31 12.10 12.04 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Homogeneous Halfspace d f g e h j i a c b 8 16 24 32 40 35.57 35.54 35.38 35.03 19.96 19.73 19.62 15.11 14.81 14.46 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Water-layered Halfspace g d e f j i h b c a 14 28 42 56 70 62.81 62.44 62.33 61.28 37.81 37.51 36.45 29.46 27.06 26.99 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
nekRS nekRS is an open-source Navier Stokes solver based on the spectral element method. NekRS supports both CPU and GPU/accelerator support though this test profile is currently configured for CPU execution. NekRS is part of Nek5000 of the Mathematics and Computer Science MCS at Argonne National Laboratory. This nekRS benchmark is primarily relevant to large core count HPC servers and otherwise may be very time consuming on smaller systems. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org flops/rank, More Is Better nekRS 23.0 Input: Kershaw h j i f e d g c a b 2000M 4000M 6000M 8000M 10000M 9145900000 9242080000 9269890000 9976450000 10264000000 10318900000 10500600000 10826700000 11106900000 11240300000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi
OpenBenchmarking.org flops/rank, More Is Better nekRS 23.0 Input: TurboPipe Periodic c b h a i j e d f g 2000M 4000M 6000M 8000M 10000M 6754170000 6757360000 6761270000 6767710000 6768070000 6835360000 7931010000 7934570000 7955790000 7964910000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer - Model: Crown e d g f h i j a b c 12 24 36 48 60 21.44 21.48 21.58 21.59 42.89 43.27 43.31 54.90 55.39 55.40 MIN: 21.3 / MAX: 21.78 MIN: 21.32 / MAX: 21.8 MIN: 21.43 / MAX: 21.89 MIN: 21.45 / MAX: 21.84 MIN: 42.47 / MAX: 43.88 MIN: 42.82 / MAX: 44.23 MIN: 42.83 / MAX: 44.44 MIN: 53.27 / MAX: 57.28 MIN: 54.02 / MAX: 57.64 MIN: 53.71 / MAX: 58.99
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer ISPC - Model: Crown e d f g j i h a b c 13 26 39 52 65 22.57 22.59 22.66 22.77 45.32 45.40 45.48 56.09 56.46 56.81 MIN: 22.39 / MAX: 22.93 MIN: 22.39 / MAX: 22.98 MIN: 22.45 / MAX: 22.99 MIN: 22.57 / MAX: 23.16 MIN: 44.74 / MAX: 46.66 MIN: 44.87 / MAX: 46.45 MIN: 44.92 / MAX: 46.64 MIN: 54.05 / MAX: 59.82 MIN: 54.53 / MAX: 59.89 MIN: 55.27 / MAX: 59.91
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer - Model: Asian Dragon d f e g j h i c b a 13 26 39 52 65 24.69 24.70 24.73 24.82 48.10 48.12 48.19 59.79 59.91 60.14 MIN: 24.62 / MAX: 24.84 MIN: 24.63 / MAX: 24.84 MIN: 24.67 / MAX: 24.86 MIN: 24.74 / MAX: 25 MIN: 47.86 / MAX: 48.8 MIN: 47.91 / MAX: 48.91 MIN: 47.96 / MAX: 48.63 MIN: 58.46 / MAX: 62.03 MIN: 58.66 / MAX: 61.96 MIN: 58.97 / MAX: 62
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer - Model: Asian Dragon Obj f e g d j h i a c b 12 24 36 48 60 22.15 22.16 22.19 22.26 43.42 43.51 43.57 53.57 53.69 53.81 MIN: 22.07 / MAX: 22.32 MIN: 22.08 / MAX: 22.35 MIN: 22.12 / MAX: 22.33 MIN: 22.18 / MAX: 22.42 MIN: 43.14 / MAX: 43.89 MIN: 43.26 / MAX: 44.02 MIN: 43.34 / MAX: 44.03 MIN: 52.17 / MAX: 55.38 MIN: 52.63 / MAX: 55.24 MIN: 52.72 / MAX: 55.86
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer ISPC - Model: Asian Dragon e f d g h i j b a c 15 30 45 60 75 28.31 28.32 28.36 28.48 54.39 54.51 54.52 67.20 67.34 67.50 MIN: 28.21 / MAX: 28.56 MIN: 28.23 / MAX: 28.55 MIN: 28.26 / MAX: 28.59 MIN: 28.37 / MAX: 28.69 MIN: 54.12 / MAX: 55.15 MIN: 54.22 / MAX: 55.08 MIN: 54.24 / MAX: 55.1 MIN: 65.48 / MAX: 70.41 MIN: 65.61 / MAX: 70.54 MIN: 65.64 / MAX: 71.17
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer ISPC - Model: Asian Dragon Obj d g f e i h j a b c 13 26 39 52 65 23.87 23.88 23.94 23.94 46.36 46.38 46.43 56.49 56.69 56.93 MIN: 23.78 / MAX: 24.08 MIN: 23.79 / MAX: 24.08 MIN: 23.84 / MAX: 24.16 MIN: 23.84 / MAX: 24.18 MIN: 46.13 / MAX: 46.98 MIN: 46.09 / MAX: 47.08 MIN: 46.17 / MAX: 47.23 MIN: 55.29 / MAX: 58.38 MIN: 55.42 / MAX: 58.97 MIN: 55.56 / MAX: 59.67
SVT-AV1 OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 4 - Input: Bosphorus 4K d e f g c h i b j a 1.1707 2.3414 3.5121 4.6828 5.8535 4.107 4.114 4.138 4.143 5.049 5.075 5.079 5.149 5.160 5.203 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 8 - Input: Bosphorus 4K d f e g c a b i h j 20 40 60 80 100 66.99 67.39 67.72 67.81 90.42 90.81 91.32 98.57 99.10 99.35 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 12 - Input: Bosphorus 4K g f e c d a b j i h 50 100 150 200 250 160.32 161.85 162.61 163.06 163.19 163.46 166.38 224.41 227.87 230.03 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 13 - Input: Bosphorus 4K f g c d e a b h i j 50 100 150 200 250 160.80 161.32 161.50 161.85 162.05 163.01 166.69 223.42 227.21 228.77 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 4 - Input: Bosphorus 1080p f d e g j h i a b c 3 6 9 12 15 10.74 10.91 10.98 11.02 12.18 12.23 12.26 12.48 12.59 12.62 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 8 - Input: Bosphorus 1080p g f d e b a c i j h 30 60 90 120 150 118.48 118.49 118.95 119.31 138.34 141.22 143.55 149.05 149.45 151.44 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 12 - Input: Bosphorus 1080p a b c f e d g h j i 130 260 390 520 650 422.99 427.69 431.90 521.52 525.17 526.22 528.53 580.16 584.12 591.32 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 13 - Input: Bosphorus 1080p a c b f g e d j h i 160 320 480 640 800 510.36 516.91 542.61 585.37 586.75 597.01 604.99 726.50 726.89 728.54 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OSPRay Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: particle_volume/ao/real_time e f d g j i h b a c 4 8 12 16 20 5.54107 5.57320 5.57469 5.57553 10.69320 10.74300 10.79880 15.97850 15.98600 15.98720
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: particle_volume/scivis/real_time f e g d j h i a c b 4 8 12 16 20 5.55581 5.56353 5.56539 5.57001 10.76640 10.78320 10.79040 15.95280 15.97780 15.98880
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: particle_volume/pathtracer/real_time e g f d i h j b c a 50 100 150 200 250 151.51 151.68 151.78 151.91 192.40 192.65 192.70 214.07 214.14 215.10
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/ao/real_time d f e g h j i c b a 4 8 12 16 20 5.60747 5.61454 5.62040 5.62278 10.85240 10.87430 10.88290 14.13990 14.17830 14.23690
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time f d e g j i h b c a 4 8 12 16 20 5.45227 5.45329 5.46153 5.47725 10.57400 10.58480 10.59130 13.76660 13.83170 13.87390
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time e d f g i j h a b c 4 8 12 16 20 6.58270 6.58745 6.59563 6.60085 12.49870 12.51040 12.54380 16.34680 16.43650 16.53500
Build: allmodconfig
a: The test quit with a non-zero exit status.
b: The test quit with a non-zero exit status.
c: The test quit with a non-zero exit status.
d: The test quit with a non-zero exit status.
e: The test quit with a non-zero exit status.
f: The test quit with a non-zero exit status.
g: The test quit with a non-zero exit status.
h: The test quit with a non-zero exit status.
i: The test quit with a non-zero exit status.
j: The test quit with a non-zero exit status.
Liquid-DSP LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 32 d g f e j i h c b a 8M 16M 24M 32M 40M 35228000 35236000 35271000 35315000 37120000 37141000 37145000 39453000 39486000 39499000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 57 h d e g f j i c b a 13M 26M 39M 52M 65M 51443000 52665000 52827000 52854000 52879000 55715000 55841000 57519000 59296000 59401000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 2 - Buffer Length: 256 - Filter Length: 32 d g e f j h i c b a 17M 34M 51M 68M 85M 67054000 68678000 68846000 68861000 72400000 72468000 72491000 76924000 77019000 77181000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 2 - Buffer Length: 256 - Filter Length: 57 g h e d f i j b a c 30M 60M 90M 120M 150M 104800000 105280000 105480000 105650000 105740000 109700000 111370000 114010000 117490000 118550000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 4 - Buffer Length: 256 - Filter Length: 32 g f d e j h i c b a 30M 60M 90M 120M 150M 138460000 138580000 138600000 138620000 145740000 145820000 145920000 153670000 153690000 153850000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 4 - Buffer Length: 256 - Filter Length: 57 d f g e c a b i j h 40M 80M 120M 160M 200M 188930000 189880000 190750000 191230000 194510000 196220000 196590000 198640000 200120000 200930000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 8 - Buffer Length: 256 - Filter Length: 32 f g e d i j h b c a 70M 140M 210M 280M 350M 276390000 277410000 277780000 278030000 292430000 292490000 292620000 305110000 306760000 307540000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 8 - Buffer Length: 256 - Filter Length: 57 f g e d b c a i h j 80M 160M 240M 320M 400M 350450000 357810000 357990000 363310000 366930000 366990000 369430000 377250000 378330000 381660000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 512 g e f d j h i a b c 3M 6M 9M 12M 15M 12256000 12366000 12681000 12683000 12899000 12909000 13363000 13909000 14021000 14225000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 16 - Buffer Length: 256 - Filter Length: 32 g f e d i j h a b c 130M 260M 390M 520M 650M 543050000 545020000 545140000 545360000 583870000 585670000 585850000 594230000 602470000 603650000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 16 - Buffer Length: 256 - Filter Length: 57 c g d b e f a i j h 160M 320M 480M 640M 800M 674930000 682070000 689150000 692760000 692920000 693340000 699740000 735800000 737120000 741420000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 2 - Buffer Length: 256 - Filter Length: 512 g d f e h i j b a c 6M 12M 18M 24M 30M 22727000 24627000 25199000 25207000 25648000 25910000 26378000 27736000 27901000 28227000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 32 - Buffer Length: 256 - Filter Length: 32 f e d g j h i a c b 300M 600M 900M 1200M 1500M 1041900000 1046600000 1047100000 1047100000 1169900000 1172400000 1172900000 1183500000 1184800000 1190300000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 32 - Buffer Length: 256 - Filter Length: 57 f e g d a b c h j i 300M 600M 900M 1200M 1500M 1024600000 1032000000 1033400000 1035000000 1192100000 1214200000 1254800000 1352900000 1369800000 1394100000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 4 - Buffer Length: 256 - Filter Length: 512 g j f d e i h a c b 12M 24M 36M 48M 60M 49556000 49781000 49977000 50258000 50380000 52129000 52890000 52911000 55165000 55588000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 32 g f e d i j h c a b 500M 1000M 1500M 2000M 2500M 1056200000 1057100000 1057500000 1059500000 2052600000 2056500000 2057500000 2206800000 2207700000 2212100000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 57 d f e g i h j a b c 400M 800M 1200M 1600M 2000M 1093300000 1094600000 1095400000 1099300000 1899700000 1916800000 1922300000 1994400000 2001900000 2010300000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 8 - Buffer Length: 256 - Filter Length: 512 e f d g j h i b c a 20M 40M 60M 80M 100M 97005000 99441000 99594000 100170000 104220000 104440000 104780000 108080000 109140000 109870000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 96 - Buffer Length: 256 - Filter Length: 32 e d f g h i j b c a 600M 1200M 1800M 2400M 3000M 1065100000 1065200000 1065300000 1065700000 2068300000 2069900000 2071000000 2995400000 2999800000 3005800000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 96 - Buffer Length: 256 - Filter Length: 57 e g f d h i j a c b 600M 1200M 1800M 2400M 3000M 1117800000 1118200000 1120500000 1120800000 1995500000 1997000000 1999500000 2559800000 2564900000 2571100000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 16 - Buffer Length: 256 - Filter Length: 512 d f g e h j i c a b 50M 100M 150M 200M 250M 193850000 194500000 194670000 196040000 207590000 209490000 209720000 214910000 216080000 216150000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 32 - Buffer Length: 256 - Filter Length: 512 f e d g h i j c a b 90M 180M 270M 360M 450M 273390000 273480000 273760000 274070000 391680000 393200000 393270000 424400000 425810000 429620000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 512 g e d f j h i b a c 130M 260M 390M 520M 650M 281730000 281830000 282920000 283030000 511070000 512020000 512310000 610950000 622560000 622630000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 96 - Buffer Length: 256 - Filter Length: 512 e f d g j h i a c b 150M 300M 450M 600M 750M 285880000 285920000 286250000 286530000 519440000 519700000 520140000 711640000 715030000 718140000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
TiDB Community Server This is a PingCAP TiDB Community Server benchmark facilitated using the sysbench OLTP database benchmarks. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_read_write - Threads: 1 c b a g e f j h i 700 1400 2100 2800 3500 2485 2510 2540 3195 3209 3218 3479 3480 3485 Test: oltp_read_write - Threads: 1
d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_read_write - Threads: 64 e f g d c a b i h 20K 40K 60K 80K 100K 53893 54956 55301 55334 78469 79090 80183 94261 95579 Test: oltp_read_write - Threads: 64
j: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 1 a b c d f e h i 1300 2600 3900 5200 6500 4331 4405 4471 5898 5954 5976 6125 6165 Test: oltp_point_select - Threads: 1
g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
j: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_read_write - Threads: 128 d g e f a b h i j 20K 40K 60K 80K 100K 59727 59944 60145 60310 85757 89099 104180 104620 105802 Test: oltp_read_write - Threads: 128
c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_index - Threads: 1 c a d g f e i j h 400 800 1200 1600 2000 1189 1212 1479 1481 1483 1490 1656 1660 1666 Test: oltp_update_index - Threads: 1
b: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 16 c b g f e i h j 20K 40K 60K 80K 100K 65406 67515 69923 70105 70250 86471 87218 87412 Test: oltp_point_select - Threads: 16
a: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 32 g e f d a b j i h 30K 60K 90K 120K 150K 96840 96907 97368 98149 104627 106180 137618 138173 138538 Test: oltp_point_select - Threads: 32
c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 64 d g e f a b i j 40K 80K 120K 160K 200K 115675 118549 118657 119092 127567 130802 180179 180581 Test: oltp_point_select - Threads: 64
c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
h: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_index - Threads: 16 a e d g c f i h j 4K 8K 12K 16K 20K 12558 12567 12622 12627 12681 12692 16817 16965 16972 Test: oltp_update_index - Threads: 16
b: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_index - Threads: 32 e g c d b a i h j 5K 10K 15K 20K 25K 17117 17135 17565 17612 17817 18361 23773 24286 24366 Test: oltp_update_index - Threads: 32
f: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_index - Threads: 64 f d e c b i j h 7K 14K 21K 28K 35K 21067 21108 21271 23324 24371 30522 30638 31332 Test: oltp_update_index - Threads: 64
a: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 128 d e f c a b j i h 40K 80K 120K 160K 200K 129492 129904 130389 149962 159242 159728 197738 198137 200327 Test: oltp_point_select - Threads: 128
g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_index - Threads: 128 g e f c a b i j h 8K 16K 24K 32K 40K 24574 24611 24830 26546 27087 27464 36141 36644 37126 Test: oltp_update_index - Threads: 128
d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_non_index - Threads: 1 b a c d f g e i h 400 800 1200 1600 2000 1312 1328 1381 1693 1697 1705 1708 1848 1861 Test: oltp_update_non_index - Threads: 1
j: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_non_index - Threads: 16 b a e d g i j h 5K 10K 15K 20K 25K 18068 18095 18557 18563 18735 23541 23543 23794 Test: oltp_update_non_index - Threads: 16
c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
f: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_non_index - Threads: 32 d e f a b i j h 8K 16K 24K 32K 40K 26273 26285 26695 28735 28914 35650 35655 36041 Test: oltp_update_non_index - Threads: 32
c: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
g: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_non_index - Threads: 128 f g e a c j h 14K 28K 42K 56K 70K 41424 41695 42138 51105 52865 64066 65816 Test: oltp_update_non_index - Threads: 128
b: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
d: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
i: The test quit with a non-zero exit status. E: FATAL: Thread initialization failed!
Neural Magic DeepSparse OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream e d g f i h j c b a 9 18 27 36 45 12.94 13.07 13.07 13.09 25.63 25.71 25.73 39.45 39.47 39.50
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream j h i e f g d c b a 130 260 390 520 650 614.23 613.05 612.98 607.91 607.82 607.16 606.10 605.92 605.73 605.04
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream d f g e i j h b a c 300 600 900 1200 1500 508.09 508.21 509.14 511.41 999.46 1002.81 1003.52 1403.07 1417.07 1418.90
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream b a c i j h d f g e 4 8 12 16 20 17.07 16.91 16.89 15.99 15.94 15.92 15.72 15.72 15.69 15.62
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream d g f e j h i c b a 150 300 450 600 750 257.27 257.28 257.50 257.89 507.36 507.63 508.36 671.26 672.37 672.46
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream c b a j h i g d f e 8 16 24 32 40 35.68 35.64 35.63 31.50 31.49 31.44 31.06 31.05 31.03 30.99
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream g f d e j i h b a c 40 80 120 160 200 70.93 71.04 71.14 71.27 136.57 136.68 136.96 201.25 201.39 201.54
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream b c a i j h g f d e 30 60 90 120 150 118.95 118.78 118.75 116.89 116.85 116.51 112.48 112.41 112.25 112.06
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream e d f g j h i a b c 1100 2200 3300 4400 5500 1599.15 1599.21 1600.53 1602.52 3324.70 3324.82 3327.19 5137.01 5138.83 5153.66
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream d f e g j i h a b c 1.1241 2.2482 3.3723 4.4964 5.6205 4.9960 4.9877 4.9859 4.9787 4.8016 4.8015 4.8005 4.6508 4.6476 4.6348
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream c g h i e f j d b a 110 220 330 440 550 507.48 495.60 495.22 494.50 494.26 494.22 494.01 493.60 487.36 485.72
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream f e g d i j h c a b 110 220 330 440 550 162.90 162.93 163.23 163.56 326.78 326.90 326.93 487.05 489.12 489.45
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream d f e g j h i a c b 50 100 150 200 250 72.46 72.57 72.66 72.69 145.37 145.48 145.65 218.15 218.52 219.53
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream d f e g j a h i c b 20 40 60 80 100 110.11 110.00 109.97 109.90 109.86 109.80 109.79 109.74 109.58 109.23
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream d f e g i h j b c a 70 140 210 280 350 108.91 109.09 109.09 109.22 216.22 216.24 216.51 321.18 321.51 322.25
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream a c b h i j d e g f 80 160 240 320 400 347.66 347.37 347.22 337.96 336.77 336.68 325.88 325.74 325.51 324.96
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream g f e d i j h c b a 160 320 480 640 800 239.52 240.16 240.23 240.55 486.71 487.23 488.06 716.14 717.97 718.92
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream g e f d h j i a b c 40 80 120 160 200 55.43 55.46 55.54 55.61 109.03 109.41 109.46 158.92 159.06 164.61
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream b a h j i c g e d f 30 60 90 120 150 150.61 150.59 146.12 145.90 145.83 145.26 144.11 144.10 143.76 143.69
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream g f e d i j h c a b 9 18 27 36 45 13.06 13.09 13.12 13.13 25.70 25.77 25.79 39.42 39.44 39.45
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream i h j g f e b d c a 130 260 390 520 650 613.64 613.16 612.52 608.72 606.79 606.76 606.67 606.58 605.88 605.76
Blender OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: BMW27 - Compute: CPU-Only g d f e i j h b a c 16 32 48 64 80 72.01 72.00 71.96 71.44 38.57 38.51 38.40 26.24 26.20 26.12
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: Classroom - Compute: CPU-Only g d e f h i j c b a 40 80 120 160 200 183.29 182.99 182.56 181.70 99.54 99.35 99.29 66.72 66.64 66.42
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: Fishy Cat - Compute: CPU-Only g e f d h j i a b c 20 40 60 80 100 90.63 90.31 90.26 90.03 49.10 48.82 48.69 33.22 33.17 33.03
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: Barbershop - Compute: CPU-Only d e g f h i j b a c 140 280 420 560 700 670.87 670.64 669.09 667.87 352.40 351.66 351.38 255.30 254.88 254.72
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: Pabellon Barcelona - Compute: CPU-Only d g e f i h j b a c 50 100 150 200 250 224.15 224.12 224.10 223.95 119.42 119.30 119.04 80.76 80.54 80.41
OpenVINO OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU d e f g h i j a c b 7 14 21 28 35 10.47 10.47 10.48 10.48 19.82 19.83 19.84 30.41 30.43 30.44 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection FP16 - Device: CPU j i h d e f g a c b 200 400 600 800 1000 805.38 804.75 804.58 761.59 761.16 760.57 759.92 393.60 393.37 393.23 MIN: 783.22 / MAX: 819.23 MIN: 776.93 / MAX: 819.19 MIN: 772.52 / MAX: 820.63 MIN: 738.34 / MAX: 772.36 MIN: 741.99 / MAX: 776.56 MIN: 741.4 / MAX: 770.88 MIN: 737.63 / MAX: 771.07 MIN: 363.29 / MAX: 431.61 MIN: 362.57 / MAX: 433.51 MIN: 360.87 / MAX: 433.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU d g e f i j h a c b 60 120 180 240 300 107.02 107.04 107.27 107.39 193.80 194.82 197.94 282.55 282.67 284.22 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Detection FP16 - Device: CPU i j h g d e f a c b 20 40 60 80 100 82.49 82.09 80.77 74.71 74.71 74.50 74.43 42.44 42.43 42.20 MIN: 70.77 / MAX: 94.62 MIN: 68.73 / MAX: 91.87 MIN: 69.54 / MAX: 95.42 MIN: 66.29 / MAX: 79.68 MIN: 66.12 / MAX: 81.09 MIN: 66.5 / MAX: 80.32 MIN: 65.68 / MAX: 83.49 MIN: 36.14 / MAX: 61.98 MIN: 36.31 / MAX: 62.36 MIN: 36.84 / MAX: 61.97 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU f d e g h j i a c b 60 120 180 240 300 106.76 106.90 107.24 107.24 196.07 196.26 197.66 283.97 284.31 284.99 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Detection FP32 - Device: CPU h j i f d g e a c b 20 40 60 80 100 81.58 81.50 80.88 74.87 74.81 74.58 74.54 42.24 42.19 42.09 MIN: 68.74 / MAX: 95.81 MIN: 68.9 / MAX: 92.66 MIN: 39.72 / MAX: 92.54 MIN: 66.72 / MAX: 80.96 MIN: 66.88 / MAX: 80.7 MIN: 67.63 / MAX: 78.73 MIN: 65.97 / MAX: 82.9 MIN: 36.59 / MAX: 61.56 MIN: 36.21 / MAX: 65.64 MIN: 37.13 / MAX: 58.71 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU f e g d h j i b c a 400 800 1200 1600 2000 791.74 793.75 793.90 797.64 1481.71 1483.25 1488.04 2028.01 2029.79 2033.17 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16 - Device: CPU h j i f g e d b c a 3 6 9 12 15 10.78 10.77 10.74 10.09 10.06 10.06 10.01 5.91 5.90 5.89 MIN: 5.59 / MAX: 21.13 MIN: 6 / MAX: 18.16 MIN: 5.92 / MAX: 24.44 MIN: 5.4 / MAX: 19.17 MIN: 5.2 / MAX: 19.38 MIN: 5.29 / MAX: 19.07 MIN: 5.7 / MAX: 19.52 MIN: 4.84 / MAX: 12.9 MIN: 4.83 / MAX: 13.4 MIN: 4.67 / MAX: 18.4 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU e f d g j i h a c b 13 26 39 52 65 20.00 20.01 20.03 20.05 37.48 37.57 37.82 56.01 56.02 56.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection FP16-INT8 - Device: CPU j i h f e d g a c b 90 180 270 360 450 425.88 425.68 421.80 399.24 398.91 398.52 398.13 213.94 213.79 213.62 MIN: 404.76 / MAX: 434.06 MIN: 402.91 / MAX: 432.03 MIN: 269.94 / MAX: 598.22 MIN: 387.9 / MAX: 408.93 MIN: 386.2 / MAX: 407.29 MIN: 382.1 / MAX: 404.98 MIN: 379.09 / MAX: 404.71 MIN: 201.64 / MAX: 242.71 MIN: 197.29 / MAX: 236.32 MIN: 197.2 / MAX: 235.23 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU f g e d h i j b c a 1300 2600 3900 5200 6500 2539.97 2557.66 2562.54 2564.78 4803.65 4848.42 4892.27 5836.27 5840.53 5882.91 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16 - Device: CPU h i j f g e d c b a 0.747 1.494 2.241 2.988 3.735 3.32 3.29 3.26 3.14 3.12 3.11 3.11 2.05 2.05 2.03 MIN: 2.11 / MAX: 12.58 MIN: 1.89 / MAX: 12.75 MIN: 2.1 / MAX: 14.3 MIN: 1.93 / MAX: 11.65 MIN: 1.88 / MAX: 11.92 MIN: 1.93 / MAX: 9.72 MIN: 1.94 / MAX: 11.57 MIN: 1.62 / MAX: 6.96 MIN: 1.6 / MAX: 7 MIN: 1.66 / MAX: 7.51 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU g e f d i h j a b c 160 320 480 640 800 341.36 342.81 343.49 344.67 642.90 643.80 648.27 748.44 750.49 757.38 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16 - Device: CPU i h j g e f d a b c 6 12 18 24 30 24.87 24.84 24.67 23.42 23.32 23.28 23.20 16.02 15.98 15.83 MIN: 17 / MAX: 33.34 MIN: 16.93 / MAX: 33.96 MIN: 20.15 / MAX: 37.89 MIN: 20.46 / MAX: 32.43 MIN: 19.49 / MAX: 30.99 MIN: 15.73 / MAX: 30.77 MIN: 15.1 / MAX: 31.6 MIN: 12.5 / MAX: 33.94 MIN: 12.74 / MAX: 33.34 MIN: 12.38 / MAX: 32.97 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU e g d f h j i a b c 600 1200 1800 2400 3000 1174.60 1175.58 1175.67 1180.85 2252.70 2254.72 2264.93 2873.24 2880.58 2881.14 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Vehicle Detection FP16-INT8 - Device: CPU h j i e g d f a c b 2 4 6 8 10 7.09 7.08 7.05 6.80 6.79 6.79 6.76 4.17 4.16 4.16 MIN: 4.43 / MAX: 16.88 MIN: 4.35 / MAX: 16.86 MIN: 4.44 / MAX: 16.57 MIN: 4.04 / MAX: 15.37 MIN: 3.79 / MAX: 15.41 MIN: 3.8 / MAX: 15.48 MIN: 4.04 / MAX: 15.47 MIN: 3.39 / MAX: 10.07 MIN: 3.43 / MAX: 10.26 MIN: 3.42 / MAX: 11.2 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU f g d e h i j a b c 600 1200 1800 2400 3000 1038.47 1039.37 1039.61 1039.82 1963.90 1964.61 1964.71 2945.26 2986.46 2987.33 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16 - Device: CPU j i h a c b f g e d 4 8 12 16 20 16.27 16.27 16.27 16.26 16.02 16.02 15.38 15.37 15.36 15.36 MIN: 8.44 / MAX: 25.48 MIN: 8.5 / MAX: 25.86 MIN: 8.92 / MAX: 25.52 MIN: 14.71 / MAX: 28.14 MIN: 14.63 / MAX: 33.79 MIN: 14.41 / MAX: 30.55 MIN: 7.99 / MAX: 24 MIN: 7.99 / MAX: 23.98 MIN: 8.02 / MAX: 23.81 MIN: 8.08 / MAX: 24.34 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU g d e f j i h a c b 2K 4K 6K 8K 10K 3533.64 3540.88 3544.18 3548.78 6638.24 6646.91 6653.86 9837.58 9845.27 9849.07 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Face Detection Retail FP16-INT8 - Device: CPU c a b j i h g e d f 1.0935 2.187 3.2805 4.374 5.4675 4.86 4.86 4.85 4.81 4.81 4.80 4.52 4.51 4.51 4.50 MIN: 4.34 / MAX: 12.27 MIN: 4.23 / MAX: 12.81 MIN: 4.25 / MAX: 12.86 MIN: 3.23 / MAX: 14.45 MIN: 3.23 / MAX: 15.04 MIN: 3.23 / MAX: 14.95 MIN: 2.77 / MAX: 13.57 MIN: 2.96 / MAX: 16.06 MIN: 2.98 / MAX: 13.05 MIN: 2.98 / MAX: 13.86 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU f d g e i j h a c b 200 400 600 800 1000 369.26 370.57 372.26 373.64 709.73 709.75 710.69 842.91 849.30 854.51 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Road Segmentation ADAS FP16-INT8 - Device: CPU j i h f d g e a c b 5 10 15 20 25 22.53 22.53 22.50 21.65 21.57 21.47 21.40 14.23 14.12 14.03 MIN: 18.74 / MAX: 31.08 MIN: 19.09 / MAX: 30.15 MIN: 13.76 / MAX: 30.22 MIN: 19.48 / MAX: 24.27 MIN: 19.5 / MAX: 24.76 MIN: 17.62 / MAX: 28.13 MIN: 19.07 / MAX: 25.3 MIN: 11.51 / MAX: 25.86 MIN: 11.51 / MAX: 26.04 MIN: 11.59 / MAX: 26.04 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU g e d f i j h a b c 70 140 210 280 350 123.41 123.61 124.12 124.30 233.65 233.88 234.18 317.22 317.28 317.33 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Machine Translation EN To DE FP16 - Device: CPU i j h g e d f a c b 15 30 45 60 75 68.42 68.35 68.27 64.77 64.68 64.41 64.31 37.80 37.79 37.79 MIN: 56.13 / MAX: 75.77 MIN: 55.82 / MAX: 74.84 MIN: 56.41 / MAX: 79.96 MIN: 55.8 / MAX: 69.46 MIN: 38.02 / MAX: 72.52 MIN: 37.44 / MAX: 73.04 MIN: 50.85 / MAX: 70.77 MIN: 33.35 / MAX: 56.45 MIN: 33.29 / MAX: 54.88 MIN: 32.97 / MAX: 53.7 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU f g e d i h j a b c 1200 2400 3600 4800 6000 2004.76 2006.09 2007.53 2013.77 3777.75 3780.80 3783.65 5776.94 5780.44 5802.65 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Weld Porosity Detection FP16-INT8 - Device: CPU i h j a b c f g e d 2 4 6 8 10 8.46 8.46 8.45 8.28 8.27 8.24 7.97 7.96 7.96 7.93 MIN: 4.49 / MAX: 17.8 MIN: 4.67 / MAX: 18 MIN: 4.46 / MAX: 17.31 MIN: 7.44 / MAX: 23.35 MIN: 7.37 / MAX: 25.18 MIN: 7.62 / MAX: 23.32 MIN: 4.37 / MAX: 16.86 MIN: 4.19 / MAX: 14.2 MIN: 4.19 / MAX: 16.59 MIN: 4.2 / MAX: 16.92 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU e g d f h j i b a c 500 1000 1500 2000 2500 1028.64 1031.60 1036.99 1041.87 2180.83 2194.36 2224.08 2450.26 2454.09 2455.51 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Person Vehicle Bike Detection FP16 - Device: CPU e g d f h j i b c a 2 4 6 8 10 7.77 7.74 7.70 7.67 7.33 7.28 7.18 4.89 4.88 4.88 MIN: 5.42 / MAX: 16.35 MIN: 6.06 / MAX: 12.66 MIN: 5.51 / MAX: 16.06 MIN: 5.32 / MAX: 16.6 MIN: 5.45 / MAX: 15.94 MIN: 5.53 / MAX: 15.78 MIN: 4.98 / MAX: 16.11 MIN: 3.93 / MAX: 13.44 MIN: 3.9 / MAX: 14.94 MIN: 3.95 / MAX: 16.05 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU e d f g j h i b c a 300 600 900 1200 1500 530.99 532.59 533.74 538.01 1012.98 1034.35 1036.11 1546.02 1551.63 1560.03 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16 - Device: CPU j b h c i a e d f g 7 14 21 28 35 31.57 31.00 30.92 30.89 30.87 30.72 30.10 30.02 29.95 29.72 MIN: 20.39 / MAX: 39.22 MIN: 29.59 / MAX: 36.33 MIN: 25.94 / MAX: 41.77 MIN: 29.48 / MAX: 36.29 MIN: 20.13 / MAX: 42.34 MIN: 29.51 / MAX: 35.07 MIN: 22.61 / MAX: 39.15 MIN: 18.78 / MAX: 38.72 MIN: 19.01 / MAX: 38.08 MIN: 19.46 / MAX: 38.99 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU f d g e j h i c a b 20K 40K 60K 80K 100K 31951.64 32002.62 32008.03 32032.06 59505.78 59615.88 59654.98 86789.80 86884.64 87359.23 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU c b a j i h g f e d 0.1215 0.243 0.3645 0.486 0.6075 0.54 0.54 0.54 0.53 0.53 0.53 0.49 0.49 0.49 0.49 MIN: 0.45 / MAX: 5.03 MIN: 0.45 / MAX: 7.81 MIN: 0.45 / MAX: 7.64 MIN: 0.31 / MAX: 7.18 MIN: 0.31 / MAX: 10.06 MIN: 0.31 / MAX: 10.06 MIN: 0.3 / MAX: 8.84 MIN: 0.3 / MAX: 8.2 MIN: 0.3 / MAX: 9.07 MIN: 0.3 / MAX: 9.28 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU d f g e h j i c b a 300 600 900 1200 1500 395.66 431.94 432.20 432.32 810.71 812.76 815.13 1237.29 1239.67 1244.69 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Handwritten English Recognition FP16-INT8 - Device: CPU d h j i c b a f g e 9 18 27 36 45 40.40 39.44 39.34 39.23 38.75 38.66 38.50 37.01 36.98 36.98 MIN: 26.93 / MAX: 74.83 MIN: 33.14 / MAX: 45.28 MIN: 25.19 / MAX: 46.89 MIN: 34.71 / MAX: 47.63 MIN: 37.46 / MAX: 43.52 MIN: 37.22 / MAX: 43.52 MIN: 36.77 / MAX: 44.23 MIN: 32.25 / MAX: 43.6 MIN: 32.61 / MAX: 41.91 MIN: 32.02 / MAX: 44.78 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU e d f g j h i a b c 30K 60K 90K 120K 150K 44933.27 44958.07 44968.43 45097.99 68895.50 68931.35 68945.32 120606.38 120728.22 123484.28 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.1 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU j i h g f e d c b a 0.0788 0.1576 0.2364 0.3152 0.394 0.35 0.35 0.35 0.35 0.35 0.35 0.35 0.34 0.34 0.34 MIN: 0.22 / MAX: 8.35 MIN: 0.22 / MAX: 8.62 MIN: 0.21 / MAX: 8.91 MIN: 0.23 / MAX: 8.63 MIN: 0.23 / MAX: 9.15 MIN: 0.23 / MAX: 8.84 MIN: 0.23 / MAX: 9.09 MIN: 0.29 / MAX: 7.09 MIN: 0.29 / MAX: 10.87 MIN: 0.29 / MAX: 7.33 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 100 - Files: 100000 e j c b a g f h d i 120K 240K 360K 480K 600K 294985 370370 403226 404858 420168 460829 523560 526316 529101 555556
OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 50 - Files: 1000000 e i d g c b a f h j 300K 600K 900K 1200K 1500K 251004 253678 278319 654022 683995 1020408 1126126 1221001 1233046 1251564
OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 100 - Files: 1000000 b c a j h i g e d f 300K 600K 900K 1200K 1500K 173822 185874 215332 289101 323729 382995 1107420 1204819 1248439 1303781
OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 50 - Files: 1000000 c b a i g d f e h j 20K 40K 60K 80K 100K 90147 97314 98932 110436 110828 111012 111198 113327 113404 113572
OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 100 - Files: 1000000 b a c j f h d e g i 20K 40K 60K 80K 100K 86715 90114 97031 110693 110803 111782 112613 113225 113895 114692
OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 50 - Files: 100000 e a g d c f j b i h 200K 400K 600K 800K 1000K 389105 529101 561798 632911 657895 709220 751880 862069 869565 925926
OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 100 - Files: 100000 b f g a d h e j c i 200K 400K 600K 800K 1000K 458716 478469 487805 515464 591716 595238 613497 684932 729927 847458
OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 50 - Files: 1000000 c e h f d i b j g a 500K 1000K 1500K 2000K 2500K 284252 320924 426439 1795332 1818182 1930502 1941748 1941748 2036660 2173913
OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 100 - Files: 1000000 b e j d a c f g h i 500K 1000K 1500K 2000K 2500K 161970 235627 558036 600601 1886792 1893939 1964637 2049180 2352941 2506266
Kripke Kripke is a simple, scalable, 3D Sn deterministic particle transport code. Its primary purpose is to research how data layout, programming paradigms and architectures effect the implementation and performance of Sn transport. Kripke is developed by LLNL. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Throughput FoM, More Is Better Kripke 1.2.6 e f g d j i h 80M 160M 240M 320M 400M 236243900 236591000 237175700 240994500 349019800 350151200 354808000 1. (CXX) g++ options: -O3 -fopenmp -ldl
a: The test quit with a non-zero exit status.
b: The test quit with a non-zero exit status.
c: The test quit with a non-zero exit status.
BRL-CAD BRL-CAD is a cross-platform, open-source solid modeling system with built-in benchmark mode. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.36 VGR Performance Metric g f e d j i h c b a 170K 340K 510K 680K 850K 295522 295603 296125 298064 569066 570458 572500 762529 768517 772162 1. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6
easyWave The easyWave software allows simulating tsunami generation and propagation in the context of early warning systems. EasyWave supports making use of OpenMP for CPU multi-threading and there are also GPU ports available but not currently incorporated as part of this test profile. The easyWave tsunami generation software is run with one of the example/reference input files for measuring the CPU execution time. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240 f d e g i h j 0.3728 0.7456 1.1184 1.4912 1.864 1.657 1.657 1.654 1.648 1.288 1.284 1.245 1. (CXX) g++ options: -O3 -fopenmp
OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200 d e f g i h j 9 18 27 36 45 38.11 38.07 38.02 37.95 26.39 26.11 25.56 1. (CXX) g++ options: -O3 -fopenmp
OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 e d f g h j i 20 40 60 80 100 99.42 98.98 97.99 97.53 68.57 68.52 68.24 1. (CXX) g++ options: -O3 -fopenmp
Embree OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer - Model: Asian Dragon e d f g j i h 11 22 33 44 55 24.83 24.85 24.89 24.96 48.71 48.72 48.91 MIN: 24.76 / MAX: 24.96 MIN: 24.78 / MAX: 25 MIN: 24.81 / MAX: 25.06 MIN: 24.9 / MAX: 25.13 MIN: 48.45 / MAX: 49.47 MIN: 48.48 / MAX: 49.3 MIN: 48.64 / MAX: 49.47
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer - Model: Asian Dragon Obj g f e d i h j 10 20 30 40 50 22.26 22.27 22.29 22.35 43.77 43.84 43.90 MIN: 22.18 / MAX: 22.43 MIN: 22.2 / MAX: 22.44 MIN: 22.22 / MAX: 22.46 MIN: 22.28 / MAX: 22.5 MIN: 43.51 / MAX: 44.16 MIN: 43.64 / MAX: 44.38 MIN: 43.66 / MAX: 44.27
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer - Model: Crown f g d e h i j 10 20 30 40 50 21.77 21.83 21.89 21.99 43.57 43.81 43.93 MIN: 21.63 / MAX: 22.18 MIN: 21.69 / MAX: 22.17 MIN: 21.74 / MAX: 22.23 MIN: 21.84 / MAX: 22.32 MIN: 43.11 / MAX: 44.65 MIN: 43.36 / MAX: 45.05 MIN: 43.46 / MAX: 45.01
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon d f e g j i h 12 24 36 48 60 27.74 27.83 27.83 27.91 54.15 54.19 54.22 MIN: 27.64 / MAX: 27.98 MIN: 27.73 / MAX: 28.13 MIN: 27.72 / MAX: 28.1 MIN: 27.81 / MAX: 28.17 MIN: 53.87 / MAX: 54.79 MIN: 53.91 / MAX: 54.97 MIN: 53.93 / MAX: 54.77
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Obj d f e g h j i 10 20 30 40 50 23.35 23.50 23.53 23.71 45.92 46.02 46.09 MIN: 23.26 / MAX: 23.57 MIN: 23.4 / MAX: 23.74 MIN: 23.43 / MAX: 23.73 MIN: 23.61 / MAX: 23.93 MIN: 45.64 / MAX: 46.53 MIN: 45.75 / MAX: 46.57 MIN: 45.82 / MAX: 46.6
OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown e d g f h j i 10 20 30 40 50 22.34 22.39 22.42 22.44 45.19 45.40 45.71 MIN: 22.15 / MAX: 22.75 MIN: 22.2 / MAX: 22.85 MIN: 22.22 / MAX: 22.85 MIN: 22.25 / MAX: 22.78 MIN: 44.65 / MAX: 46.39 MIN: 44.88 / MAX: 46.68 MIN: 45.11 / MAX: 47.49
OpenVKL OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU Scalar e d f g h i j 80 160 240 320 400 190 191 191 191 363 363 363 MIN: 13 / MAX: 3484 MIN: 13 / MAX: 3471 MIN: 13 / MAX: 3484 MIN: 13 / MAX: 3483 MIN: 24 / MAX: 6610 MIN: 24 / MAX: 6577 MIN: 24 / MAX: 6613
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC d e f g i j h 200 400 600 800 1000 487 487 488 489 922 922 926 MIN: 36 / MAX: 6949 MIN: 36 / MAX: 6956 MIN: 36 / MAX: 6952 MIN: 36 / MAX: 6969 MIN: 67 / MAX: 12374 MIN: 67 / MAX: 12356 MIN: 67 / MAX: 12416
oneDNN This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU d f e g j i h 0.48 0.96 1.44 1.92 2.4 2.13332 2.13062 2.12570 2.11813 1.15578 1.15012 1.14749 MIN: 2 MIN: 1.97 MIN: 2.01 MIN: 1.99 MIN: 1.03 MIN: 1 MIN: 1.01 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU f d g e i h j 0.3539 0.7078 1.0617 1.4156 1.7695 1.572820 1.558240 1.551180 1.549110 0.798540 0.778543 0.768314 MIN: 1.53 MIN: 1.51 MIN: 1.52 MIN: 1.51 MIN: 0.7 MIN: 0.71 MIN: 0.71 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU f e d g i h j 0.3019 0.6038 0.9057 1.2076 1.5095 1.341830 1.338610 1.337890 1.335640 0.735094 0.734461 0.731618 MIN: 1.31 MIN: 1.31 MIN: 1.31 MIN: 1.31 MIN: 0.66 MIN: 0.66 MIN: 0.66 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU e g f d h j i 0.8649 1.7298 2.5947 3.4596 4.3245 3.84421 3.82381 3.81823 3.81576 3.72247 3.68087 3.65907 MIN: 3.27 MIN: 3.29 MIN: 3.25 MIN: 3.26 MIN: 2.83 MIN: 2.85 MIN: 2.81 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU e f g d j i h 0.1426 0.2852 0.4278 0.5704 0.713 0.633975 0.630325 0.629108 0.628236 0.430270 0.427512 0.426426 MIN: 0.6 MIN: 0.6 MIN: 0.6 MIN: 0.6 MIN: 0.38 MIN: 0.39 MIN: 0.38 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU e d f g i j h 0.6893 1.3786 2.0679 2.7572 3.4465 3.06370 3.05991 3.05674 3.05458 1.78876 1.78691 1.78170 MIN: 2.97 MIN: 2.96 MIN: 2.97 MIN: 2.97 MIN: 1.65 MIN: 1.66 MIN: 1.64 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU e g f d j i h 0.7615 1.523 2.2845 3.046 3.8075 3.38436 3.38156 3.37956 3.37782 1.73501 1.73499 1.73381 MIN: 3.33 MIN: 3.33 MIN: 3.33 MIN: 3.33 MIN: 1.64 MIN: 1.65 MIN: 1.64 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU f d e g i j h 0.1914 0.3828 0.5742 0.7656 0.957 0.850691 0.847805 0.844434 0.843492 0.440368 0.440156 0.440006 MIN: 0.83 MIN: 0.83 MIN: 0.83 MIN: 0.83 MIN: 0.41 MIN: 0.41 MIN: 0.41 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU e f d g j i h 0.4315 0.863 1.2945 1.726 2.1575 1.91781 1.91422 1.91374 1.91274 1.04333 1.04312 1.04100 MIN: 1.88 MIN: 1.88 MIN: 1.88 MIN: 1.88 MIN: 0.94 MIN: 0.94 MIN: 0.94 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU e g f d j h i 0.5772 1.1544 1.7316 2.3088 2.886 2.56522 2.51441 2.49714 2.49408 1.75453 1.74203 1.64478 MIN: 2.32 MIN: 2.3 MIN: 2.26 MIN: 2.3 MIN: 1.52 MIN: 1.51 MIN: 1.42 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU i h j e f d g 0.4369 0.8738 1.3107 1.7476 2.1845 1.941900 0.892701 0.880016 0.657610 0.653182 0.652259 0.647700 MIN: 0.87 MIN: 0.79 MIN: 0.78 MIN: 0.57 MIN: 0.57 MIN: 0.57 MIN: 0.57 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU h j i e g d f 0.4722 0.9444 1.4166 1.8888 2.361 2.09880 1.94941 1.24308 1.14432 1.12723 1.03749 1.00136 MIN: 1.29 MIN: 1.26 MIN: 1.04 MIN: 1.07 MIN: 0.93 MIN: 0.92 MIN: 0.92 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU e g d f j i h 0.2881 0.5762 0.8643 1.1524 1.4405 1.280430 1.279180 1.257580 1.206530 0.936001 0.931793 0.926283 MIN: 1.24 MIN: 1.24 MIN: 1.21 MIN: 1.18 MIN: 0.86 MIN: 0.86 MIN: 0.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU g d f e j h i 0.1378 0.2756 0.4134 0.5512 0.689 0.612320 0.603950 0.600834 0.575794 0.309278 0.302460 0.301535 MIN: 0.53 MIN: 0.53 MIN: 0.53 MIN: 0.52 MIN: 0.28 MIN: 0.27 MIN: 0.28 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU f e g d j h i 0.2388 0.4776 0.7164 0.9552 1.194 1.061440 1.054250 1.045670 1.028750 0.714970 0.704550 0.644252 MIN: 0.98 MIN: 0.97 MIN: 0.98 MIN: 0.96 MIN: 0.67 MIN: 0.66 MIN: 0.61 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU d e g f i j h 400 800 1200 1600 2000 1641.92 1641.00 1637.37 1636.76 991.07 988.59 986.96 MIN: 1584.81 MIN: 1595.55 MIN: 1584.58 MIN: 1585.98 MIN: 953.96 MIN: 950.96 MIN: 949.02 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU d e f g j h i 400 800 1200 1600 2000 1642.51 1639.36 1636.44 1631.99 994.61 993.56 987.36 MIN: 1593.16 MIN: 1581.93 MIN: 1585.81 MIN: 1581.62 MIN: 960.2 MIN: 955.42 MIN: 952.16 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU d e f g j h i 400 800 1200 1600 2000 1643.99 1643.97 1642.35 1641.40 991.12 987.84 985.74 MIN: 1588.03 MIN: 1590.89 MIN: 1586.17 MIN: 1589.91 MIN: 954.92 MIN: 952.67 MIN: 949.93 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU f e g d j i h 200 400 600 800 1000 851.49 849.71 848.03 838.52 569.80 566.18 564.12 MIN: 807.97 MIN: 805.98 MIN: 807.34 MIN: 796.3 MIN: 548.08 MIN: 544.56 MIN: 545.13 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU e f d g h i j 200 400 600 800 1000 851.66 849.34 849.16 837.60 568.75 564.45 563.58 MIN: 809.45 MIN: 805.8 MIN: 806.44 MIN: 796.61 MIN: 546.79 MIN: 545.57 MIN: 543.65 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.3 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU g d f e h j i 200 400 600 800 1000 847.42 847.38 845.31 841.08 568.65 566.39 563.33 MIN: 806.72 MIN: 806.33 MIN: 803.78 MIN: 798.46 MIN: 547.26 MIN: 542.7 MIN: 544.04 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl
QuantLib QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Single-Threaded h i j 700 1400 2100 2800 3500 3357.9 3365.4 3371.6 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.32 Configuration: Multi-Threaded h i j 30K 60K 90K 120K 150K 116781.5 117199.0 117263.3 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
a Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113eJava Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 7 October 2023 01:18 by user .
b Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113eJava Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 7 October 2023 13:27 by user .
c Processor: 2 x AMD EPYC 9254 24-Core @ 2.90GHz (48 Cores / 96 Threads), Motherboard: Supermicro H13DSH (1.5 BIOS), Memory: 24 x 32 GB DDR5-4800MT/s Samsung M321R4GA3BB6-CQKET, Disk: 2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07, Graphics: astdrmfb
OS: AlmaLinux 9.2, Kernel: 5.14.0-284.25.1.el9_2.x86_64 (x86_64), Compiler: GCC 11.3.1 20221121, File-System: ext4, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10113eJava Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 7 October 2023 19:27 by user .
d Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 20 October 2023 12:43 by user .
e Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 20 October 2023 22:56 by user .
f Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 21 October 2023 12:57 by user .
g Processor: AMD EPYC 9124 16-Core @ 3.00GHz (16 Cores / 32 Threads), Motherboard: Supermicro H13SSW (1.1 BIOS), Memory: 12 x 64 GB DDR5-4800MT/s HMCG94MEBRA123N, Disk: 2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07, Graphics: astdrmfb
OS: AlmaLinux 9.2, Kernel: 5.14.0-284.25.1.el9_2.x86_64 (x86_64), Compiler: GCC 11.3.1 20221121, File-System: ext4, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 22 October 2023 13:18 by user .
h Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 24 October 2023 01:00 by user .
i Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 24 October 2023 12:52 by user .
j Processor: AMD EPYC 9334 32-Core @ 2.70GHz (32 Cores / 64 Threads), Motherboard: Supermicro H13SSW (1.1 BIOS), Memory: 12 x 64 GB DDR5-4800MT/s HMCG94MEBRA123N, Disk: 2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07, Graphics: astdrmfb, Monitor: DELL E207WFP
OS: AlmaLinux 9.2, Kernel: 5.14.0-284.25.1.el9_2.x86_64 (x86_64), Compiler: GCC 11.3.1 20221121, File-System: ext4, Screen Resolution: 1680x1050
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Java Notes: OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS)Python Notes: Python 3.9.16Security Notes: itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 24 October 2023 19:18 by user .