2 x AMD EPYC 9654 96-Core testing with a AMD Titanite_4G (RTI1004D BIOS) and llvmpipe on Red Hat Enterprise Linux 9.1 via the Phoronix Test Suite.
a Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
b c Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1600x1200
no smt a Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
no smt b Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores)Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GBDisk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipeMonitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768
smt a Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
smt b smt c smt d Changed Processor to 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads) .
Zstd Compression This test measures the time needed to compress/decompress a sample file (silesia.tar) using Zstd (Zstandard) compression with options for different compression levels / settings. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3 - Compression Speed smt d smt c smt b smt a no smt b no smt a c b a 700 1400 2100 2800 3500 2528.7 2604.6 2513.4 2795.1 2865.9 2804.2 3049.4 3095.0 3033.9 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3 - Decompression Speed smt d smt c smt b smt a no smt b no smt a c b a 300 600 900 1200 1500 1513.5 1516.2 1519.1 1515.6 1511.5 1500.4 1517.4 1516.6 1514.8 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8 - Compression Speed smt d smt c smt b smt a no smt b no smt a c b a 300 600 900 1200 1500 1024.8 1005.8 1122.4 1023.9 1234.2 1227.5 1241.1 1239.3 1233.8 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8 - Decompression Speed smt d smt c smt b smt a no smt b no smt a c b a 400 800 1200 1600 2000 1664.2 1664.0 1671.0 1664.3 1667.6 1669.7 1661.9 1651.0 1669.3 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 12 - Compression Speed smt d smt c smt b smt a no smt b no smt a c b a 70 140 210 280 350 256.2 249.8 259.1 254.1 278.2 279.9 330.1 332.0 330.8 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 12 - Decompression Speed smt d smt c smt b smt a no smt b no smt a c b a 400 800 1200 1600 2000 1731.2 1732.3 1726.3 1723.7 1727.8 1728.0 1715.6 1716.7 1704.8 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed smt d smt c smt b smt a no smt b no smt a c b a 5 10 15 20 25 19.6 19.2 19.5 18.8 19.8 19.8 19.1 19.1 19.1 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed smt d smt c smt b smt a no smt b no smt a c b a 300 600 900 1200 1500 1479.1 1475.2 1483.5 1495.2 1483.8 1483.1 1470.5 1467.8 1472.6 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Compression Speed smt d smt c smt b smt a no smt b no smt a c b a 200 400 600 800 1000 1059.0 1046.6 1038.9 1051.4 1032.3 955.6 916.9 909.4 892.7 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Decompression Speed smt d smt c smt b smt a no smt b no smt a c b a 300 600 900 1200 1500 1543.6 1540.9 1540.4 1539.5 1538.8 1542.5 1540.9 1537.5 1536.6 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Compression Speed smt d smt c smt b smt a no smt b no smt a c b a 200 400 600 800 1000 879.6 860.8 852.7 853.8 892.0 859.9 926.9 910.8 938.5 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Decompression Speed smt d smt c smt b smt a no smt b no smt a c b a 400 800 1200 1600 2000 1677.6 1683.7 1676.5 1682.5 1682.8 1684.8 1675.4 1673.7 1677.9 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed smt d smt c smt b smt a no smt b no smt a c b a 3 6 9 12 15 9.81 9.82 9.87 9.78 9.76 9.39 9.30 9.29 9.22 1. (CC) gcc options: -O3 -pthread -lz
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed smt d smt c smt b smt a no smt b no smt a c b a 300 600 900 1200 1500 1391.7 1389.0 1392.4 1393.5 1397.6 1395.8 1384.0 1378.2 1383.7 1. (CC) gcc options: -O3 -pthread -lz
Embree Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.
Binary: Pathtracer - Model: Crown
a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt d: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
Binary: Pathtracer ISPC - Model: Crown
a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt d: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
Binary: Pathtracer - Model: Asian Dragon
a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt d: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
Binary: Pathtracer - Model: Asian Dragon Obj
a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt d: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
Binary: Pathtracer ISPC - Model: Asian Dragon
a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt d: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
Binary: Pathtracer ISPC - Model: Asian Dragon Obj
a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
no smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt a: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt b: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt c: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
smt d: The test quit with a non-zero exit status. E: ./embree-4.0.0.x86_64.linux/bin/embree_pathtracer_ispc: error while loading shared libraries: libGLU.so.1: cannot open shared object file: No such file or directory
Kvazaar This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Slow smt d smt c smt b smt a no smt b no smt a c b a 15 30 45 60 75 66.08 65.49 66.22 64.63 47.43 47.13 40.76 40.86 40.63 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Medium smt d smt c smt b smt a no smt b no smt a c b a 15 30 45 60 75 65.49 65.59 65.69 65.56 47.93 47.97 41.47 41.39 41.40 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Slow smt d smt c smt b smt a no smt b no smt a c b a 40 80 120 160 200 135.56 135.80 136.33 132.67 159.79 155.56 140.10 139.07 139.92 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Medium smt d smt c smt b smt a no smt b no smt a c b a 40 80 120 160 200 136.42 140.89 138.33 140.78 161.40 159.63 143.81 144.21 143.31 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Very Fast smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 73.24 73.57 74.11 75.91 69.94 70.02 80.31 81.61 80.90 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 75.50 78.72 76.70 76.64 74.03 75.50 84.55 80.68 81.90 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 78.85 76.14 77.00 77.96 74.37 76.05 82.70 84.77 83.45 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Very Fast smt d smt c smt b smt a no smt b no smt a c b a 60 120 180 240 300 270.76 243.36 274.63 250.71 268.77 269.62 291.03 290.59 296.93 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Super Fast smt d smt c smt b smt a no smt b no smt a c b a 70 140 210 280 350 256.45 288.09 267.04 296.72 280.18 288.41 301.40 303.99 307.49 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast smt d smt c smt b smt a no smt b no smt a c b a 70 140 210 280 350 303.63 303.43 295.18 302.55 271.45 278.62 309.64 305.52 310.73 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium smt d smt c smt b smt a no smt b no smt a c b a 11 22 33 44 55 46.21 46.57 46.62 47.56 38.65 38.38 33.10 33.13 33.03
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 80.00 79.63 79.95 80.17 88.13 87.15 81.10 81.41 81.16
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 88.91 89.16 89.70 89.40 96.67 98.21 91.29 91.47 91.37
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast smt d smt c smt b smt a no smt b no smt a c b a 15 30 45 60 75 57.52 57.44 57.86 59.30 58.09 57.13 69.04 68.79 68.82
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast smt d smt c smt b smt a no smt b no smt a c b a 16 32 48 64 80 58.66 58.34 59.20 59.06 58.33 59.83 69.92 69.00 69.33
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast smt d smt c smt b smt a no smt b no smt a c b a 16 32 48 64 80 58.76 57.33 57.51 57.96 57.23 57.78 71.13 70.68 70.56
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast smt d smt c smt b smt a no smt b no smt a c b a 50 100 150 200 250 181.83 192.25 209.55 183.99 183.75 196.25 237.44 234.68 234.95
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast smt d smt c smt b smt a no smt b no smt a c b a 50 100 150 200 250 218.91 178.78 220.79 178.49 216.15 181.67 237.96 239.92 238.68
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast smt d smt c smt b smt a no smt b no smt a c b a 50 100 150 200 250 224.31 218.28 179.56 216.15 209.85 186.24 238.77 240.91 240.98
VP9 libvpx Encoding This is a standard video encoding performance test of Google's libvpx library and the vpxenc command for the VP9 video format. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 0 - Input: Bosphorus 4K smt d smt c smt b smt a no smt b no smt a c b a 2 4 6 8 10 7.15 6.92 6.97 7.24 7.16 7.04 7.70 7.71 7.68 1. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11
OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 5 - Input: Bosphorus 4K smt d smt c smt b smt a no smt b no smt a c b a 4 8 12 16 20 15.11 15.38 14.27 13.90 14.50 14.48 17.46 17.37 17.36 1. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11
OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 0 - Input: Bosphorus 1080p smt d smt c smt b smt a no smt b no smt a c b a 4 8 12 16 20 13.68 13.97 13.57 14.08 13.72 14.28 14.76 14.67 14.69 1. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11
OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 5 - Input: Bosphorus 1080p smt d smt c smt b smt a no smt b no smt a c b a 7 14 21 28 35 29.66 29.54 29.60 29.54 29.71 29.62 29.46 29.50 29.37 1. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11
VVenC VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under The Clear BSD License. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast no smt b no smt a c b a 1.3264 2.6528 3.9792 5.3056 6.632 5.895 5.890 5.808 5.809 5.820 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto Video Input: Bosphorus 4K - Video Preset: Fast
smt a: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt b: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt c: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt d: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster no smt b no smt a c b a 3 6 9 12 15 12.31 12.48 12.40 12.39 12.34 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto Video Input: Bosphorus 4K - Video Preset: Faster
smt a: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt b: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt c: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt d: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast no smt b no smt a c b a 3 6 9 12 15 12.37 12.36 12.44 12.40 12.44 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto Video Input: Bosphorus 1080p - Video Preset: Fast
smt a: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt b: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt c: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt d: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster no smt b no smt a c b a 7 14 21 28 35 28.52 28.69 30.08 29.85 30.04 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto Video Input: Bosphorus 1080p - Video Preset: Faster
smt a: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt b: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt c: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
smt d: The test quit with a non-zero exit status. E: Parameter Check Error: Number of threads out of range (-1
OpenVKL OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC smt d smt c smt b smt a no smt b no smt a c b a 300 600 900 1200 1500 1238 1235 1243 1318 1108 1098 1066 1075 1089 MIN: 392 / MAX: 3738 MIN: 392 / MAX: 4332 MIN: 390 / MAX: 3501 MIN: 391 / MAX: 3855 MIN: 297 / MAX: 4208 MIN: 297 / MAX: 4284 MIN: 180 / MAX: 6427 MIN: 179 / MAX: 6442 MIN: 179 / MAX: 7194
OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark Scalar smt d smt c smt b smt a no smt b no smt a c b a 200 400 600 800 1000 781 793 810 764 652 647 549 557 556 MIN: 139 / MAX: 3776 MIN: 139 / MAX: 3583 MIN: 138 / MAX: 3650 MIN: 139 / MAX: 3808 MIN: 102 / MAX: 3990 MIN: 101 / MAX: 4024 MIN: 60 / MAX: 5475 MIN: 61 / MAX: 6019 MIN: 61 / MAX: 5994
Build: allmodconfig
a: The test quit with a non-zero exit status.
b: The test quit with a non-zero exit status.
c: The test quit with a non-zero exit status.
no smt a: The test quit with a non-zero exit status.
no smt b: The test quit with a non-zero exit status.
smt a: The test quit with a non-zero exit status.
smt b: The test quit with a non-zero exit status.
smt c: The test quit with a non-zero exit status.
smt d: The test quit with a non-zero exit status.
oneDNN This is a test of the Intel oneDNN as an Intel-optimized library for Deep Neural Networks and making use of its built-in benchdnn functionality. The result is the total perf time reported. Intel oneDNN was formerly known as DNNL (Deep Neural Network Library) and MKL-DNN before being rebranded as part of the Intel oneAPI toolkit. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 3 6 9 12 15 8.26078 9.34981 7.42270 7.60566 1.93126 2.04003 1.88686 1.92340 2.01581 MIN: 7.09 MIN: 7.73 MIN: 6.44 MIN: 6.54 MIN: 1.77 MIN: 1.78 MIN: 1.68 MIN: 1.72 MIN: 1.81 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.8104 1.6208 2.4312 3.2416 4.052 3.50563 3.60194 3.49453 3.39151 2.12379 2.19645 1.56742 1.56257 1.56461 MIN: 3.19 MIN: 3.08 MIN: 3.11 MIN: 2.93 MIN: 1.9 MIN: 2 MIN: 1.39 MIN: 1.41 MIN: 1.41 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 3 6 9 12 15 12.15710 12.01300 7.30147 11.43260 4.79302 4.87883 4.39720 4.27858 3.11497 MIN: 8.52 MIN: 8.02 MIN: 5.77 MIN: 7.59 MIN: 3.4 MIN: 3.53 MIN: 3.21 MIN: 3.37 MIN: 2.47 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.224 0.448 0.672 0.896 1.12 0.975091 0.995710 0.971704 0.975357 0.629026 0.556069 0.546991 0.513068 0.534450 MIN: 0.91 MIN: 0.87 MIN: 0.82 MIN: 0.92 MIN: 0.51 MIN: 0.46 MIN: 0.5 MIN: 0.47 MIN: 0.49 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 5 10 15 20 25 11.75730 18.65940 19.54900 15.42100 7.98861 6.19257 3.83017 9.19570 8.74576 MIN: 8.17 MIN: 11.23 MIN: 10.67 MIN: 10.4 MIN: 3.88 MIN: 3.65 MIN: 2.72 MIN: 4.13 MIN: 3.65 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.8092 1.6184 2.4276 3.2368 4.046 2.97427 3.36535 3.59643 3.38833 2.02833 2.02286 1.63860 1.72975 1.87777 MIN: 2.3 MIN: 2.7 MIN: 2.7 MIN: 2.76 MIN: 1.43 MIN: 1.56 MIN: 1.2 MIN: 1.27 MIN: 1.23 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.156 0.312 0.468 0.624 0.78 0.630630 0.545118 0.551783 0.538539 0.400325 0.403590 0.692667 0.689064 0.693367 MIN: 0.48 MIN: 0.45 MIN: 0.49 MIN: 0.48 MIN: 0.38 MIN: 0.38 MIN: 0.65 MIN: 0.64 MIN: 0.64 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 5 10 15 20 25 20.97260 21.03010 20.57200 20.26950 9.31751 9.25292 7.38116 7.28243 7.35746 MIN: 18.21 MIN: 17.96 MIN: 18.25 MIN: 17.68 MIN: 8.07 MIN: 7.79 MIN: 6.77 MIN: 6.58 MIN: 4.85 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.2633 0.5266 0.7899 1.0532 1.3165 0.973984 0.972863 0.973555 0.978590 0.651301 0.664295 1.169190 1.166960 1.170040 MIN: 0.92 MIN: 0.92 MIN: 0.92 MIN: 0.93 MIN: 0.62 MIN: 0.63 MIN: 1.07 MIN: 1.07 MIN: 1.07 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.0918 0.1836 0.2754 0.3672 0.459 0.389223 0.394377 0.408074 0.407430 0.255796 0.254845 0.312289 0.312721 0.311405 MIN: 0.29 MIN: 0.29 MIN: 0.27 MIN: 0.27 MIN: 0.18 MIN: 0.18 MIN: 0.28 MIN: 0.28 MIN: 0.3 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.2775 0.555 0.8325 1.11 1.3875 1.233400 1.201460 1.181350 1.200490 0.670574 0.664359 0.556851 0.551966 0.555277 MIN: 1.08 MIN: 1.08 MIN: 1.08 MIN: 1.04 MIN: 0.55 MIN: 0.56 MIN: 0.53 MIN: 0.49 MIN: 0.53 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.0688 0.1376 0.2064 0.2752 0.344 0.247825 0.275917 0.291087 0.279638 0.164845 0.160361 0.305599 0.305731 0.304972 MIN: 0.23 MIN: 0.23 MIN: 0.23 MIN: 0.23 MIN: 0.15 MIN: 0.15 MIN: 0.28 MIN: 0.28 MIN: 0.28 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 400 800 1200 1600 2000 1957.77 1888.21 1890.28 1912.16 1124.75 1148.26 906.14 903.27 907.49 MIN: 1929.47 MIN: 1860.29 MIN: 1864.29 MIN: 1891.03 MIN: 1091.36 MIN: 1108.42 MIN: 898.41 MIN: 894.76 MIN: 897.95 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 700 1400 2100 2800 3500 3349.36 3011.21 3034.62 3187.00 901.04 930.26 669.15 671.65 674.09 MIN: 3325.75 MIN: 2853.26 MIN: 2821.2 MIN: 3034.82 MIN: 864.28 MIN: 898.89 MIN: 661.71 MIN: 664.19 MIN: 667.01 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 400 800 1200 1600 2000 1883.76 1926.15 1937.65 1830.41 1119.17 1151.25 915.08 912.11 911.25 MIN: 1850.75 MIN: 1901.09 MIN: 1908.65 MIN: 1807.97 MIN: 1086.08 MIN: 1070.35 MIN: 906.26 MIN: 902.43 MIN: 903.01 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.1302 0.2604 0.3906 0.5208 0.651 0.457554 0.447820 0.450261 0.451472 0.291229 0.291687 0.417188 0.578466 0.415446 MIN: 0.34 MIN: 0.37 MIN: 0.37 MIN: 0.4 MIN: 0.27 MIN: 0.27 MIN: 0.4 MIN: 0.4 MIN: 0.4 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.6213 1.2426 1.8639 2.4852 3.1065 2.67303 2.70235 2.76140 2.70807 1.70057 1.65041 1.82264 1.84172 1.83147 MIN: 2.09 MIN: 2.27 MIN: 2.46 MIN: 2.09 MIN: 1.5 MIN: 1.41 MIN: 1.71 MIN: 1.76 MIN: 1.73 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.1603 0.3206 0.4809 0.6412 0.8015 0.680395 0.676798 0.672768 0.672585 0.461174 0.462386 0.708563 0.712495 0.711588 MIN: 0.53 MIN: 0.53 MIN: 0.53 MIN: 0.52 MIN: 0.43 MIN: 0.42 MIN: 0.67 MIN: 0.68 MIN: 0.68 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 700 1400 2100 2800 3500 3171.15 3153.22 3249.28 3269.05 903.36 913.20 671.23 670.20 671.69 MIN: 3148.29 MIN: 3059.88 MIN: 3226.78 MIN: 3243.11 MIN: 874.93 MIN: 884.92 MIN: 662.9 MIN: 663.54 MIN: 664.46 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.1521 0.3042 0.4563 0.6084 0.7605 0.672115 0.676124 0.675664 0.674455 0.347231 0.342836 0.353175 0.356875 0.357017 MIN: 0.49 MIN: 0.49 MIN: 0.55 MIN: 0.49 MIN: 0.3 MIN: 0.28 MIN: 0.31 MIN: 0.31 MIN: 0.31 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 400 800 1200 1600 2000 1912.74 1925.68 1894.07 1888.10 1139.63 1147.34 911.76 917.08 909.69 MIN: 1890.93 MIN: 1901.2 MIN: 1870.66 MIN: 1865.76 MIN: 1100.83 MIN: 1109.85 MIN: 901.88 MIN: 909.14 MIN: 901.1 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 700 1400 2100 2800 3500 3172.19 3185.64 3222.93 3133.65 939.55 973.32 667.95 668.95 675.92 MIN: 3155.85 MIN: 2949.58 MIN: 2927.41 MIN: 3037.06 MIN: 904.78 MIN: 937.3 MIN: 660.93 MIN: 662.29 MIN: 668.99 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.1356 0.2712 0.4068 0.5424 0.678 0.602831 0.593299 0.600199 0.591738 0.293564 0.316665 0.262920 0.263373 0.263997 MIN: 0.48 MIN: 0.39 MIN: 0.38 MIN: 0.43 MIN: 0.22 MIN: 0.24 MIN: 0.2 MIN: 0.2 MIN: 0.18 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.1429 0.2858 0.4287 0.5716 0.7145 0.627133 0.634992 0.620907 0.621776 0.340498 0.316779 0.285432 0.291387 0.290200 MIN: 0.4 MIN: 0.55 MIN: 0.41 MIN: 0.45 MIN: 0.28 MIN: 0.25 MIN: 0.24 MIN: 0.23 MIN: 0.25 1. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread
ClickHouse ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache smt d smt c smt b smt a no smt b no smt a c b a 140 280 420 560 700 500.12 495.85 516.09 500.13 622.73 635.48 614.24 610.79 600.70 MIN: 69.61 / MAX: 6000 MIN: 51.06 / MAX: 6000 MIN: 89.55 / MAX: 6000 MIN: 65.15 / MAX: 6000 MIN: 83.22 / MAX: 5454.55 MIN: 85.35 / MAX: 6000 MIN: 57.14 / MAX: 6666.67 MIN: 58.14 / MAX: 6666.67 MIN: 57.75 / MAX: 6000
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run smt d smt c smt b smt a no smt b no smt a c b a 140 280 420 560 700 515.11 524.75 527.88 524.04 649.52 666.43 621.88 627.20 625.91 MIN: 88.5 / MAX: 6000 MIN: 90.23 / MAX: 6000 MIN: 90.63 / MAX: 6666.67 MIN: 90.5 / MAX: 6666.67 MIN: 86.46 / MAX: 6000 MIN: 85.11 / MAX: 6666.67 MIN: 58.54 / MAX: 6666.67 MIN: 58.54 / MAX: 6000 MIN: 56.13 / MAX: 7500
OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run smt d smt c smt b smt a no smt b no smt a c b a 140 280 420 560 700 527.80 530.47 538.63 534.82 662.01 665.00 636.18 628.37 625.16 MIN: 81.52 / MAX: 6000 MIN: 92.02 / MAX: 5454.55 MIN: 89.82 / MAX: 6000 MIN: 91.32 / MAX: 6000 MIN: 86.33 / MAX: 6000 MIN: 85.84 / MAX: 6000 MIN: 58.03 / MAX: 6666.67 MIN: 58.37 / MAX: 6666.67 MIN: 57.69 / MAX: 6000
Memcached Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:5 smt d smt c smt b smt a no smt b no smt a c b a 900K 1800K 2700K 3600K 4500K 2527084.87 2517750.47 2507331.29 2520253.00 2460416.33 2444886.82 4155273.46 4162812.47 4143044.21 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:10 smt d smt c smt b smt a no smt b no smt a c b a 1.5M 3M 4.5M 6M 7.5M 4569476.86 4549313.42 4392934.75 4530948.62 4220522.49 4244908.83 6839975.87 6792746.34 6861088.89 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:100 smt d smt c smt b smt a no smt b no smt a c b a 1000K 2000K 3000K 4000K 5000K 4403267.42 4394194.49 4357453.76 4383314.65 3216133.91 3192061.68 4852421.67 4876951.36 4878860.00 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
GROMACS The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare smt d smt c smt b smt a no smt b no smt a c b a 5 10 15 20 25 19.08 19.05 19.02 18.82 18.84 19.18 10.59 10.61 10.57 1. (CXX) g++ options: -O3
Neural Magic DeepSparse This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 96.72 97.00 96.91 97.02 97.38 97.44 42.74 42.90 42.99
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 200 400 600 800 1000 974.99 971.90 975.50 972.52 955.24 955.16 1122.06 1118.44 1115.76
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 8 16 24 32 40 30.25 31.93 31.78 31.76 29.75 31.91 35.12 35.10 34.83
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 8 16 24 32 40 33.05 31.31 31.46 31.48 33.60 31.33 28.47 28.49 28.71
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 700 1400 2100 2800 3500 3116.09 3132.38 3114.43 3114.68 3086.36 3107.30 1571.83 1573.75 1566.56
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 7 14 21 28 35 30.72 30.58 30.75 30.75 30.64 30.42 30.49 30.46 30.59
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 40 80 120 160 200 183.95 189.41 188.41 188.58 175.32 191.26 197.66 196.54 197.10
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 1.2828 2.5656 3.8484 5.1312 6.414 5.4341 5.2773 5.3053 5.3004 5.7015 5.2262 5.0573 5.0859 5.0715
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 200 400 600 800 1000 816.76 818.60 822.16 817.75 817.63 813.98 400.04 401.21 401.78
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 30 60 90 120 150 117.22 116.97 116.48 117.12 115.64 116.15 119.70 119.38 119.21
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 75.52 70.14 77.41 77.88 71.89 72.13 98.59 98.62 99.15
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 4 8 12 16 20 13.23 14.25 12.91 12.83 13.90 13.86 10.14 10.14 10.08
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 200 400 600 800 1000 931.82 937.99 927.68 929.02 938.91 941.24 438.44 439.04 440.85
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 102.76 102.10 103.19 103.09 100.42 100.24 109.25 109.11 108.68
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 30 60 90 120 150 106.65 96.17 119.60 121.92 100.51 101.01 113.51 104.29 104.12
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 3 6 9 12 15 9.3656 10.3852 8.3506 8.1914 9.9395 9.8899 8.8004 9.5793 9.5962
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 500 1000 1500 2000 2500 2255.42 2253.14 2245.80 2230.31 2203.16 2204.75 1013.74 1012.35 1009.85
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 11 22 33 44 55 42.48 42.55 42.65 42.95 42.84 42.81 47.29 47.35 47.46
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 40 80 120 160 200 139.82 163.71 136.83 139.10 164.81 166.27 181.72 181.81 188.54
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 2 4 6 8 10 7.1490 6.1057 7.3054 7.1865 6.0650 6.0118 5.5007 5.4980 5.3018
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 300 600 900 1200 1500 1301.18 1305.71 1306.58 1306.67 1292.80 1291.97 625.55 619.94 619.75
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 73.62 73.34 73.35 73.31 73.21 73.20 76.62 77.31 77.34
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 40 80 120 160 200 141.47 135.89 145.17 132.87 155.74 131.76 193.31 193.53 192.88
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 2 4 6 8 10 7.0640 7.3550 6.8844 7.5225 6.4174 7.5856 5.1696 5.1633 5.1812
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 70 140 210 280 350 316.03 315.33 314.25 314.62 308.30 308.43 149.69 149.82 149.74
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 70 140 210 280 350 301.92 303.25 304.08 303.33 303.74 304.21 320.05 319.96 319.98
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 14 28 42 56 70 46.78 48.77 45.96 47.51 48.93 48.18 60.49 59.92 60.25
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 5 10 15 20 25 21.36 20.49 21.74 21.03 20.42 20.74 16.52 16.67 16.58
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 140 280 420 560 700 660.21 662.26 658.34 658.21 647.76 649.30 316.63 316.29 314.84
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 30 60 90 120 150 144.91 144.47 145.27 145.40 145.36 145.35 151.39 151.60 152.14
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 66.08 70.38 68.29 73.29 69.33 69.11 89.55 89.34 87.96
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 4 8 12 16 20 15.13 14.20 14.64 13.64 14.42 14.46 11.16 11.19 11.36
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 97.89 96.91 97.35 97.29 97.34 97.40 42.92 42.83 42.96
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream smt d smt c smt b smt a no smt b no smt a c b a 200 400 600 800 1000 966.76 971.67 969.21 970.22 955.34 956.01 1117.73 1116.29 1116.43
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 8 16 24 32 40 31.07 29.42 31.01 30.96 31.07 31.32 34.99 34.82 34.93
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream smt d smt c smt b smt a no smt b no smt a c b a 8 16 24 32 40 32.18 33.99 32.24 32.30 32.18 31.92 28.57 28.71 28.62
Stress-NG OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Hash smt d smt c smt b smt a no smt b no smt a c b a 9M 18M 27M 36M 45M 41965286.06 41972765.93 41989522.68 41966139.67 27422305.53 27408413.10 18961773.18 18955118.10 18954936.00 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: MMAP smt d smt c smt b smt a no smt b no smt a c b a 2K 4K 6K 8K 10K 7273.19 7633.16 9017.12 8360.76 3591.71 4520.48 1668.92 1664.75 1663.08 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: NUMA smt d smt c smt b smt a no smt b no smt a c b a 110 220 330 440 550 24.71 24.79 24.77 24.82 19.78 20.51 478.05 498.67 483.90 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Poll smt d smt c smt b smt a no smt b no smt a c b a 3M 6M 9M 12M 15M 15403597.24 15228320.07 15341564.16 15359471.73 10393402.01 10458275.24 12676101.41 12661687.46 12653709.64 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
Test: Zlib
a: The test run did not produce a result.
b: The test run did not produce a result.
c: The test run did not produce a result.
no smt a: The test run did not produce a result.
no smt b: The test run did not produce a result.
smt a: The test run did not produce a result.
smt b: The test run did not produce a result.
smt c: The test run did not produce a result.
smt d: The test run did not produce a result.
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Futex smt d smt c smt b smt a no smt b no smt a c b a 800K 1600K 2400K 3200K 4000K 2077119.76 2067499.58 2396325.93 2333781.39 3802292.60 3746361.52 2794473.75 2805836.52 2794694.37 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: MEMFD smt d smt c smt b smt a no smt b no smt a c b a 120 240 360 480 600 394.49 413.34 564.05 464.70 308.67 303.56 507.97 507.74 518.46 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Mutex smt d smt c smt b smt a no smt b no smt a c b a 30M 60M 90M 120M 150M 137579874.56 138939958.50 135855921.28 136339636.91 65500297.73 63581395.67 59929401.40 60031543.97 59479783.64 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Atomic smt d smt c smt b smt a no smt b no smt a c b a 90 180 270 360 450 182.80 184.24 186.64 184.34 395.95 400.03 183.33 223.29 174.72 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Crypto smt d smt c smt b smt a no smt b no smt a c b a 100K 200K 300K 400K 500K 468006.00 468159.21 466609.22 466292.12 437065.75 435615.35 203095.44 203147.15 203073.15 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Malloc smt d smt c smt b smt a no smt b no smt a c b a 140M 280M 420M 560M 700M 640853365.54 639757070.52 634995429.66 634718750.41 456651508.04 456657338.84 313768771.26 314418461.02 312709034.05 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Forking smt d smt c smt b smt a no smt b no smt a c b a 14K 28K 42K 56K 70K 34685.85 34917.39 36020.16 36266.02 45685.28 43094.96 64299.62 58664.97 58156.36 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Pthread smt d smt c smt b smt a no smt b no smt a c b a 40K 80K 120K 160K 200K 91735.75 77834.39 180407.59 74978.51 67451.30 68076.03 109609.15 109356.78 109397.78 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
Test: IO_uring
a: The test run did not produce a result.
b: The test run did not produce a result.
c: The test run did not produce a result.
no smt a: The test run did not produce a result.
no smt b: The test run did not produce a result.
smt a: The test run did not produce a result.
smt b: The test run did not produce a result.
smt c: The test run did not produce a result.
smt d: The test run did not produce a result.
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: SENDFILE smt d smt c smt b smt a no smt b no smt a c b a 900K 1800K 2700K 3600K 4500K 4351920.42 4351871.12 4329824.38 4329963.26 3282827.50 3284433.20 1891202.37 1913590.77 1950323.96 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: CPU Cache smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 40.56 42.55 44.38 47.58 55.84 40.94 97.04 67.21 77.51 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: CPU Stress smt d smt c smt b smt a no smt b no smt a c b a 110K 220K 330K 440K 550K 489998.75 490300.48 487987.32 487359.39 326819.72 328297.04 217304.19 217072.27 205134.87 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Semaphores smt d smt c smt b smt a no smt b no smt a c b a 4M 8M 12M 16M 20M 19842969.28 19866440.86 19927313.52 20047519.05 13192391.85 13141129.68 18088584.67 18100474.36 18128283.29 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Matrix Math smt d smt c smt b smt a no smt b no smt a c b a 200K 400K 600K 800K 1000K 951700.17 952461.48 946660.88 946032.88 925984.24 932248.18 382328.50 382304.04 382305.69 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Vector Math smt d smt c smt b smt a no smt b no smt a c b a 300K 600K 900K 1200K 1500K 1300693.93 1295970.28 1291704.57 1291689.33 920642.34 920216.27 556833.50 556797.27 556875.59 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Function Call smt d smt c smt b smt a no smt b no smt a c b a 300K 600K 900K 1200K 1500K 1425621.44 1422505.51 1413555.44 1414423.65 829445.38 829106.63 621041.93 621003.92 621015.34 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
Test: x86_64 RdRand
a: The test run did not produce a result. E: stress-ng: error: [1836509] No stress workers invoked (one or more were unsupported)
b: The test run did not produce a result. E: stress-ng: error: [3544257] No stress workers invoked (one or more were unsupported)
c: The test run did not produce a result. E: stress-ng: error: [1223131] No stress workers invoked (one or more were unsupported)
no smt a: The test run did not produce a result. E: stress-ng: error: [4177065] No stress workers invoked (one or more were unsupported)
no smt b: The test run did not produce a result. E: stress-ng: error: [19683] No stress workers invoked (one or more were unsupported)
smt a: The test run did not produce a result. E: stress-ng: error: [55524] No stress workers invoked (one or more were unsupported)
smt b: The test run did not produce a result. E: stress-ng: error: [3903578] No stress workers invoked (one or more were unsupported)
smt c: The test run did not produce a result. E: stress-ng: error: [4007271] No stress workers invoked (one or more were unsupported)
smt d: The test run did not produce a result. E: stress-ng: error: [381360] No stress workers invoked (one or more were unsupported)
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Memory Copying smt d smt c smt b smt a no smt b no smt a c b a 4K 8K 12K 16K 20K 13370.33 15077.69 15430.18 15914.10 10949.90 11342.69 20297.91 20340.40 20106.51 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Socket Activity smt d smt c smt b smt a no smt b no smt a c b a 2K 4K 6K 8K 10K 8864.78 8747.83 8750.61 8748.99 8924.10 8968.28 8876.10 8851.65 8873.58 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Context Switching smt d smt c smt b smt a no smt b no smt a c b a 10M 20M 30M 40M 50M 12728401.45 12328933.65 12221058.34 12895047.73 44683906.68 47222624.49 16862185.54 16313126.86 18941003.97 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Glibc C String Functions smt d smt c smt b smt a no smt b no smt a c b a 8M 16M 24M 32M 40M 36111781.82 34602827.77 35996976.13 35687958.37 28009942.56 26755146.69 16537965.14 16168655.17 16257100.25 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Glibc Qsort Data Sorting smt d smt c smt b smt a no smt b no smt a c b a 600 1200 1800 2400 3000 2516.09 2517.26 2520.38 2564.48 1963.75 1978.80 1125.86 1132.35 1122.39 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: System V Message Passing smt d smt c smt b smt a no smt b no smt a c b a 3M 6M 9M 12M 15M 12418451.71 8609357.68 8586858.51 10103952.13 7372780.72 7402514.74 10475486.39 10471889.97 10473084.09 1. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread
OpenVINO This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 109.23 109.36 108.89 108.93 109.04 109.08 49.77 49.72 49.72 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 200 400 600 800 1000 437.68 437.51 439.50 439.41 438.99 438.29 962.15 962.63 962.10 MIN: 394.89 / MAX: 478.58 MIN: 400.05 / MAX: 473.91 MIN: 424.22 / MAX: 477.66 MIN: 410.81 / MAX: 465.4 MIN: 427.57 / MAX: 484.31 MIN: 416.93 / MAX: 496.86 MIN: 888.7 / MAX: 1017.92 MIN: 893.43 / MAX: 1015.71 MIN: 879.24 / MAX: 1018.81 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 13 26 39 52 65 58.00 58.05 57.67 57.72 57.49 57.58 28.33 28.42 28.47 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 400 800 1200 1600 2000 822.50 821.93 827.03 827.07 830.04 828.67 1679.03 1675.96 1671.46 MIN: 717.65 / MAX: 997.43 MIN: 725.25 / MAX: 1010.56 MIN: 723.77 / MAX: 1003.25 MIN: 724.84 / MAX: 1037.91 MIN: 722.6 / MAX: 1015.67 MIN: 730.29 / MAX: 1036.1 MIN: 865.58 / MAX: 1995.12 MIN: 1231.52 / MAX: 1967.75 MIN: 924.15 / MAX: 1977.46 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 13 26 39 52 65 57.62 57.71 57.31 57.29 57.19 57.18 27.89 28.23 27.97 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 400 800 1200 1600 2000 828.01 826.67 832.70 833.15 834.17 833.99 1704.02 1685.26 1701.70 MIN: 716.19 / MAX: 1018.34 MIN: 724.1 / MAX: 1006.75 MIN: 723.65 / MAX: 1031.69 MIN: 725.84 / MAX: 1017.38 MIN: 732.01 / MAX: 1006.46 MIN: 723.91 / MAX: 1011.94 MIN: 828.99 / MAX: 1969.02 MIN: 891.16 / MAX: 1979.37 MIN: 1395.71 / MAX: 2063.97 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 2K 4K 6K 8K 10K 7990.47 7993.18 7949.05 7953.21 7979.82 7979.05 3174.04 3085.53 2941.47 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 4 8 12 16 20 6.00 5.99 6.03 6.02 6.01 6.01 15.10 15.54 16.30 MIN: 5.21 / MAX: 25.51 MIN: 5.13 / MAX: 31.29 MIN: 5.17 / MAX: 38.35 MIN: 5.27 / MAX: 25.12 MIN: 5.02 / MAX: 36.88 MIN: 5.2 / MAX: 37.8 MIN: 6.94 / MAX: 60.59 MIN: 8.28 / MAX: 57.72 MIN: 7.91 / MAX: 51.62 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 50 100 150 200 250 209.24 210.19 208.19 208.13 210.14 208.82 95.59 95.48 95.76 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 110 220 330 440 550 228.94 227.93 230.06 230.21 228.01 229.46 500.30 500.83 499.32 MIN: 214.92 / MAX: 248.29 MIN: 210.46 / MAX: 252.96 MIN: 210.58 / MAX: 251.42 MIN: 211.56 / MAX: 253.58 MIN: 212.99 / MAX: 267.17 MIN: 217.93 / MAX: 265.81 MIN: 410.04 / MAX: 531.93 MIN: 418.76 / MAX: 546.62 MIN: 264.54 / MAX: 537.26 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 3K 6K 9K 12K 15K 12172.92 12168.05 12109.64 12117.16 12128.38 12119.66 5898.79 5894.27 5908.89 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 2 4 6 8 10 3.93 3.93 3.96 3.95 3.95 3.95 8.13 8.13 8.11 MIN: 3.61 / MAX: 23.62 MIN: 3.61 / MAX: 42.82 MIN: 3.66 / MAX: 32.83 MIN: 3.61 / MAX: 34.38 MIN: 3.68 / MAX: 42.53 MIN: 3.61 / MAX: 38 MIN: 3.83 / MAX: 59.87 MIN: 5.35 / MAX: 55.84 MIN: 5.39 / MAX: 69.87 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 2K 4K 6K 8K 10K 10587.30 10603.84 10549.15 10544.03 10549.24 10556.93 4910.13 4915.42 4914.17 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 3 6 9 12 15 4.52 4.52 4.54 4.54 4.54 4.54 9.76 9.75 9.76 MIN: 4.03 / MAX: 45.52 MIN: 4.12 / MAX: 33.17 MIN: 4.11 / MAX: 42.14 MIN: 4.07 / MAX: 35.16 MIN: 4.09 / MAX: 55.78 MIN: 4.12 / MAX: 27.91 MIN: 4.98 / MAX: 36.12 MIN: 5.25 / MAX: 35.53 MIN: 5.03 / MAX: 28.1 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 200 400 600 800 1000 1057.74 1058.57 1050.37 1049.16 1048.74 1045.81 535.78 541.03 540.41 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 20 40 60 80 100 45.34 45.31 45.66 45.71 45.73 45.86 89.46 88.61 88.71 MIN: 39.4 / MAX: 73.83 MIN: 39.35 / MAX: 73.19 MIN: 38.82 / MAX: 75.65 MIN: 39.78 / MAX: 73.33 MIN: 39.68 / MAX: 86.83 MIN: 39.29 / MAX: 91.13 MIN: 42.16 / MAX: 123.4 MIN: 47.57 / MAX: 124.67 MIN: 44.2 / MAX: 132.86 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 4K 8K 12K 16K 20K 20679.68 20684.29 20610.62 20610.23 20849.75 20836.10 9485.65 9496.95 9494.22 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 3 6 9 12 15 9.26 9.25 9.28 9.28 9.18 9.18 10.11 10.10 10.10 MIN: 8.12 / MAX: 30.29 MIN: 8.12 / MAX: 19.04 MIN: 8.13 / MAX: 24.28 MIN: 8.1 / MAX: 22.87 MIN: 8.21 / MAX: 24.31 MIN: 8.17 / MAX: 31.1 MIN: 5.43 / MAX: 36.27 MIN: 5.47 / MAX: 28.16 MIN: 5.46 / MAX: 35.41 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 2K 4K 6K 8K 10K 9767.99 9773.26 9680.44 9746.08 9758.74 9784.09 5724.81 5720.90 5750.74 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 2 4 6 8 10 4.91 4.90 4.95 4.92 4.91 4.90 8.37 8.38 8.34 MIN: 4.51 / MAX: 27.27 MIN: 4.5 / MAX: 29.95 MIN: 4.54 / MAX: 24.23 MIN: 4.52 / MAX: 34.8 MIN: 4.49 / MAX: 34.72 MIN: 4.46 / MAX: 56.52 MIN: 6.83 / MAX: 50.24 MIN: 6.4 / MAX: 32.33 MIN: 6.61 / MAX: 55.54 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 40K 80K 120K 160K 200K 172228.34 173620.31 175754.35 173926.92 162294.47 160545.41 112186.25 111378.39 112346.36 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.1485 0.297 0.4455 0.594 0.7425 0.53 0.53 0.53 0.53 0.58 0.57 0.66 0.66 0.65 MIN: 0.5 / MAX: 8.86 MIN: 0.5 / MAX: 9.15 MIN: 0.5 / MAX: 9.61 MIN: 0.5 / MAX: 24.2 MIN: 0.5 / MAX: 12.8 MIN: 0.5 / MAX: 13.02 MIN: 0.31 / MAX: 22.67 MIN: 0.32 / MAX: 19.99 MIN: 0.32 / MAX: 20.68 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 30K 60K 90K 120K 150K 149647.68 148047.13 147582.87 148316.88 127770.39 127833.52 74486.08 74353.41 74495.17 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU smt d smt c smt b smt a no smt b no smt a c b a 0.2453 0.4906 0.7359 0.9812 1.2265 0.97 0.96 0.97 0.97 1.01 1.01 1.09 1.09 1.09 MIN: 0.86 / MAX: 13.31 MIN: 0.87 / MAX: 9.72 MIN: 0.87 / MAX: 10.96 MIN: 0.87 / MAX: 9.78 MIN: 0.86 / MAX: 8.72 MIN: 0.86 / MAX: 8.97 MIN: 0.49 / MAX: 22.06 MIN: 0.48 / MAX: 25.82 MIN: 0.49 / MAX: 19.01 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
RocksDB This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill smt d smt c smt b smt a no smt b no smt a c b a 110K 220K 330K 440K 550K 415428 416006 417882 423027 468210 478629 536551 534681 533927 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read smt d smt c smt b smt a no smt b no smt a c b a 300M 600M 900M 1200M 1500M 1231916197 1234570512 1231168093 1225662852 1213540299 1209611055 468069792 466888888 468231434 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Update Random smt d smt c smt b smt a no smt b no smt a c b a 120K 240K 360K 480K 600K 420514 419985 411513 413199 452228 462018 543572 545556 544384 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Sequential Fill smt d smt c smt b smt a no smt b no smt a c b a 120K 240K 360K 480K 600K 414047 414282 413708 414168 464044 465700 544565 545396 542256 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill Sync smt d smt c smt b smt a no smt b no smt a c b a 90K 180K 270K 360K 450K 404463 394852 401295 388052 344040 350673 356922 373002 376601 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read While Writing smt d smt c smt b smt a no smt b no smt a c b a 3M 6M 9M 12M 15M 13098097 13948914 13830689 15317250 7913568 7643831 8316379 8620352 9296185 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read Random Write Random smt d smt c smt b smt a no smt b no smt a c b a 600K 1200K 1800K 2400K 3000K 1752904 1613913 1761416 1787682 2063831 2079804 2910023 2891962 2926458 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
a Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 9 March 2023 19:46 by user .
b Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 10 March 2023 04:27 by user .
c Processor: AMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 768GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: ASPEED, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1600x1200
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 10 March 2023 07:00 by user .
no smt a Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 10 March 2023 17:20 by user phoronix.
no smt b Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 10 March 2023 19:43 by user phoronix.
smt a Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 11 March 2023 05:04 by user phoronix.
smt b Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 11 March 2023 07:43 by user phoronix.
smt c Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 11 March 2023 10:38 by user phoronix.
smt d Processor: 2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads), Motherboard: AMD Titanite_4G (RTI1004D BIOS), Chipset: AMD Device 14a4, Memory: 1520GB, Disk: 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007, Graphics: llvmpipe, Monitor: VGA HDMI, Network: Broadcom NetXtreme BCM5720 PCIe
OS: Red Hat Enterprise Linux 9.1, Kernel: 5.14.0-162.6.1.el9_1.x86_64 (x86_64), Desktop: GNOME Shell 40.10, Display Server: X Server 1.20.11, OpenGL: 4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits), Compiler: GCC 11.3.1 20220421, File-System: xfs, Screen Resolution: 1024x768
Kernel Notes: Transparent Huge Pages: alwaysCompiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-islProcessor Notes: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Notes: Python 3.9.14Security Notes: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
Testing initiated at 11 March 2023 12:53 by user phoronix.