Benchmarks for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2403039-NE-2403025NE90 Linux Distros Emerald Rapids - Phoronix Test Suite Linux Distros Emerald Rapids Benchmarks for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2403039-NE-2403025NE90 .
Linux Distros Emerald Rapids Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Compiler File-System Screen Resolution Desktop Display Server Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads) Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS) Intel Device 1bce 1008GB 3201GB Micron_7450_MTFDKCB3T2TFS ASPEED 2 x Intel X710 for 10GBASE-T Ubuntu 23.10 6.5.0-17-generic (x86_64) GCC 13.2.0 ext4 1024x768 3201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash Drive CentOS Stream 9 5.14.0-419.el9.x86_64 (x86_64) GNOME Shell 40.10 X Server GCC 11.4.1 20231218 xfs 1920x1200 Fedora Linux 39 6.7.6-200.fc39.x86_64 (x86_64) GCC 13.2.1 20231205 1024x768 Arch Linux 6.7.6-arch1-2 (x86_64) GCC 13.2.1 20230801 btrfs 1920x1200 OpenBenchmarking.org Kernel Details - Ubuntu Linux 23.10: Transparent Huge Pages: madvise - CentOS Stream 9: Transparent Huge Pages: always - Fedora Server 39: Transparent Huge Pages: madvise - Arch Linux: Transparent Huge Pages: always Compiler Details - Ubuntu Linux 23.10: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - CentOS Stream 9: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl - Fedora Server 39: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - Arch Linux: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,m2,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu Processor Details - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161 Python Details - Ubuntu Linux 23.10: Python 3.11.6 - CentOS Stream 9: Python 3.9.18 - Fedora Server 39: Python 3.12.2 - Arch Linux: Python 3.11.7 Security Details - Ubuntu Linux 23.10: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - CentOS Stream 9: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Fedora Server 39: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Arch Linux: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Linux Distros Emerald Rapids hpcg: 104 104 104 - 60 hpcg: 144 144 144 - 60 lczero: BLAS lczero: Eigen quicksilver: CTS2 quicksilver: CORAL2 P1 quicksilver: CORAL2 P2 cloverleaf: clover_bm16 cloverleaf: clover_bm64_short namd: ATPase with 327,506 Atoms namd: STMV with 1,066,628 Atoms nwchem: C240 Buckyball incompact3d: X3D-benchmarking input.i3d lammps: 20k Atoms lammps: Rhodopsin Protein easywave: e2Asean Grid + BengkuluSept2007 Source - 2400 embree: Pathtracer ISPC - Crown embree: Pathtracer ISPC - Asian Dragon svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K vvenc: Bosphorus 4K - Fast vvenc: Bosphorus 4K - Faster mt-dgemm: Sustained Floating-Point Rate oidn: RT.hdr_alb_nrm.3840x2160 - CPU-Only oidn: RT.ldr_alb_nrm.3840x2160 - CPU-Only oidn: RTLightmap.hdr.4096x4096 - CPU-Only openvkl: vklBenchmarkCPU ISPC compress-7zip: Compression Rating compress-7zip: Decompression Rating y-cruncher: 1B y-cruncher: 5B clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, Third Run memcached: 1:10 memcached: 1:100 redis: GET - 500 redis: SET - 500 graph500: 26 graph500: 26 graph500: 26 graph500: 26 gromacs: MPI CPU - water_GMX50_bare pgbench: 100 - 1000 - Read Only pgbench: 100 - 1000 - Read Only - Average Latency pgbench: 100 - 1000 - Read Write pgbench: 100 - 1000 - Read Write - Average Latency tensorflow: CPU - 512 - ResNet-50 rawtherapee: Total Benchmark Time deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream gpaw: Carbon Nanotube openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Face Detection Retail FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Road Segmentation ADAS FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Handwritten English Recognition FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU rocksdb: Rand Read rocksdb: Update Rand rocksdb: Read While Writing rocksdb: Read Rand Write Rand speedb: Rand Read ospray: particle_volume/ao/real_time ospray: particle_volume/scivis/real_time ospray: particle_volume/pathtracer/real_time ospray: gravity_spheres_volume/dim_512/ao/real_time ospray: gravity_spheres_volume/dim_512/scivis/real_time ospray: gravity_spheres_volume/dim_512/pathtracer/real_time ospray-studio: 1 - 4K - 1 - Path Tracer - CPU ospray-studio: 2 - 4K - 1 - Path Tracer - CPU ospray-studio: 3 - 4K - 1 - Path Tracer - CPU ospray-studio: 1 - 4K - 16 - Path Tracer - CPU ospray-studio: 1 - 4K - 32 - Path Tracer - CPU ospray-studio: 2 - 4K - 16 - Path Tracer - CPU ospray-studio: 2 - 4K - 32 - Path Tracer - CPU ospray-studio: 3 - 4K - 16 - Path Tracer - CPU ospray-studio: 3 - 4K - 32 - Path Tracer - CPU ospray-studio: 1 - 1080p - 1 - Path Tracer - CPU ospray-studio: 2 - 1080p - 1 - Path Tracer - CPU ospray-studio: 3 - 1080p - 1 - Path Tracer - CPU ospray-studio: 1 - 1080p - 16 - Path Tracer - CPU ospray-studio: 1 - 1080p - 32 - Path Tracer - CPU ospray-studio: 2 - 1080p - 16 - Path Tracer - CPU ospray-studio: 2 - 1080p - 32 - Path Tracer - CPU ospray-studio: 3 - 1080p - 16 - Path Tracer - CPU ospray-studio: 3 - 1080p - 32 - Path Tracer - CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 71.1371 69.3362 15 380 7680222 5931500 6744778 279.21 32.10 4.70711 1.49004 1750.3 169.178579 56.683 37.518 177.754 100.3399 144.9195 2.307 21.317 66.857 66.430 2.785 5.611 37.971018 4.53 4.54 2.18 2821 464813 455056 7.207 29.821 205.20 214.31 215.62 3370014.38 3477137.28 1541713.80 2134872.89 1226550000 1289580000 483534000 664991000 9.630 679317 1.489 39542 25.616 73.12 129.079 132.6789 478.7631 4547.5395 14.0573 1837.1113 34.7603 11099.6440 5.7515 829.5063 77.0180 155.8178 409.0089 1826.0447 34.9884 853.2079 74.8838 1223.1639 52.2774 176.5691 361.2877 1866.2259 34.2545 133.2063 477.1362 38.637 375.75 85.06 519.83 245.98 8901.61 14.37 24570.10 5.20 2377.90 53.79 1143.25 27.93 43516.98 2.85 10033.95 12.74 3217.84 39.76 61020.16 0.80 599822046 125560 9775989 955461 600703384 20.6546 20.7725 82.9700 28.6088 28.9162 32.3212 914 911 1079 12086 32279 12243 33174 14508 37285 234 233 276 3718 6448 3694 6324 4353 7321 71.1332 69.1728 7398333 5800833 6381000 314.49 25.01 3.20328 0.50251 184.192332 57.836 39.795 205.005 105.6194 177.7960 2.358 21.560 69.868 69.718 2.823 5.808 63.635840 5.04 4.90 2.51 2815 751070 434200 7.913 32.850 183.62 200.18 201.05 3337339.10 2615816.73 1821521.39 1978937.18 1464120000 1499600000 466398000 640794000 5.939 76.68 132.9101 478.0315 4462.5255 14.3182 1863.3429 34.2906 11022.3020 5.7833 827.9914 77.1671 152.5678 416.6816 1866.5153 34.2262 853.3374 74.8038 1223.6470 52.2360 173.9515 366.3831 1810.9508 35.2846 133.2818 476.5785 328.37 97.34 528.79 241.67 8908.74 14.36 24295.71 5.25 2412.51 53.02 617.45 52.09 40187.34 3.02 10113.47 12.65 3196.47 40.02 60429.54 0.83 20.5021 20.4427 83.5652 29.7626 29.5104 33.2938 72.4575 70.3805 7367500 5835818 6759600 255.39 31.63 5.40706 1.92977 168.671819 57.677 39.009 156.237 142.1675 179.5403 2.346 21.161 71.518 70.874 2.834 5.804 37.720076 4.68 4.70 2.25 2821 496138 428601 8.270 33.734 188.71 202.14 206.83 5054518.76 8983240.52 1838671.43 2125843.97 1195510000 1253250000 493031000 663412000 7.180 118.228 194.508 340.97 93.74 529.14 241.70 8862.07 14.43 24296.54 5.25 2383.22 53.67 978.70 32.67 42419.89 2.86 10082.93 12.69 3255.16 39.30 56624.98 0.83 652854125 123092 8567006 1184837 626261826 20.4442 20.5419 82.1380 28.6637 28.430 31.6999 902 897 1058 12187 28035 12262 27524 14422 34698 235 233 276 3683 6314 3655 6303 4377 7424 71.1292 70.1210 7723667 5865500 7013889 356.23 30.30 5.59956 1.74784 187.266596 62.990 42.751 145.713 118.7400 148.6022 2.395 22.046 73.717 72.906 2.900 5.942 43.669234 4.75 4.75 2.36 2951 759279 482076 7.561 33.652 209.64 221.80 221.71 5462773.67 9633352.44 1777534.65 2231227.61 1275690000 1323480000 509964000 692893000 13.638 698734 1.440 18536 54.085 77.06 107.048 134.2065 474.2419 4534.8946 14.0959 1868.7705 34.2134 11213.1629 5.6953 834.1920 76.6571 154.3216 413.3838 1839.9833 34.7428 857.8494 74.5256 1227.3743 52.1246 181.3330 351.7460 1878.4478 34.0360 134.9333 471.8157 392.84 81.35 531.53 240.65 8956.37 14.28 24355.33 5.24 2409.76 53.08 1092.75 29.23 41472.25 2.94 10197.22 12.54 3189.70 40.11 64056.00 0.77 608345894 127451 9385652 932034 616573385 20.6673 20.7789 82.5113 34.0487 31.5793 33.3694 874 867 1026 11575 23884 11658 23687 13639 33976 226 223 265 3591 6380 3544 6399 4173 7043 OpenBenchmarking.org
High Performance Conjugate Gradient X Y Z: 104 104 104 - RT: 60 OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 104 104 104 - RT: 60 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 16 32 48 64 80 SE +/- 0.19, N = 3 SE +/- 0.12, N = 3 SE +/- 0.14, N = 3 SE +/- 0.32, N = 3 71.14 71.13 72.46 71.13 -lmpi_cxx -lmpi_cxx -lmpi_cxx 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi
High Performance Conjugate Gradient X Y Z: 144 144 144 - RT: 60 OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 16 32 48 64 80 SE +/- 0.52, N = 3 SE +/- 0.83, N = 4 SE +/- 0.27, N = 3 SE +/- 0.59, N = 3 69.34 69.17 70.38 70.12 -lmpi_cxx -lmpi_cxx -lmpi_cxx 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi
LeelaChessZero Backend: BLAS OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.30 Backend: BLAS Ubuntu Linux 23.10 4 8 12 16 20 SE +/- 1.18, N = 9 15 1. (CXX) g++ options: -flto -pthread
LeelaChessZero Backend: Eigen OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.30 Backend: Eigen Ubuntu Linux 23.10 80 160 240 320 400 SE +/- 4.52, N = 4 380 1. (CXX) g++ options: -flto -pthread
Quicksilver Input: CTS2 OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CTS2 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 1.7M 3.4M 5.1M 6.8M 8.5M SE +/- 80526.35, N = 9 SE +/- 121572.66, N = 6 SE +/- 90618.71, N = 4 SE +/- 67222.68, N = 9 7680222 7398333 7367500 7723667 1. (CXX) g++ options: -fopenmp -O3 -march=native
Quicksilver Input: CORAL2 P1 OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CORAL2 P1 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 1.3M 2.6M 3.9M 5.2M 6.5M SE +/- 65941.38, N = 12 SE +/- 105910.76, N = 12 SE +/- 42699.12, N = 11 SE +/- 55910.49, N = 6 5931500 5800833 5835818 5865500 1. (CXX) g++ options: -fopenmp -O3 -march=native
Quicksilver Input: CORAL2 P2 OpenBenchmarking.org Figure Of Merit, More Is Better Quicksilver 20230818 Input: CORAL2 P2 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 1.5M 3M 4.5M 6M 7.5M SE +/- 81512.06, N = 9 SE +/- 51868.42, N = 3 SE +/- 74346.22, N = 5 SE +/- 67285.55, N = 9 6744778 6381000 6759600 7013889 1. (CXX) g++ options: -fopenmp -O3 -march=native
CloverLeaf Input: clover_bm16 OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm16 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 80 160 240 320 400 SE +/- 3.60, N = 3 SE +/- 1.51, N = 3 SE +/- 1.01, N = 3 SE +/- 4.10, N = 3 279.21 314.49 255.39 356.23 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
CloverLeaf Input: clover_bm64_short OpenBenchmarking.org Seconds, Fewer Is Better CloverLeaf 1.3 Input: clover_bm64_short Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 7 14 21 28 35 SE +/- 0.23, N = 11 SE +/- 0.12, N = 3 SE +/- 0.40, N = 3 SE +/- 0.27, N = 3 32.10 25.01 31.63 30.30 1. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
NAMD Input: ATPase with 327,506 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: ATPase with 327,506 Atoms Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 1.2599 2.5198 3.7797 5.0396 6.2995 SE +/- 0.33618, N = 15 SE +/- 0.30866, N = 12 SE +/- 0.33952, N = 15 SE +/- 0.21129, N = 12 4.70711 3.20328 5.40706 5.59956
NAMD Input: STMV with 1,066,628 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0b6 Input: STMV with 1,066,628 Atoms Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 0.4342 0.8684 1.3026 1.7368 2.171 SE +/- 0.14829, N = 15 SE +/- 0.04889, N = 12 SE +/- 0.05361, N = 15 SE +/- 0.07631, N = 15 1.49004 0.50251 1.92977 1.74784
NWChem Input: C240 Buckyball OpenBenchmarking.org Seconds, Fewer Is Better NWChem 7.0.2 Input: C240 Buckyball Ubuntu Linux 23.10 400 800 1200 1600 2000 1750.3 1. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2
Xcompact3d Incompact3d Input: X3D-benchmarking input.i3d OpenBenchmarking.org Seconds, Fewer Is Better Xcompact3d Incompact3d 2021-03-11 Input: X3D-benchmarking input.i3d Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 40 80 120 160 200 SE +/- 0.44, N = 3 SE +/- 0.56, N = 3 SE +/- 0.67, N = 3 SE +/- 0.25, N = 3 169.18 184.19 168.67 187.27 -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz 1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
LAMMPS Molecular Dynamics Simulator Model: 20k Atoms OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: 20k Atoms Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 14 28 42 56 70 SE +/- 0.42, N = 3 SE +/- 0.46, N = 3 SE +/- 0.40, N = 3 SE +/- 0.44, N = 3 56.68 57.84 57.68 62.99 1. (CXX) g++ options: -O3 -lm -ldl
LAMMPS Molecular Dynamics Simulator Model: Rhodopsin Protein OpenBenchmarking.org ns/day, More Is Better LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: Rhodopsin Protein Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 10 20 30 40 50 SE +/- 0.93, N = 15 SE +/- 0.76, N = 15 SE +/- 0.95, N = 15 SE +/- 0.85, N = 12 37.52 39.80 39.01 42.75 1. (CXX) g++ options: -O3 -lm -ldl
easyWave Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 OpenBenchmarking.org Seconds, Fewer Is Better easyWave r34 Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 40 80 120 160 200 SE +/- 8.98, N = 12 SE +/- 10.40, N = 12 SE +/- 15.88, N = 12 SE +/- 7.11, N = 12 177.75 205.01 156.24 145.71 1. (CXX) g++ options: -O3 -fopenmp
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Crown Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 30 60 90 120 150 SE +/- 0.25, N = 3 SE +/- 1.24, N = 15 SE +/- 1.32, N = 15 SE +/- 0.13, N = 3 100.34 105.62 142.17 118.74 MIN: 95.92 / MAX: 109.46 MIN: 95.01 / MAX: 132.75 MIN: 115.81 / MAX: 164.58 MIN: 113.06 / MAX: 135.85
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.3 Binary: Pathtracer ISPC - Model: Asian Dragon Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 40 80 120 160 200 SE +/- 0.50, N = 3 SE +/- 3.90, N = 15 SE +/- 0.73, N = 3 SE +/- 0.19, N = 3 144.92 177.80 179.54 148.60 MIN: 137.85 / MAX: 155.04 MIN: 142.88 / MAX: 210.57 MIN: 145.33 / MAX: 207.47 MIN: 140.37 / MAX: 169.21
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 4 - Input: Bosphorus 4K Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 0.5389 1.0778 1.6167 2.1556 2.6945 SE +/- 0.007, N = 3 SE +/- 0.009, N = 3 SE +/- 0.008, N = 3 SE +/- 0.009, N = 3 2.307 2.358 2.346 2.395 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 8 - Input: Bosphorus 4K Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 5 10 15 20 25 SE +/- 0.19, N = 3 SE +/- 0.21, N = 3 SE +/- 0.10, N = 3 SE +/- 0.08, N = 3 21.32 21.56 21.16 22.05 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 12 - Input: Bosphorus 4K Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 16 32 48 64 80 SE +/- 0.48, N = 15 SE +/- 0.39, N = 3 SE +/- 0.99, N = 3 SE +/- 0.15, N = 3 66.86 69.87 71.52 73.72 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.8 Encoder Mode: Preset 13 - Input: Bosphorus 4K Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 16 32 48 64 80 SE +/- 0.74, N = 5 SE +/- 0.99, N = 3 SE +/- 0.53, N = 3 SE +/- 0.36, N = 3 66.43 69.72 70.87 72.91 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Fast Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 0.6525 1.305 1.9575 2.61 3.2625 SE +/- 0.035, N = 3 SE +/- 0.026, N = 3 SE +/- 0.017, N = 3 SE +/- 0.007, N = 3 2.785 2.823 2.834 2.900 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Faster Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 1.337 2.674 4.011 5.348 6.685 SE +/- 0.061, N = 4 SE +/- 0.013, N = 3 SE +/- 0.035, N = 3 SE +/- 0.050, N = 3 5.611 5.808 5.804 5.942 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
ACES DGEMM Sustained Floating-Point Rate OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 14 28 42 56 70 SE +/- 0.09, N = 3 SE +/- 0.51, N = 3 SE +/- 0.04, N = 3 SE +/- 0.91, N = 13 37.97 63.64 37.72 43.67 1. (CC) gcc options: -O3 -march=native -fopenmp
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 1.134 2.268 3.402 4.536 5.67 SE +/- 0.02, N = 3 SE +/- 0.07, N = 3 SE +/- 0.06, N = 3 SE +/- 0.01, N = 3 4.53 5.04 4.68 4.75
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 1.1025 2.205 3.3075 4.41 5.5125 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 SE +/- 0.03, N = 15 SE +/- 0.02, N = 3 4.54 4.90 4.70 4.75
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.2 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 0.5648 1.1296 1.6944 2.2592 2.824 SE +/- 0.01, N = 3 SE +/- 0.03, N = 4 SE +/- 0.01, N = 15 SE +/- 0.03, N = 3 2.18 2.51 2.25 2.36
OpenVKL Benchmark: vklBenchmarkCPU ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 2.0.0 Benchmark: vklBenchmarkCPU ISPC Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 600 1200 1800 2400 3000 SE +/- 20.99, N = 3 SE +/- 33.05, N = 3 SE +/- 22.66, N = 3 SE +/- 20.04, N = 3 2821 2815 2821 2951 MIN: 175 / MAX: 34505 MIN: 186 / MAX: 35204 MIN: 178 / MAX: 36193 MIN: 193 / MAX: 35719
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 160K 320K 480K 640K 800K SE +/- 4291.24, N = 3 SE +/- 5583.39, N = 15 SE +/- 4508.27, N = 7 SE +/- 9120.21, N = 15 464813 751070 496138 759279 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 100K 200K 300K 400K 500K SE +/- 39319.74, N = 3 SE +/- 2615.74, N = 15 SE +/- 14994.49, N = 7 SE +/- 19128.23, N = 15 455056 434200 428601 482076 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
Y-Cruncher Pi Digits To Calculate: 1B OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 1B Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 2 4 6 8 10 SE +/- 0.037, N = 3 SE +/- 0.045, N = 3 SE +/- 0.088, N = 5 SE +/- 0.109, N = 3 7.207 7.913 8.270 7.561
Y-Cruncher Pi Digits To Calculate: 5B OpenBenchmarking.org Seconds, Fewer Is Better Y-Cruncher 0.8.3 Pi Digits To Calculate: 5B Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 8 16 24 32 40 SE +/- 0.07, N = 3 SE +/- 0.17, N = 3 SE +/- 0.43, N = 3 SE +/- 0.37, N = 5 29.82 32.85 33.73 33.65
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 50 100 150 200 250 SE +/- 2.70, N = 3 SE +/- 0.84, N = 3 SE +/- 2.54, N = 3 SE +/- 2.35, N = 3 205.20 183.62 188.71 209.64 MIN: 35.4 / MAX: 1818.18 MIN: 34.56 / MAX: 1714.29 MIN: 30.08 / MAX: 1428.57 MIN: 32.84 / MAX: 1764.71
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 50 100 150 200 250 SE +/- 1.67, N = 3 SE +/- 3.30, N = 3 SE +/- 1.90, N = 3 SE +/- 1.76, N = 3 214.31 200.18 202.14 221.80 MIN: 36.39 / MAX: 1764.71 MIN: 37.41 / MAX: 2000 MIN: 36.41 / MAX: 1463.41 MIN: 36.97 / MAX: 1875
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 50 100 150 200 250 SE +/- 3.81, N = 3 SE +/- 2.16, N = 3 SE +/- 3.01, N = 3 SE +/- 0.45, N = 3 215.62 201.05 206.83 221.71 MIN: 37.43 / MAX: 1714.29 MIN: 36.08 / MAX: 1500 MIN: 35.91 / MAX: 1935.48 MIN: 35.63 / MAX: 2068.97
Memcached Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:10 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 1.2M 2.4M 3.6M 4.8M 6M SE +/- 36897.17, N = 5 SE +/- 43085.73, N = 13 SE +/- 65254.44, N = 3 SE +/- 45099.83, N = 8 3370014.38 3337339.10 5054518.76 5462773.67 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Memcached Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.19 Set To Get Ratio: 1:100 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 2M 4M 6M 8M 10M SE +/- 20632.12, N = 3 SE +/- 20448.57, N = 10 SE +/- 380886.14, N = 12 SE +/- 121500.81, N = 15 3477137.28 2615816.73 8983240.52 9633352.44 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Redis Test: GET - Parallel Connections: 500 OpenBenchmarking.org Requests Per Second, More Is Better Redis 7.0.4 Test: GET - Parallel Connections: 500 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 400K 800K 1200K 1600K 2000K SE +/- 15103.72, N = 15 SE +/- 19161.91, N = 15 SE +/- 30474.05, N = 15 SE +/- 19370.21, N = 15 1541713.80 1821521.39 1838671.43 1777534.65 1. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
Redis Test: SET - Parallel Connections: 500 OpenBenchmarking.org Requests Per Second, More Is Better Redis 7.0.4 Test: SET - Parallel Connections: 500 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 500K 1000K 1500K 2000K 2500K SE +/- 48178.71, N = 15 SE +/- 47416.25, N = 15 SE +/- 73166.31, N = 15 SE +/- 46614.18, N = 15 2134872.89 1978937.18 2125843.97 2231227.61 1. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
Graph500 Scale: 26 OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 300M 600M 900M 1200M 1500M 1226550000 1464120000 1195510000 1275690000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 300M 600M 900M 1200M 1500M 1289580000 1499600000 1253250000 1323480000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 110M 220M 330M 440M 550M 483534000 466398000 493031000 509964000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 150M 300M 450M 600M 750M 664991000 640794000 663412000 692893000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 4 8 12 16 20 SE +/- 1.403, N = 7 SE +/- 0.323, N = 12 SE +/- 0.850, N = 12 SE +/- 1.257, N = 15 9.630 5.939 7.180 13.638 1. (CXX) g++ options: -O3 -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Ubuntu Linux 23.10 Arch Linux 150K 300K 450K 600K 750K SE +/- 22056.84, N = 12 SE +/- 16477.93, N = 12 679317 698734 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Ubuntu Linux 23.10 Arch Linux 0.335 0.67 1.005 1.34 1.675 SE +/- 0.047, N = 12 SE +/- 0.035, N = 12 1.489 1.440 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Ubuntu Linux 23.10 Arch Linux 8K 16K 24K 32K 40K SE +/- 1662.84, N = 9 SE +/- 280.04, N = 12 39542 18536 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 16 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Ubuntu Linux 23.10 Arch Linux 12 24 36 48 60 SE +/- 0.97, N = 9 SE +/- 0.82, N = 12 25.62 54.09 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 20 40 60 80 100 SE +/- 0.84, N = 3 SE +/- 0.83, N = 4 SE +/- 0.61, N = 3 73.12 76.68 77.06
RawTherapee Total Benchmark Time OpenBenchmarking.org Seconds, Fewer Is Better RawTherapee Total Benchmark Time Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 30 60 90 120 150 SE +/- 0.65, N = 3 SE +/- 0.45, N = 3 SE +/- 0.34, N = 3 129.08 118.23 107.05 1. Ubuntu Linux 23.10: RawTherapee, version 5.9, command line. 2. Fedora Server 39: RawTherapee, version 5.10, command line. 3. Arch Linux: RawTherapee, version 5.10, command line.
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 30 60 90 120 150 SE +/- 0.29, N = 3 SE +/- 0.30, N = 3 SE +/- 0.47, N = 3 132.68 132.91 134.21
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 100 200 300 400 500 SE +/- 0.91, N = 3 SE +/- 0.62, N = 3 SE +/- 1.54, N = 3 478.76 478.03 474.24
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 1000 2000 3000 4000 5000 SE +/- 40.60, N = 7 SE +/- 40.12, N = 7 SE +/- 55.62, N = 3 4547.54 4462.53 4534.89
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 4 8 12 16 20 SE +/- 0.13, N = 7 SE +/- 0.13, N = 7 SE +/- 0.18, N = 3 14.06 14.32 14.10
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 400 800 1200 1600 2000 SE +/- 7.36, N = 3 SE +/- 4.86, N = 3 SE +/- 9.98, N = 3 1837.11 1863.34 1868.77
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 8 16 24 32 40 SE +/- 0.12, N = 3 SE +/- 0.09, N = 3 SE +/- 0.18, N = 3 34.76 34.29 34.21
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 2K 4K 6K 8K 10K SE +/- 102.73, N = 7 SE +/- 43.63, N = 3 SE +/- 102.84, N = 7 11099.64 11022.30 11213.16
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 1.3012 2.6024 3.9036 5.2048 6.506 SE +/- 0.0557, N = 7 SE +/- 0.0226, N = 3 SE +/- 0.0549, N = 7 5.7515 5.7833 5.6953
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 200 400 600 800 1000 SE +/- 5.31, N = 3 SE +/- 4.43, N = 3 SE +/- 2.18, N = 3 829.51 827.99 834.19
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 20 40 60 80 100 SE +/- 0.46, N = 3 SE +/- 0.41, N = 3 SE +/- 0.21, N = 3 77.02 77.17 76.66
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 30 60 90 120 150 SE +/- 0.87, N = 3 SE +/- 0.32, N = 3 SE +/- 1.36, N = 3 155.82 152.57 154.32
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 90 180 270 360 450 SE +/- 2.51, N = 3 SE +/- 0.86, N = 3 SE +/- 3.56, N = 3 409.01 416.68 413.38
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 400 800 1200 1600 2000 SE +/- 16.26, N = 3 SE +/- 3.56, N = 3 SE +/- 7.12, N = 3 1826.04 1866.52 1839.98
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 8 16 24 32 40 SE +/- 0.31, N = 3 SE +/- 0.07, N = 3 SE +/- 0.14, N = 3 34.99 34.23 34.74
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 200 400 600 800 1000 SE +/- 6.05, N = 3 SE +/- 8.06, N = 3 SE +/- 8.02, N = 3 853.21 853.34 857.85
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 20 40 60 80 100 SE +/- 0.50, N = 3 SE +/- 0.70, N = 3 SE +/- 0.70, N = 3 74.88 74.80 74.53
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 300 600 900 1200 1500 SE +/- 14.85, N = 3 SE +/- 15.64, N = 3 SE +/- 12.68, N = 3 1223.16 1223.65 1227.37
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 12 24 36 48 60 SE +/- 0.63, N = 3 SE +/- 0.70, N = 3 SE +/- 0.55, N = 3 52.28 52.24 52.12
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 40 80 120 160 200 SE +/- 1.16, N = 3 SE +/- 0.21, N = 3 SE +/- 2.15, N = 4 176.57 173.95 181.33
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 80 160 240 320 400 SE +/- 2.37, N = 3 SE +/- 0.14, N = 3 SE +/- 4.23, N = 4 361.29 366.38 351.75
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 400 800 1200 1600 2000 SE +/- 20.52, N = 3 SE +/- 16.06, N = 3 SE +/- 22.85, N = 3 1866.23 1810.95 1878.45
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 8 16 24 32 40 SE +/- 0.38, N = 3 SE +/- 0.32, N = 3 SE +/- 0.42, N = 3 34.25 35.28 34.04
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 30 60 90 120 150 SE +/- 0.24, N = 3 SE +/- 0.09, N = 3 SE +/- 0.39, N = 3 133.21 133.28 134.93
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.6 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Ubuntu Linux 23.10 CentOS Stream 9 Arch Linux 100 200 300 400 500 SE +/- 0.78, N = 3 SE +/- 0.34, N = 3 SE +/- 1.04, N = 3 477.14 476.58 471.82
GPAW Input: Carbon Nanotube OpenBenchmarking.org Seconds, Fewer Is Better GPAW 23.6 Input: Carbon Nanotube Ubuntu Linux 23.10 Fedora Server 39 40 80 120 160 200 SE +/- 0.35, N = 15 SE +/- 0.94, N = 3 38.64 194.51 -fwrapv -O2 -fno-strict-overflow -fcf-protection -fexceptions -fPIC -UNDEBUG -std=c99 1. (CC) gcc options: -shared -lxc -lblas -lmpi
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 90 180 270 360 450 SE +/- 0.48, N = 3 SE +/- 2.69, N = 3 SE +/- 0.63, N = 3 SE +/- 0.49, N = 3 375.75 328.37 340.97 392.84 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Person Detection FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 0.81, N = 3 SE +/- 0.18, N = 3 SE +/- 0.10, N = 3 85.06 97.34 93.74 81.35 -pie - MIN: 39.38 / MAX: 260.96 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.82 / MAX: 325.84 -pie - MIN: 34.75 / MAX: 283.24 -pie - MIN: 38.9 / MAX: 148.69 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 110 220 330 440 550 SE +/- 5.90, N = 4 SE +/- 1.20, N = 3 SE +/- 6.06, N = 4 SE +/- 6.17, N = 4 519.83 528.79 529.14 531.53 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Face Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 50 100 150 200 250 SE +/- 2.84, N = 4 SE +/- 0.55, N = 3 SE +/- 2.84, N = 4 SE +/- 2.90, N = 4 245.98 241.67 241.70 240.65 -pie - MIN: 176.44 / MAX: 390.61 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 160.04 / MAX: 556.9 -pie - MIN: 163.92 / MAX: 559.83 -pie - MIN: 175.12 / MAX: 455.8 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 2K 4K 6K 8K 10K SE +/- 20.48, N = 3 SE +/- 7.04, N = 3 SE +/- 9.74, N = 3 SE +/- 34.95, N = 3 8901.61 8908.74 8862.07 8956.37 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 14.37 14.36 14.43 14.28 -pie - MIN: 12.05 / MAX: 72.49 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 12.55 / MAX: 76.83 -pie - MIN: 12.18 / MAX: 71.66 -pie - MIN: 12.05 / MAX: 46.92 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 5K 10K 15K 20K 25K SE +/- 208.25, N = 3 SE +/- 36.89, N = 3 SE +/- 130.19, N = 3 SE +/- 269.84, N = 3 24570.10 24295.71 24296.54 24355.33 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Face Detection Retail FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Face Detection Retail FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 1.1813 2.3626 3.5439 4.7252 5.9065 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 SE +/- 0.03, N = 3 SE +/- 0.06, N = 3 5.20 5.25 5.25 5.24 -pie - MIN: 4.59 / MAX: 31.78 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 4.69 / MAX: 58.72 -pie - MIN: 4.62 / MAX: 31.26 -pie - MIN: 4.62 / MAX: 25.2 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 500 1000 1500 2000 2500 SE +/- 15.67, N = 3 SE +/- 10.50, N = 3 SE +/- 4.46, N = 3 SE +/- 6.39, N = 3 2377.90 2412.51 2383.22 2409.76 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Road Segmentation ADAS FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Road Segmentation ADAS FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 12 24 36 48 60 SE +/- 0.36, N = 3 SE +/- 0.23, N = 3 SE +/- 0.10, N = 3 SE +/- 0.14, N = 3 53.79 53.02 53.67 53.08 -pie - MIN: 44.62 / MAX: 198.12 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 42.98 / MAX: 178.63 -pie - MIN: 43.29 / MAX: 161.25 -pie - MIN: 44.51 / MAX: 131.9 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 200 400 600 800 1000 SE +/- 4.60, N = 3 SE +/- 13.25, N = 15 SE +/- 8.04, N = 9 SE +/- 11.59, N = 3 1143.25 617.45 978.70 1092.75 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 12 24 36 48 60 SE +/- 0.11, N = 3 SE +/- 1.14, N = 15 SE +/- 0.27, N = 9 SE +/- 0.30, N = 3 27.93 52.09 32.67 29.23 -pie - MIN: 19.99 / MAX: 261.46 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 17.25 / MAX: 578.83 -pie - MIN: 19.33 / MAX: 484.58 -pie - MIN: 21.95 / MAX: 117.93 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 9K 18K 27K 36K 45K SE +/- 43.54, N = 3 SE +/- 347.22, N = 3 SE +/- 194.22, N = 3 SE +/- 312.18, N = 3 43516.98 40187.34 42419.89 41472.25 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 0.6795 1.359 2.0385 2.718 3.3975 SE +/- 0.00, N = 3 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 2.85 3.02 2.86 2.94 -pie - MIN: 2.08 / MAX: 32.04 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 2.07 / MAX: 29.73 -pie - MIN: 1.94 / MAX: 41.9 -pie - MIN: 2.09 / MAX: 30.51 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 2K 4K 6K 8K 10K SE +/- 140.94, N = 3 SE +/- 104.96, N = 5 SE +/- 124.93, N = 4 SE +/- 125.31, N = 3 10033.95 10113.47 10082.93 10197.22 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 3 6 9 12 15 SE +/- 0.18, N = 3 SE +/- 0.14, N = 5 SE +/- 0.16, N = 4 SE +/- 0.16, N = 3 12.74 12.65 12.69 12.54 -pie - MIN: 10.88 / MAX: 73.62 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 10.9 / MAX: 74.36 -pie - MIN: 10.9 / MAX: 75.69 -pie - MIN: 10.74 / MAX: 50.52 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 700 1400 2100 2800 3500 SE +/- 1.65, N = 3 SE +/- 1.03, N = 3 SE +/- 4.78, N = 3 SE +/- 3.83, N = 3 3217.84 3196.47 3255.16 3189.70 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Handwritten English Recognition FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Handwritten English Recognition FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 9 18 27 36 45 SE +/- 0.02, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 39.76 40.02 39.30 40.11 -pie - MIN: 37.84 / MAX: 104.98 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.6 / MAX: 102.02 -pie - MIN: 33.26 / MAX: 101.52 -pie - MIN: 38.25 / MAX: 97.25 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 14K 28K 42K 56K 70K SE +/- 827.51, N = 15 SE +/- 478.67, N = 3 SE +/- 271.02, N = 3 SE +/- 941.42, N = 15 61020.16 60429.54 56624.98 64056.00 -pie -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF -pie -pie 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2023.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 0.1868 0.3736 0.5604 0.7472 0.934 SE +/- 0.00, N = 15 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 SE +/- 0.01, N = 15 0.80 0.83 0.83 0.77 -pie - MIN: 0.2 / MAX: 28.24 -isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 0.21 / MAX: 20.36 -pie - MIN: 0.2 / MAX: 31.65 -pie - MIN: 0.19 / MAX: 28.17 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Random Read Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 140M 280M 420M 560M 700M SE +/- 7527805.83, N = 15 SE +/- 3865049.53, N = 3 SE +/- 7708164.70, N = 3 599822046 652854125 608345894 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Update Random Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 30K 60K 90K 120K 150K SE +/- 440.29, N = 3 SE +/- 1187.74, N = 3 SE +/- 1143.37, N = 3 125560 123092 127451 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Read While Writing Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 2M 4M 6M 8M 10M SE +/- 81611.31, N = 8 SE +/- 133209.05, N = 14 SE +/- 87416.61, N = 3 9775989 8567006 9385652 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Read Random Write Random Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 300K 600K 900K 1200K 1500K SE +/- 5328.60, N = 3 SE +/- 13512.70, N = 15 SE +/- 9325.25, N = 15 955461 1184837 932034 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
Speedb Test: Random Read OpenBenchmarking.org Op/s, More Is Better Speedb 2.7 Test: Random Read Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 130M 260M 390M 520M 650M SE +/- 5282775.06, N = 8 SE +/- 8524314.28, N = 3 SE +/- 6923132.62, N = 4 600703384 626261826 616573385 -lpthread 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/ao/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 5 10 15 20 25 SE +/- 0.04, N = 3 SE +/- 0.01, N = 3 SE +/- 0.06, N = 3 SE +/- 0.05, N = 3 20.65 20.50 20.44 20.67
OSPRay Benchmark: particle_volume/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/scivis/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 5 10 15 20 25 SE +/- 0.08, N = 3 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 SE +/- 0.04, N = 3 20.77 20.44 20.54 20.78
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: particle_volume/pathtracer/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 20 40 60 80 100 SE +/- 0.35, N = 3 SE +/- 0.23, N = 3 SE +/- 0.58, N = 3 SE +/- 0.87, N = 4 82.97 83.57 82.14 82.51
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 8 16 24 32 40 SE +/- 0.05, N = 3 SE +/- 0.26, N = 15 SE +/- 0.10, N = 3 SE +/- 0.29, N = 3 28.61 29.76 28.66 34.05
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 7 14 21 28 35 SE +/- 0.11, N = 3 SE +/- 0.17, N = 3 SE +/- 0.17, N = 3 SE +/- 0.48, N = 15 28.92 29.51 28.43 31.58
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 3.1 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time Ubuntu Linux 23.10 CentOS Stream 9 Fedora Server 39 Arch Linux 8 16 24 32 40 SE +/- 0.05, N = 3 SE +/- 0.48, N = 15 SE +/- 0.12, N = 3 SE +/- 0.10, N = 3 32.32 33.29 31.70 33.37
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 200 400 600 800 1000 SE +/- 3.48, N = 3 SE +/- 9.82, N = 4 SE +/- 3.93, N = 3 914 902 874
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 200 400 600 800 1000 SE +/- 3.53, N = 3 SE +/- 2.03, N = 3 SE +/- 3.18, N = 3 911 897 867
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 200 400 600 800 1000 SE +/- 2.40, N = 3 SE +/- 2.96, N = 3 SE +/- 2.33, N = 3 1079 1058 1026
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 3K 6K 9K 12K 15K SE +/- 3.51, N = 3 SE +/- 22.15, N = 3 SE +/- 32.00, N = 3 12086 12187 11575
OSPRay Studio Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 7K 14K 21K 28K 35K SE +/- 481.26, N = 15 SE +/- 1257.60, N = 15 SE +/- 740.65, N = 15 32279 28035 23884
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 3K 6K 9K 12K 15K SE +/- 25.12, N = 3 SE +/- 36.03, N = 3 SE +/- 13.00, N = 3 12243 12262 11658
OSPRay Studio Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 7K 14K 21K 28K 35K SE +/- 600.94, N = 15 SE +/- 1255.46, N = 15 SE +/- 467.39, N = 15 33174 27524 23687
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 3K 6K 9K 12K 15K SE +/- 177.62, N = 4 SE +/- 37.95, N = 3 SE +/- 37.30, N = 3 14508 14422 13639
OSPRay Studio Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 8K 16K 24K 32K 40K SE +/- 564.37, N = 15 SE +/- 119.27, N = 3 SE +/- 138.45, N = 3 37285 34698 33976
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.88, N = 3 SE +/- 0.33, N = 3 234 235 226
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 50 100 150 200 250 SE +/- 0.33, N = 3 SE +/- 0.33, N = 3 SE +/- 0.00, N = 3 233 233 223
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 60 120 180 240 300 SE +/- 0.00, N = 3 SE +/- 1.45, N = 3 SE +/- 0.67, N = 3 276 276 265
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 800 1600 2400 3200 4000 SE +/- 3.21, N = 3 SE +/- 16.22, N = 3 SE +/- 21.20, N = 3 3718 3683 3591
OSPRay Studio Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 1400 2800 4200 5600 7000 SE +/- 77.79, N = 4 SE +/- 13.35, N = 3 SE +/- 40.01, N = 3 6448 6314 6380
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 800 1600 2400 3200 4000 SE +/- 7.45, N = 3 SE +/- 43.59, N = 3 SE +/- 5.13, N = 3 3694 3655 3544
OSPRay Studio Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 1400 2800 4200 5600 7000 SE +/- 60.98, N = 6 SE +/- 28.01, N = 3 SE +/- 44.43, N = 3 6324 6303 6399
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 900 1800 2700 3600 4500 SE +/- 47.59, N = 4 SE +/- 21.55, N = 3 SE +/- 13.25, N = 3 4353 4377 4173
OSPRay Studio Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 1.0 Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU Ubuntu Linux 23.10 Fedora Server 39 Arch Linux 1600 3200 4800 6400 8000 SE +/- 31.90, N = 3 SE +/- 91.12, N = 4 SE +/- 29.16, N = 3 7321 7424 7043
Phoronix Test Suite v10.8.4