Linux Distros Emerald Rapids

Benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2403039-NE-2403025NE90
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

BLAS (Basic Linear Algebra Sub-Routine) Tests 3 Tests
C/C++ Compiler Tests 5 Tests
CPU Massive 10 Tests
Creator Workloads 9 Tests
Database Test Suite 5 Tests
Encoding 2 Tests
Fortran Tests 5 Tests
Game Development 2 Tests
HPC - High Performance Computing 14 Tests
Common Kernel Benchmarks 2 Tests
Machine Learning 4 Tests
Molecular Dynamics 6 Tests
MPI Benchmarks 5 Tests
Multi-Core 15 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 6 Tests
OpenMPI Tests 8 Tests
Python Tests 4 Tests
Raytracing 2 Tests
Renderers 2 Tests
Scientific Computing 8 Tests
Server 6 Tests
Server CPU Tests 4 Tests
Video Encoding 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Ubuntu Linux 23.10
February 25
  20 Hours, 3 Minutes
CentOS Stream 9
February 26
  13 Hours, 36 Minutes
Fedora Server 39
March 02
  17 Hours, 42 Minutes
Arch Linux
March 03
  17 Hours, 43 Minutes
Invert Hiding All Results Option
  17 Hours, 16 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Linux Distros Emerald Rapids - Phoronix Test Suite

Linux Distros Emerald Rapids

Benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2403039-NE-2403025NE90.

Linux Distros Emerald RapidsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionDesktopDisplay ServerUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-17-generic (x86_64)GCC 13.2.0ext41024x7683201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash DriveCentOS Stream 95.14.0-419.el9.x86_64 (x86_64)GNOME Shell 40.10X ServerGCC 11.4.1 20231218xfs1920x1200Fedora Linux 396.7.6-200.fc39.x86_64 (x86_64)GCC 13.2.1 202312051024x768Arch Linux6.7.6-arch1-2 (x86_64)GCC 13.2.1 20230801btrfs1920x1200OpenBenchmarking.orgKernel Details- Ubuntu Linux 23.10: Transparent Huge Pages: madvise- CentOS Stream 9: Transparent Huge Pages: always- Fedora Server 39: Transparent Huge Pages: madvise- Arch Linux: Transparent Huge Pages: alwaysCompiler Details- Ubuntu Linux 23.10: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - CentOS Stream 9: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl - Fedora Server 39: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - Arch Linux: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,m2,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu Processor Details- Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Python Details- Ubuntu Linux 23.10: Python 3.11.6- CentOS Stream 9: Python 3.9.18- Fedora Server 39: Python 3.12.2- Arch Linux: Python 3.11.7Security Details- Ubuntu Linux 23.10: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - CentOS Stream 9: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Fedora Server 39: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Arch Linux: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Linux Distros Emerald Rapidshpcg: 104 104 104 - 60hpcg: 144 144 144 - 60lczero: BLASlczero: Eigenquicksilver: CTS2quicksilver: CORAL2 P1quicksilver: CORAL2 P2cloverleaf: clover_bm16cloverleaf: clover_bm64_shortnamd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomsnwchem: C240 Buckyballincompact3d: X3D-benchmarking input.i3dlammps: 20k Atomslammps: Rhodopsin Proteineasywave: e2Asean Grid + BengkuluSept2007 Source - 2400embree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fastermt-dgemm: Sustained Floating-Point Rateoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyopenvkl: vklBenchmarkCPU ISPCcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingy-cruncher: 1By-cruncher: 5Bclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runmemcached: 1:10memcached: 1:100redis: GET - 500redis: SET - 500graph500: 26graph500: 26graph500: 26graph500: 26gromacs: MPI CPU - water_GMX50_barepgbench: 100 - 1000 - Read Onlypgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Write - Average Latencytensorflow: CPU - 512 - ResNet-50rawtherapee: Total Benchmark Timedeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamgpaw: Carbon Nanotubeopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUrocksdb: Rand Readrocksdb: Update Randrocksdb: Read While Writingrocksdb: Read Rand Write Randspeedb: Rand Readospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 2 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 2 - 4K - 16 - Path Tracer - CPUospray-studio: 2 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray-studio: 1 - 1080p - 1 - Path Tracer - CPUospray-studio: 2 - 1080p - 1 - Path Tracer - CPUospray-studio: 3 - 1080p - 1 - Path Tracer - CPUospray-studio: 1 - 1080p - 16 - Path Tracer - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUospray-studio: 2 - 1080p - 16 - Path Tracer - CPUospray-studio: 2 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 1080p - 16 - Path Tracer - CPUospray-studio: 3 - 1080p - 32 - Path Tracer - CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux71.137169.336215380768022259315006744778279.2132.104.707111.490041750.3169.17857956.68337.518177.754100.3399144.91952.30721.31766.85766.4302.7855.61137.9710184.534.542.1828214648134550567.20729.821205.20214.31215.623370014.383477137.281541713.802134872.89122655000012895800004835340006649910009.6306793171.4893954225.61673.12129.079132.6789478.76314547.539514.05731837.111334.760311099.64405.7515829.506377.0180155.8178409.00891826.044734.9884853.207974.88381223.163952.2774176.5691361.28771866.225934.2545133.2063477.136238.637375.7585.06519.83245.988901.6114.3724570.105.202377.9053.791143.2527.9343516.982.8510033.9512.743217.8439.7661020.160.80599822046125560977598995546160070338420.654620.772582.970028.608828.916232.3212914911107912086322791224333174145083728523423327637186448369463244353732171.133269.1728739833358008336381000314.4925.013.203280.50251184.19233257.83639.795205.005105.6194177.79602.35821.56069.86869.7182.8235.80863.6358405.044.902.5128157510704342007.91332.850183.62200.18201.053337339.102615816.731821521.391978937.18146412000014996000004663980006407940005.93976.68132.9101478.03154462.525514.31821863.342934.290611022.30205.7833827.991477.1671152.5678416.68161866.515334.2262853.337474.80381223.647052.2360173.9515366.38311810.950835.2846133.2818476.5785328.3797.34528.79241.678908.7414.3624295.715.252412.5153.02617.4552.0940187.343.0210113.4712.653196.4740.0260429.540.8320.502120.442783.565229.762629.510433.293872.457570.3805736750058358186759600255.3931.635.407061.92977168.67181957.67739.009156.237142.1675179.54032.34621.16171.51870.8742.8345.80437.7200764.684.702.2528214961384286018.27033.734188.71202.14206.835054518.768983240.521838671.432125843.97119551000012532500004930310006634120007.180118.228194.508340.9793.74529.14241.708862.0714.4324296.545.252383.2253.67978.7032.6742419.892.8610082.9312.693255.1639.3056624.980.836528541251230928567006118483762626182620.444220.541982.138028.663728.43031.6999902897105812187280351226227524144223469823523327636836314365563034377742471.129270.1210772366758655007013889356.2330.305.599561.74784187.26659662.99042.751145.713118.7400148.60222.39522.04673.71772.9062.9005.94243.6692344.754.752.3629517592794820767.56133.652209.64221.80221.715462773.679633352.441777534.652231227.611275690000132348000050996400069289300013.6386987341.4401853654.08577.06107.048134.2065474.24194534.894614.09591868.770534.213411213.16295.6953834.192076.6571154.3216413.38381839.983334.7428857.849474.52561227.374352.1246181.3330351.74601878.447834.0360134.9333471.8157392.8481.35531.53240.658956.3714.2824355.335.242409.7653.081092.7529.2341472.252.9410197.2212.543189.7040.1164056.000.77608345894127451938565293203461657338520.667320.778982.511334.048731.579333.36948748671026115752388411658236871363933976226223265359163803544639941737043OpenBenchmarking.org

High Performance Conjugate Gradient

X Y Z: 104 104 104 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 104 104 104 - RT: 60Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1632486480SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 3SE +/- 0.32, N = 371.1471.1372.4671.13-lmpi_cxx-lmpi_cxx-lmpi_cxx1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi

High Performance Conjugate Gradient

X Y Z: 144 144 144 - RT: 60

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1632486480SE +/- 0.52, N = 3SE +/- 0.83, N = 4SE +/- 0.27, N = 3SE +/- 0.59, N = 369.3469.1770.3870.12-lmpi_cxx-lmpi_cxx-lmpi_cxx1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi

LeelaChessZero

Backend: BLAS

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASUbuntu Linux 23.1048121620SE +/- 1.18, N = 9151. (CXX) g++ options: -flto -pthread

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenUbuntu Linux 23.1080160240320400SE +/- 4.52, N = 43801. (CXX) g++ options: -flto -pthread

Quicksilver

Input: CTS2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CTS2Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.7M3.4M5.1M6.8M8.5MSE +/- 80526.35, N = 9SE +/- 121572.66, N = 6SE +/- 90618.71, N = 4SE +/- 67222.68, N = 976802227398333736750077236671. (CXX) g++ options: -fopenmp -O3 -march=native

Quicksilver

Input: CORAL2 P1

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.3M2.6M3.9M5.2M6.5MSE +/- 65941.38, N = 12SE +/- 105910.76, N = 12SE +/- 42699.12, N = 11SE +/- 55910.49, N = 659315005800833583581858655001. (CXX) g++ options: -fopenmp -O3 -march=native

Quicksilver

Input: CORAL2 P2

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.5M3M4.5M6M7.5MSE +/- 81512.06, N = 9SE +/- 51868.42, N = 3SE +/- 74346.22, N = 5SE +/- 67285.55, N = 967447786381000675960070138891. (CXX) g++ options: -fopenmp -O3 -march=native

CloverLeaf

Input: clover_bm16

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux80160240320400SE +/- 3.60, N = 3SE +/- 1.51, N = 3SE +/- 1.01, N = 3SE +/- 4.10, N = 3279.21314.49255.39356.231. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

CloverLeaf

Input: clover_bm64_short

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux714212835SE +/- 0.23, N = 11SE +/- 0.12, N = 3SE +/- 0.40, N = 3SE +/- 0.27, N = 332.1025.0131.6330.301. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

NAMD

Input: ATPase with 327,506 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.25992.51983.77975.03966.2995SE +/- 0.33618, N = 15SE +/- 0.30866, N = 12SE +/- 0.33952, N = 15SE +/- 0.21129, N = 124.707113.203285.407065.59956

NAMD

Input: STMV with 1,066,628 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.43420.86841.30261.73682.171SE +/- 0.14829, N = 15SE +/- 0.04889, N = 12SE +/- 0.05361, N = 15SE +/- 0.07631, N = 151.490040.502511.929771.74784

NWChem

Input: C240 Buckyball

OpenBenchmarking.orgSeconds, Fewer Is BetterNWChem 7.0.2Input: C240 BuckyballUbuntu Linux 23.104008001200160020001750.31. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2

Xcompact3d Incompact3d

Input: X3D-benchmarking input.i3d

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200SE +/- 0.44, N = 3SE +/- 0.56, N = 3SE +/- 0.67, N = 3SE +/- 0.25, N = 3169.18184.19168.67187.27-lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1428425670SE +/- 0.42, N = 3SE +/- 0.46, N = 3SE +/- 0.40, N = 3SE +/- 0.44, N = 356.6857.8457.6862.991. (CXX) g++ options: -O3 -lm -ldl

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1020304050SE +/- 0.93, N = 15SE +/- 0.76, N = 15SE +/- 0.95, N = 15SE +/- 0.85, N = 1237.5239.8039.0142.751. (CXX) g++ options: -O3 -lm -ldl

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200SE +/- 8.98, N = 12SE +/- 10.40, N = 12SE +/- 15.88, N = 12SE +/- 7.11, N = 12177.75205.01156.24145.711. (CXX) g++ options: -O3 -fopenmp

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux306090120150SE +/- 0.25, N = 3SE +/- 1.24, N = 15SE +/- 1.32, N = 15SE +/- 0.13, N = 3100.34105.62142.17118.74MIN: 95.92 / MAX: 109.46MIN: 95.01 / MAX: 132.75MIN: 115.81 / MAX: 164.58MIN: 113.06 / MAX: 135.85

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200SE +/- 0.50, N = 3SE +/- 3.90, N = 15SE +/- 0.73, N = 3SE +/- 0.19, N = 3144.92177.80179.54148.60MIN: 137.85 / MAX: 155.04MIN: 142.88 / MAX: 210.57MIN: 145.33 / MAX: 207.47MIN: 140.37 / MAX: 169.21

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.53891.07781.61672.15562.6945SE +/- 0.007, N = 3SE +/- 0.009, N = 3SE +/- 0.008, N = 3SE +/- 0.009, N = 32.3072.3582.3462.3951. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux510152025SE +/- 0.19, N = 3SE +/- 0.21, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 321.3221.5621.1622.051. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1632486480SE +/- 0.48, N = 15SE +/- 0.39, N = 3SE +/- 0.99, N = 3SE +/- 0.15, N = 366.8669.8771.5273.721. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1632486480SE +/- 0.74, N = 5SE +/- 0.99, N = 3SE +/- 0.53, N = 3SE +/- 0.36, N = 366.4369.7270.8772.911. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.65251.3051.95752.613.2625SE +/- 0.035, N = 3SE +/- 0.026, N = 3SE +/- 0.017, N = 3SE +/- 0.007, N = 32.7852.8232.8342.9001. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.3372.6744.0115.3486.685SE +/- 0.061, N = 4SE +/- 0.013, N = 3SE +/- 0.035, N = 3SE +/- 0.050, N = 35.6115.8085.8045.9421. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

ACES DGEMM

Sustained Floating-Point Rate

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1428425670SE +/- 0.09, N = 3SE +/- 0.51, N = 3SE +/- 0.04, N = 3SE +/- 0.91, N = 1337.9763.6437.7243.671. (CC) gcc options: -O3 -march=native -fopenmp

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.1342.2683.4024.5365.67SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 34.535.044.684.75

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.10252.2053.30754.415.5125SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 15SE +/- 0.02, N = 34.544.904.704.75

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.56481.12961.69442.25922.824SE +/- 0.01, N = 3SE +/- 0.03, N = 4SE +/- 0.01, N = 15SE +/- 0.03, N = 32.182.512.252.36

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux6001200180024003000SE +/- 20.99, N = 3SE +/- 33.05, N = 3SE +/- 22.66, N = 3SE +/- 20.04, N = 32821281528212951MIN: 175 / MAX: 34505MIN: 186 / MAX: 35204MIN: 178 / MAX: 36193MIN: 193 / MAX: 35719

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux160K320K480K640K800KSE +/- 4291.24, N = 3SE +/- 5583.39, N = 15SE +/- 4508.27, N = 7SE +/- 9120.21, N = 154648137510704961387592791. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux100K200K300K400K500KSE +/- 39319.74, N = 3SE +/- 2615.74, N = 15SE +/- 14994.49, N = 7SE +/- 19128.23, N = 154550564342004286014820761. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810SE +/- 0.037, N = 3SE +/- 0.045, N = 3SE +/- 0.088, N = 5SE +/- 0.109, N = 37.2077.9138.2707.561

Y-Cruncher

Pi Digits To Calculate: 5B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 5BUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux816243240SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.43, N = 3SE +/- 0.37, N = 529.8232.8533.7333.65

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux50100150200250SE +/- 2.70, N = 3SE +/- 0.84, N = 3SE +/- 2.54, N = 3SE +/- 2.35, N = 3205.20183.62188.71209.64MIN: 35.4 / MAX: 1818.18MIN: 34.56 / MAX: 1714.29MIN: 30.08 / MAX: 1428.57MIN: 32.84 / MAX: 1764.71

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux50100150200250SE +/- 1.67, N = 3SE +/- 3.30, N = 3SE +/- 1.90, N = 3SE +/- 1.76, N = 3214.31200.18202.14221.80MIN: 36.39 / MAX: 1764.71MIN: 37.41 / MAX: 2000MIN: 36.41 / MAX: 1463.41MIN: 36.97 / MAX: 1875

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux50100150200250SE +/- 3.81, N = 3SE +/- 2.16, N = 3SE +/- 3.01, N = 3SE +/- 0.45, N = 3215.62201.05206.83221.71MIN: 37.43 / MAX: 1714.29MIN: 36.08 / MAX: 1500MIN: 35.91 / MAX: 1935.48MIN: 35.63 / MAX: 2068.97

Memcached

Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:10Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.2M2.4M3.6M4.8M6MSE +/- 36897.17, N = 5SE +/- 43085.73, N = 13SE +/- 65254.44, N = 3SE +/- 45099.83, N = 83370014.383337339.105054518.765462773.671. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Memcached

Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2M4M6M8M10MSE +/- 20632.12, N = 3SE +/- 20448.57, N = 10SE +/- 380886.14, N = 12SE +/- 121500.81, N = 153477137.282615816.738983240.529633352.441. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Redis

Test: GET - Parallel Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux400K800K1200K1600K2000KSE +/- 15103.72, N = 15SE +/- 19161.91, N = 15SE +/- 30474.05, N = 15SE +/- 19370.21, N = 151541713.801821521.391838671.431777534.651. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Redis

Test: SET - Parallel Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux500K1000K1500K2000K2500KSE +/- 48178.71, N = 15SE +/- 47416.25, N = 15SE +/- 73166.31, N = 15SE +/- 46614.18, N = 152134872.891978937.182125843.972231227.611. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Graph500

Scale: 26

OpenBenchmarking.orgbfs median_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux300M600M900M1200M1500M12265500001464120000119551000012756900001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Graph500

Scale: 26

OpenBenchmarking.orgbfs max_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux300M600M900M1200M1500M12895800001499600000125325000013234800001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Graph500

Scale: 26

OpenBenchmarking.orgsssp median_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux110M220M330M440M550M4835340004663980004930310005099640001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

Graph500

Scale: 26

OpenBenchmarking.orgsssp max_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux150M300M450M600M750M6649910006407940006634120006928930001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux48121620SE +/- 1.403, N = 7SE +/- 0.323, N = 12SE +/- 0.850, N = 12SE +/- 1.257, N = 159.6305.9397.18013.6381. (CXX) g++ options: -O3 -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyUbuntu Linux 23.10Arch Linux150K300K450K600K750KSE +/- 22056.84, N = 12SE +/- 16477.93, N = 126793176987341. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyUbuntu Linux 23.10Arch Linux0.3350.671.0051.341.675SE +/- 0.047, N = 12SE +/- 0.035, N = 121.4891.4401. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteUbuntu Linux 23.10Arch Linux8K16K24K32K40KSE +/- 1662.84, N = 9SE +/- 280.04, N = 1239542185361. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyUbuntu Linux 23.10Arch Linux1224364860SE +/- 0.97, N = 9SE +/- 0.82, N = 1225.6254.091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

TensorFlow

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: ResNet-50Ubuntu Linux 23.10CentOS Stream 9Arch Linux20406080100SE +/- 0.84, N = 3SE +/- 0.83, N = 4SE +/- 0.61, N = 373.1276.6877.06

RawTherapee

Total Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterRawTherapeeTotal Benchmark TimeUbuntu Linux 23.10Fedora Server 39Arch Linux306090120150SE +/- 0.65, N = 3SE +/- 0.45, N = 3SE +/- 0.34, N = 3129.08118.23107.051. Ubuntu Linux 23.10: RawTherapee, version 5.9, command line.2. Fedora Server 39: RawTherapee, version 5.10, command line.3. Arch Linux: RawTherapee, version 5.10, command line.

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150SE +/- 0.29, N = 3SE +/- 0.30, N = 3SE +/- 0.47, N = 3132.68132.91134.21

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux100200300400500SE +/- 0.91, N = 3SE +/- 0.62, N = 3SE +/- 1.54, N = 3478.76478.03474.24

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux10002000300040005000SE +/- 40.60, N = 7SE +/- 40.12, N = 7SE +/- 55.62, N = 34547.544462.534534.89

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux48121620SE +/- 0.13, N = 7SE +/- 0.13, N = 7SE +/- 0.18, N = 314.0614.3214.10

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux400800120016002000SE +/- 7.36, N = 3SE +/- 4.86, N = 3SE +/- 9.98, N = 31837.111863.341868.77

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux816243240SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 334.7634.2934.21

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux2K4K6K8K10KSE +/- 102.73, N = 7SE +/- 43.63, N = 3SE +/- 102.84, N = 711099.6411022.3011213.16

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux1.30122.60243.90365.20486.506SE +/- 0.0557, N = 7SE +/- 0.0226, N = 3SE +/- 0.0549, N = 75.75155.78335.6953

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux2004006008001000SE +/- 5.31, N = 3SE +/- 4.43, N = 3SE +/- 2.18, N = 3829.51827.99834.19

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux20406080100SE +/- 0.46, N = 3SE +/- 0.41, N = 3SE +/- 0.21, N = 377.0277.1776.66

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150SE +/- 0.87, N = 3SE +/- 0.32, N = 3SE +/- 1.36, N = 3155.82152.57154.32

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux90180270360450SE +/- 2.51, N = 3SE +/- 0.86, N = 3SE +/- 3.56, N = 3409.01416.68413.38

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux400800120016002000SE +/- 16.26, N = 3SE +/- 3.56, N = 3SE +/- 7.12, N = 31826.041866.521839.98

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux816243240SE +/- 0.31, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 334.9934.2334.74

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux2004006008001000SE +/- 6.05, N = 3SE +/- 8.06, N = 3SE +/- 8.02, N = 3853.21853.34857.85

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux20406080100SE +/- 0.50, N = 3SE +/- 0.70, N = 3SE +/- 0.70, N = 374.8874.8074.53

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux30060090012001500SE +/- 14.85, N = 3SE +/- 15.64, N = 3SE +/- 12.68, N = 31223.161223.651227.37

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux1224364860SE +/- 0.63, N = 3SE +/- 0.70, N = 3SE +/- 0.55, N = 352.2852.2452.12

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux4080120160200SE +/- 1.16, N = 3SE +/- 0.21, N = 3SE +/- 2.15, N = 4176.57173.95181.33

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux80160240320400SE +/- 2.37, N = 3SE +/- 0.14, N = 3SE +/- 4.23, N = 4361.29366.38351.75

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux400800120016002000SE +/- 20.52, N = 3SE +/- 16.06, N = 3SE +/- 22.85, N = 31866.231810.951878.45

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux816243240SE +/- 0.38, N = 3SE +/- 0.32, N = 3SE +/- 0.42, N = 334.2535.2834.04

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 0.39, N = 3133.21133.28134.93

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux100200300400500SE +/- 0.78, N = 3SE +/- 0.34, N = 3SE +/- 1.04, N = 3477.14476.58471.82

GPAW

Input: Carbon Nanotube

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeUbuntu Linux 23.10Fedora Server 394080120160200SE +/- 0.35, N = 15SE +/- 0.94, N = 338.64194.51-fwrapv -O2-fno-strict-overflow -fcf-protection -fexceptions -fPIC -UNDEBUG -std=c991. (CC) gcc options: -shared -lxc -lblas -lmpi

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux90180270360450SE +/- 0.48, N = 3SE +/- 2.69, N = 3SE +/- 0.63, N = 3SE +/- 0.49, N = 3375.75328.37340.97392.84-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux20406080100SE +/- 0.11, N = 3SE +/- 0.81, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 385.0697.3493.7481.35-pie - MIN: 39.38 / MAX: 260.96-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.82 / MAX: 325.84-pie - MIN: 34.75 / MAX: 283.24-pie - MIN: 38.9 / MAX: 148.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux110220330440550SE +/- 5.90, N = 4SE +/- 1.20, N = 3SE +/- 6.06, N = 4SE +/- 6.17, N = 4519.83528.79529.14531.53-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux50100150200250SE +/- 2.84, N = 4SE +/- 0.55, N = 3SE +/- 2.84, N = 4SE +/- 2.90, N = 4245.98241.67241.70240.65-pie - MIN: 176.44 / MAX: 390.61-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 160.04 / MAX: 556.9-pie - MIN: 163.92 / MAX: 559.83-pie - MIN: 175.12 / MAX: 455.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2K4K6K8K10KSE +/- 20.48, N = 3SE +/- 7.04, N = 3SE +/- 9.74, N = 3SE +/- 34.95, N = 38901.618908.748862.078956.37-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux48121620SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 314.3714.3614.4314.28-pie - MIN: 12.05 / MAX: 72.49-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 12.55 / MAX: 76.83-pie - MIN: 12.18 / MAX: 71.66-pie - MIN: 12.05 / MAX: 46.921. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux5K10K15K20K25KSE +/- 208.25, N = 3SE +/- 36.89, N = 3SE +/- 130.19, N = 3SE +/- 269.84, N = 324570.1024295.7124296.5424355.33-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.18132.36263.54394.72525.9065SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 35.205.255.255.24-pie - MIN: 4.59 / MAX: 31.78-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 4.69 / MAX: 58.72-pie - MIN: 4.62 / MAX: 31.26-pie - MIN: 4.62 / MAX: 25.21. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux5001000150020002500SE +/- 15.67, N = 3SE +/- 10.50, N = 3SE +/- 4.46, N = 3SE +/- 6.39, N = 32377.902412.512383.222409.76-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1224364860SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 353.7953.0253.6753.08-pie - MIN: 44.62 / MAX: 198.12-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 42.98 / MAX: 178.63-pie - MIN: 43.29 / MAX: 161.25-pie - MIN: 44.51 / MAX: 131.91. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2004006008001000SE +/- 4.60, N = 3SE +/- 13.25, N = 15SE +/- 8.04, N = 9SE +/- 11.59, N = 31143.25617.45978.701092.75-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1224364860SE +/- 0.11, N = 3SE +/- 1.14, N = 15SE +/- 0.27, N = 9SE +/- 0.30, N = 327.9352.0932.6729.23-pie - MIN: 19.99 / MAX: 261.46-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 17.25 / MAX: 578.83-pie - MIN: 19.33 / MAX: 484.58-pie - MIN: 21.95 / MAX: 117.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux9K18K27K36K45KSE +/- 43.54, N = 3SE +/- 347.22, N = 3SE +/- 194.22, N = 3SE +/- 312.18, N = 343516.9840187.3442419.8941472.25-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.67951.3592.03852.7183.3975SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 32.853.022.862.94-pie - MIN: 2.08 / MAX: 32.04-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 2.07 / MAX: 29.73-pie - MIN: 1.94 / MAX: 41.9-pie - MIN: 2.09 / MAX: 30.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2K4K6K8K10KSE +/- 140.94, N = 3SE +/- 104.96, N = 5SE +/- 124.93, N = 4SE +/- 125.31, N = 310033.9510113.4710082.9310197.22-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux3691215SE +/- 0.18, N = 3SE +/- 0.14, N = 5SE +/- 0.16, N = 4SE +/- 0.16, N = 312.7412.6512.6912.54-pie - MIN: 10.88 / MAX: 73.62-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 10.9 / MAX: 74.36-pie - MIN: 10.9 / MAX: 75.69-pie - MIN: 10.74 / MAX: 50.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux7001400210028003500SE +/- 1.65, N = 3SE +/- 1.03, N = 3SE +/- 4.78, N = 3SE +/- 3.83, N = 33217.843196.473255.163189.70-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux918273645SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 339.7640.0239.3040.11-pie - MIN: 37.84 / MAX: 104.98-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.6 / MAX: 102.02-pie - MIN: 33.26 / MAX: 101.52-pie - MIN: 38.25 / MAX: 97.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux14K28K42K56K70KSE +/- 827.51, N = 15SE +/- 478.67, N = 3SE +/- 271.02, N = 3SE +/- 941.42, N = 1561020.1660429.5456624.9864056.00-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.18680.37360.56040.74720.934SE +/- 0.00, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 150.800.830.830.77-pie - MIN: 0.2 / MAX: 28.24-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 0.21 / MAX: 20.36-pie - MIN: 0.2 / MAX: 31.65-pie - MIN: 0.19 / MAX: 28.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Random ReadUbuntu Linux 23.10Fedora Server 39Arch Linux140M280M420M560M700MSE +/- 7527805.83, N = 15SE +/- 3865049.53, N = 3SE +/- 7708164.70, N = 3599822046652854125608345894-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Update RandomUbuntu Linux 23.10Fedora Server 39Arch Linux30K60K90K120K150KSE +/- 440.29, N = 3SE +/- 1187.74, N = 3SE +/- 1143.37, N = 3125560123092127451-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read While WritingUbuntu Linux 23.10Fedora Server 39Arch Linux2M4M6M8M10MSE +/- 81611.31, N = 8SE +/- 133209.05, N = 14SE +/- 87416.61, N = 3977598985670069385652-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read Random Write RandomUbuntu Linux 23.10Fedora Server 39Arch Linux300K600K900K1200K1500KSE +/- 5328.60, N = 3SE +/- 13512.70, N = 15SE +/- 9325.25, N = 159554611184837932034-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Speedb

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadUbuntu Linux 23.10Fedora Server 39Arch Linux130M260M390M520M650MSE +/- 5282775.06, N = 8SE +/- 8524314.28, N = 3SE +/- 6923132.62, N = 4600703384626261826616573385-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux510152025SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 320.6520.5020.4420.67

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux510152025SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 320.7720.4420.5420.78

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/pathtracer/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux20406080100SE +/- 0.35, N = 3SE +/- 0.23, N = 3SE +/- 0.58, N = 3SE +/- 0.87, N = 482.9783.5782.1482.51

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/ao/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux816243240SE +/- 0.05, N = 3SE +/- 0.26, N = 15SE +/- 0.10, N = 3SE +/- 0.29, N = 328.6129.7628.6634.05

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux714212835SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 3SE +/- 0.48, N = 1528.9229.5128.4331.58

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux816243240SE +/- 0.05, N = 3SE +/- 0.48, N = 15SE +/- 0.12, N = 3SE +/- 0.10, N = 332.3233.2931.7033.37

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux2004006008001000SE +/- 3.48, N = 3SE +/- 9.82, N = 4SE +/- 3.93, N = 3914902874

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux2004006008001000SE +/- 3.53, N = 3SE +/- 2.03, N = 3SE +/- 3.18, N = 3911897867

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux2004006008001000SE +/- 2.40, N = 3SE +/- 2.96, N = 3SE +/- 2.33, N = 3107910581026

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux3K6K9K12K15KSE +/- 3.51, N = 3SE +/- 22.15, N = 3SE +/- 32.00, N = 3120861218711575

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux7K14K21K28K35KSE +/- 481.26, N = 15SE +/- 1257.60, N = 15SE +/- 740.65, N = 15322792803523884

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux3K6K9K12K15KSE +/- 25.12, N = 3SE +/- 36.03, N = 3SE +/- 13.00, N = 3122431226211658

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux7K14K21K28K35KSE +/- 600.94, N = 15SE +/- 1255.46, N = 15SE +/- 467.39, N = 15331742752423687

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux3K6K9K12K15KSE +/- 177.62, N = 4SE +/- 37.95, N = 3SE +/- 37.30, N = 3145081442213639

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux8K16K24K32K40KSE +/- 564.37, N = 15SE +/- 119.27, N = 3SE +/- 138.45, N = 3372853469833976

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux50100150200250SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3234235226

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux50100150200250SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3233233223

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux60120180240300SE +/- 0.00, N = 3SE +/- 1.45, N = 3SE +/- 0.67, N = 3276276265

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux8001600240032004000SE +/- 3.21, N = 3SE +/- 16.22, N = 3SE +/- 21.20, N = 3371836833591

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux14002800420056007000SE +/- 77.79, N = 4SE +/- 13.35, N = 3SE +/- 40.01, N = 3644863146380

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux8001600240032004000SE +/- 7.45, N = 3SE +/- 43.59, N = 3SE +/- 5.13, N = 3369436553544

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux14002800420056007000SE +/- 60.98, N = 6SE +/- 28.01, N = 3SE +/- 44.43, N = 3632463036399

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux9001800270036004500SE +/- 47.59, N = 4SE +/- 21.55, N = 3SE +/- 13.25, N = 3435343774173

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux16003200480064008000SE +/- 31.90, N = 3SE +/- 91.12, N = 4SE +/- 29.16, N = 3732174247043

Phoronix Test Suite v10.8.4