Linux Distros Emerald Rapids

Benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2403039-NE-2403025NE90
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

BLAS (Basic Linear Algebra Sub-Routine) Tests 3 Tests
C/C++ Compiler Tests 5 Tests
CPU Massive 10 Tests
Creator Workloads 9 Tests
Database Test Suite 5 Tests
Encoding 2 Tests
Fortran Tests 5 Tests
Game Development 2 Tests
HPC - High Performance Computing 14 Tests
Common Kernel Benchmarks 2 Tests
Machine Learning 4 Tests
Molecular Dynamics 6 Tests
MPI Benchmarks 5 Tests
Multi-Core 15 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 6 Tests
OpenMPI Tests 8 Tests
Python Tests 4 Tests
Raytracing 2 Tests
Renderers 2 Tests
Scientific Computing 8 Tests
Server 6 Tests
Server CPU Tests 4 Tests
Video Encoding 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Ubuntu Linux 23.10
February 25
  20 Hours, 3 Minutes
CentOS Stream 9
February 26
  13 Hours, 36 Minutes
Fedora Server 39
March 02
  17 Hours, 42 Minutes
Arch Linux
March 03
  17 Hours, 43 Minutes
Invert Hiding All Results Option
  17 Hours, 16 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Linux Distros Emerald RapidsProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionDesktopDisplay ServerUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud QuantaGrid D54Q-2U S6Q-MB-MPS (3B05.TEL4P1 BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-17-generic (x86_64)GCC 13.2.0ext41024x7683201GB Micron_7450_MTFDKCB3T2TFS + 257GB Flash DriveCentOS Stream 95.14.0-419.el9.x86_64 (x86_64)GNOME Shell 40.10X ServerGCC 11.4.1 20231218xfs1920x1200Fedora Linux 396.7.6-200.fc39.x86_64 (x86_64)GCC 13.2.1 202312051024x768Arch Linux6.7.6-arch1-2 (x86_64)GCC 13.2.1 20230801btrfs1920x1200OpenBenchmarking.orgKernel Details- Ubuntu Linux 23.10: Transparent Huge Pages: madvise- CentOS Stream 9: Transparent Huge Pages: always- Fedora Server 39: Transparent Huge Pages: madvise- Arch Linux: Transparent Huge Pages: alwaysCompiler Details- Ubuntu Linux 23.10: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - CentOS Stream 9: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl - Fedora Server 39: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - Arch Linux: --disable-libssp --disable-libstdcxx-pch --disable-werror --enable-__cxa_atexit --enable-bootstrap --enable-cet=auto --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-default-ssp --enable-gnu-indirect-function --enable-gnu-unique-object --enable-languages=ada,c,c++,d,fortran,go,lto,m2,objc,obj-c++ --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-lto --enable-multilib --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-build-config=bootstrap-lto --with-linker-hash-style=gnu Processor Details- Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0x21000161Python Details- Ubuntu Linux 23.10: Python 3.11.6- CentOS Stream 9: Python 3.9.18- Fedora Server 39: Python 3.12.2- Arch Linux: Python 3.11.7Security Details- Ubuntu Linux 23.10: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - CentOS Stream 9: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Fedora Server 39: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - Arch Linux: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch LinuxResult OverviewPhoronix Test Suite100%139%177%216%255%NAMDMemcachedGROMACSACES DGEMMeasyWaveEmbree7-Zip CompressionCloverLeafY-CruncherLAMMPS Molecular Dynamics SimulatorClickHouseIntel Open Image DenoiseXcompact3d Incompact3dRedisOpenVINOGraph500SVT-AV1OSPRayQuicksilverVVenCOpenVKLHigh Performance Conjugate Gradient

Linux Distros Emerald Rapidsnwchem: C240 Buckyballquicksilver: CTS2quicksilver: CORAL2 P2openvkl: vklBenchmarkCPU ISPCeasywave: e2Asean Grid + BengkuluSept2007 Source - 2400quicksilver: CORAL2 P1tensorflow: CPU - 512 - ResNet-50namd: STMV with 1,066,628 Atomsclickhouse: 100M Rows Hits Dataset, Third Runclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachehpcg: 144 144 144 - 60lczero: BLAScloverleaf: clover_bm16pgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlypgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writeospray-studio: 2 - 4K - 32 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUgromacs: MPI CPU - water_GMX50_barememcached: 1:100vvenc: Bosphorus 4K - Fastospray: particle_volume/pathtracer/real_timenamd: ATPase with 327,506 Atomscompress-7zip: Decompression Ratingcompress-7zip: Compression Ratingincompact3d: X3D-benchmarking input.i3dopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUhpcg: 104 104 104 - 60redis: GET - 500rocksdb: Read Rand Write Randopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUmemcached: 1:10lammps: 20k Atomsredis: SET - 500graph500: 26graph500: 26graph500: 26graph500: 26ospray: particle_volume/scivis/real_timelczero: Eigenrocksdb: Read While Writingvvenc: Bosphorus 4K - Fasterospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timegpaw: Carbon Nanotuberocksdb: Rand Readopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUospray: particle_volume/ao/real_timerawtherapee: Total Benchmark Timeopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUospray-studio: 2 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUspeedb: Rand Readsvt-av1: Preset 4 - Bosphorus 4Kospray-studio: 1 - 1080p - 32 - Path Tracer - CPUospray-studio: 2 - 4K - 16 - Path Tracer - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 1080p - 32 - Path Tracer - CPUospray-studio: 3 - 1080p - 16 - Path Tracer - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUospray-studio: 1 - 1080p - 16 - Path Tracer - CPUospray-studio: 3 - 1080p - 1 - Path Tracer - CPUdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamospray-studio: 1 - 1080p - 1 - Path Tracer - CPUospray-studio: 2 - 1080p - 16 - Path Tracer - CPUospray-studio: 2 - 1080p - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 1 - Path Tracer - CPUcloverleaf: clover_bm64_shortospray-studio: 2 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUy-cruncher: 5Brocksdb: Update Randdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamsvt-av1: Preset 12 - Bosphorus 4Kdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamlammps: Rhodopsin Proteindeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamsvt-av1: Preset 8 - Bosphorus 4Kdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamoidn: RTLightmap.hdr.4096x4096 - CPU-Onlyembree: Pathtracer ISPC - Crownsvt-av1: Preset 13 - Bosphorus 4Koidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyy-cruncher: 1Bembree: Pathtracer ISPC - Asian Dragonmt-dgemm: Sustained Floating-Point Rateoidn: RT.hdr_alb_nrm.3840x2160 - CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1750.3768022267447782821177.754593150073.121.49004215.62214.31205.2069.336215279.211.48967931725.6163954233174322799.6303477137.282.78582.97004.70711455056464813169.1785790.8061020.1671.13711541713.8095546127.931143.253370014.3856.6832134872.896649910004835340001289580000122655000020.772538097759895.61128.608832.321228.916238.637599822046245.98519.8320.6546129.07912.7410033.95632437285145086007033842.30764481224314.05734547.5395120867321435353.792377.90409.0089155.817885.06375.7514.378901.615.2024570.1039.763217.842.8543516.9837182765.751511099.6440234369423391432.10911107929.821125560132.6789478.763166.857361.2877176.569137.518477.1362133.206334.25451866.225921.31752.27741223.163934.76031837.111377.0180829.506334.98841826.044774.8838853.20792.18100.339966.4304.547.207144.919537.9710184.53739833363810002815205.005580083376.680.50251201.05200.18183.6269.1728314.495.9392615816.732.82383.56523.20328434200751070184.1923320.8360429.5471.13321821521.3952.09617.453337339.1057.8361978937.186407940004663980001499600000146412000020.44275.80829.762633.293829.5104241.67528.7920.502112.6510113.472.35814.31824462.525553.022412.51416.6816152.567897.34328.3714.368908.745.2524295.7140.023196.473.0240187.345.783311022.302025.0132.850132.9101478.031569.868366.3831173.951539.795476.5785133.281835.28461810.950821.56052.23601223.647034.29061863.342977.1671827.991434.22621866.515374.8038853.33742.51105.619469.7184.907.913177.796063.6358405.04736750067596002821156.23758358181.92977206.83202.14188.7170.3805255.3927524280357.1808983240.522.83482.13805.40706428601496138168.6718190.8356624.9872.45751838671.43118483732.67978.705054518.7657.6772125843.976634120004930310001253250000119551000020.541985670065.80428.663731.699928.430194.508652854125241.70529.1420.4442118.22812.6910082.93630334698144226262618262.346631412262121877424437753.672383.2293.74340.9714.438862.075.2524296.5439.303255.162.8642419.893683276235365523390231.63897105833.73412309271.51839.00921.1612.25142.167570.8744.708.270179.540337.7200764.68772366770138892951145.713586550077.061.74784221.71221.80209.6470.1210356.231.44069873454.08518536236872388413.6389633352.442.90082.51135.59956482076759279187.2665960.7764056.0071.12921777534.6593203429.231092.755462773.6762.9902231227.616928930005099640001323480000127569000020.778993856525.94234.048733.369431.5793608345894240.65531.5320.6673107.04812.5410197.22639933976136396165733852.39563801165814.09594534.8946115757043417353.082409.76413.3838154.321681.35392.8414.288956.375.2424355.3340.113189.702.9441472.2535912655.695311213.1629226354422387430.30867102633.652127451134.2065474.241973.717351.7460181.333042.751471.8157134.933334.03601878.447822.04652.12461227.374334.21341868.770576.6571834.192034.74281839.983374.5256857.84942.36118.740072.9064.757.561148.602243.6692344.75OpenBenchmarking.org

NWChem

NWChem is an open-source high performance computational chemistry package. Per NWChem's documentation, "NWChem aims to provide its users with computational chemistry tools that are scalable both in their ability to treat large scientific computational chemistry problems efficiently, and in their use of available parallel computing resources from high-performance parallel supercomputers to conventional workstation clusters." Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterNWChem 7.0.2Input: C240 BuckyballUbuntu Linux 23.104008001200160020001750.31. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lga -larmci -lpeigs -l64to32 -lopenblas -lpthread -lrt -llapack -lnwcblas -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -lcomex -m64 -ffast-math -std=legacy -fdefault-integer-8 -finline-functions -O2

Input: C240 Buckyball

CentOS Stream 9: The test quit with a non-zero exit status. E: mpirun was unable to launch the specified application as it could not access

Fedora Server 39: The test run did not produce a result. E: /nwchem-7.0.2/bin/LINUX64/nwchem: error while loading shared libraries: libmpi_usempif08.so.40: cannot open shared object file: No such file or directory

Quicksilver

Quicksilver is a proxy application that represents some elements of the Mercury workload by solving a simplified dynamic Monte Carlo particle transport problem. Quicksilver is developed by Lawrence Livermore National Laboratory (LLNL) and this test profile currently makes use of the OpenMP CPU threaded code path. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CTS2Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.7M3.4M5.1M6.8M8.5MSE +/- 80526.35, N = 9SE +/- 121572.66, N = 6SE +/- 90618.71, N = 4SE +/- 67222.68, N = 976802227398333736750077236671. (CXX) g++ options: -fopenmp -O3 -march=native
OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CTS2Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.3M2.6M3.9M5.2M6.5MMin: 7249000 / Avg: 7680222.22 / Max: 8028000Min: 6894000 / Avg: 7398333.33 / Max: 7644000Min: 7161000 / Avg: 7367500 / Max: 7596000Min: 7438000 / Avg: 7723666.67 / Max: 80030001. (CXX) g++ options: -fopenmp -O3 -march=native

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.5M3M4.5M6M7.5MSE +/- 81512.06, N = 9SE +/- 51868.42, N = 3SE +/- 74346.22, N = 5SE +/- 67285.55, N = 967447786381000675960070138891. (CXX) g++ options: -fopenmp -O3 -march=native
OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P2Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.2M2.4M3.6M4.8M6MMin: 6455000 / Avg: 6744777.78 / Max: 7276000Min: 6287000 / Avg: 6381000 / Max: 6466000Min: 6516000 / Avg: 6759600 / Max: 6985000Min: 6682000 / Avg: 7013888.89 / Max: 72980001. (CXX) g++ options: -fopenmp -O3 -march=native

OpenVKL

OpenVKL is the Intel Open Volume Kernel Library that offers high-performance volume computation kernels and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux6001200180024003000SE +/- 20.99, N = 3SE +/- 33.05, N = 3SE +/- 22.66, N = 3SE +/- 20.04, N = 32821281528212951MIN: 175 / MAX: 34505MIN: 186 / MAX: 35204MIN: 178 / MAX: 36193MIN: 193 / MAX: 35719
OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux5001000150020002500Min: 2792 / Avg: 2821.33 / Max: 2862Min: 2749 / Avg: 2815 / Max: 2851Min: 2789 / Avg: 2821.33 / Max: 2865Min: 2919 / Avg: 2951.33 / Max: 2988

easyWave

The easyWave software allows simulating tsunami generation and propagation in the context of early warning systems. EasyWave supports making use of OpenMP for CPU multi-threading and there are also GPU ports available but not currently incorporated as part of this test profile. The easyWave tsunami generation software is run with one of the example/reference input files for measuring the CPU execution time. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200SE +/- 8.98, N = 12SE +/- 10.40, N = 12SE +/- 15.88, N = 12SE +/- 7.11, N = 12177.75205.01156.24145.711. (CXX) g++ options: -O3 -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200Min: 130.91 / Avg: 177.75 / Max: 236.16Min: 157.73 / Avg: 205.01 / Max: 286.78Min: 96.98 / Avg: 156.24 / Max: 300.61Min: 109.09 / Avg: 145.71 / Max: 196.481. (CXX) g++ options: -O3 -fopenmp

Quicksilver

Quicksilver is a proxy application that represents some elements of the Mercury workload by solving a simplified dynamic Monte Carlo particle transport problem. Quicksilver is developed by Lawrence Livermore National Laboratory (LLNL) and this test profile currently makes use of the OpenMP CPU threaded code path. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.3M2.6M3.9M5.2M6.5MSE +/- 65941.38, N = 12SE +/- 105910.76, N = 12SE +/- 42699.12, N = 11SE +/- 55910.49, N = 659315005800833583581858655001. (CXX) g++ options: -fopenmp -O3 -march=native
OpenBenchmarking.orgFigure Of Merit, More Is BetterQuicksilver 20230818Input: CORAL2 P1Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1000K2000K3000K4000K5000KMin: 5749000 / Avg: 5931500 / Max: 6579000Min: 5443000 / Avg: 5800833.33 / Max: 6788000Min: 5706000 / Avg: 5835818.18 / Max: 6202000Min: 5781000 / Avg: 5865500 / Max: 61400001. (CXX) g++ options: -fopenmp -O3 -march=native

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: ResNet-50Ubuntu Linux 23.10CentOS Stream 9Arch Linux20406080100SE +/- 0.84, N = 3SE +/- 0.83, N = 4SE +/- 0.61, N = 373.1276.6877.06
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 512 - Model: ResNet-50Ubuntu Linux 23.10CentOS Stream 9Arch Linux1530456075Min: 71.46 / Avg: 73.12 / Max: 74.2Min: 74.67 / Avg: 76.68 / Max: 78.51Min: 75.97 / Avg: 77.06 / Max: 78.08

Device: CPU - Batch Size: 512 - Model: ResNet-50

Fedora Server 39: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'absl'

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.43420.86841.30261.73682.171SE +/- 0.14829, N = 15SE +/- 0.04889, N = 12SE +/- 0.05361, N = 15SE +/- 0.07631, N = 151.490040.502511.929771.74784
OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 0.26 / Avg: 1.49 / Max: 2.19Min: 0.26 / Avg: 0.5 / Max: 0.79Min: 1.65 / Avg: 1.93 / Max: 2.33Min: 1.18 / Avg: 1.75 / Max: 2.13

ClickHouse

ClickHouse is an open-source, high performance OLAP data management system. This test profile uses ClickHouse's standard benchmark recommendations per https://clickhouse.com/docs/en/operations/performance-test/ / https://github.com/ClickHouse/ClickBench/tree/main/clickhouse with the 100 million rows web analytics dataset. The reported value is the query processing time using the geometric mean of all separate queries performed as an aggregate. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux50100150200250SE +/- 3.81, N = 3SE +/- 2.16, N = 3SE +/- 3.01, N = 3SE +/- 0.45, N = 3215.62201.05206.83221.71MIN: 37.43 / MAX: 1714.29MIN: 36.08 / MAX: 1500MIN: 35.91 / MAX: 1935.48MIN: 35.63 / MAX: 2068.97
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200Min: 208.79 / Avg: 215.62 / Max: 221.95Min: 196.75 / Avg: 201.05 / Max: 203.57Min: 200.86 / Avg: 206.83 / Max: 210.49Min: 221 / Avg: 221.71 / Max: 222.56

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux50100150200250SE +/- 1.67, N = 3SE +/- 3.30, N = 3SE +/- 1.90, N = 3SE +/- 1.76, N = 3214.31200.18202.14221.80MIN: 36.39 / MAX: 1764.71MIN: 37.41 / MAX: 2000MIN: 36.41 / MAX: 1463.41MIN: 36.97 / MAX: 1875
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200Min: 211 / Avg: 214.31 / Max: 216.31Min: 193.92 / Avg: 200.18 / Max: 205.13Min: 198.35 / Avg: 202.14 / Max: 204.37Min: 218.3 / Avg: 221.8 / Max: 223.91

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux50100150200250SE +/- 2.70, N = 3SE +/- 0.84, N = 3SE +/- 2.54, N = 3SE +/- 2.35, N = 3205.20183.62188.71209.64MIN: 35.4 / MAX: 1818.18MIN: 34.56 / MAX: 1714.29MIN: 30.08 / MAX: 1428.57MIN: 32.84 / MAX: 1764.71
OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200Min: 199.81 / Avg: 205.2 / Max: 207.98Min: 182.31 / Avg: 183.62 / Max: 185.2Min: 185.89 / Avg: 188.71 / Max: 193.77Min: 204.99 / Avg: 209.64 / Max: 212.61

High Performance Conjugate Gradient

HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1632486480SE +/- 0.52, N = 3SE +/- 0.83, N = 4SE +/- 0.27, N = 3SE +/- 0.59, N = 369.3469.1770.3870.12-lmpi_cxx-lmpi_cxx-lmpi_cxx1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi
OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 144 144 144 - RT: 60Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1428425670Min: 68.31 / Avg: 69.34 / Max: 70.01Min: 66.76 / Avg: 69.17 / Max: 70.27Min: 69.87 / Avg: 70.38 / Max: 70.77Min: 68.96 / Avg: 70.12 / Max: 70.851. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi

LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASUbuntu Linux 23.1048121620SE +/- 1.18, N = 9151. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASUbuntu Linux 23.1048121620Min: 13 / Avg: 14.67 / Max: 241. (CXX) g++ options: -flto -pthread

Backend: BLAS

CentOS Stream 9: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory

Fedora Server 39: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory

Arch Linux: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux80160240320400SE +/- 3.60, N = 3SE +/- 1.51, N = 3SE +/- 1.01, N = 3SE +/- 4.10, N = 3279.21314.49255.39356.231. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm16Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux60120180240300Min: 273.09 / Avg: 279.21 / Max: 285.54Min: 312.36 / Avg: 314.49 / Max: 317.4Min: 253.89 / Avg: 255.39 / Max: 257.3Min: 348.08 / Avg: 356.23 / Max: 361.111. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyUbuntu Linux 23.10Arch Linux0.3350.671.0051.341.675SE +/- 0.047, N = 12SE +/- 0.035, N = 121.4891.4401. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyUbuntu Linux 23.10Arch Linux246810Min: 1.22 / Avg: 1.49 / Max: 1.81Min: 1.26 / Avg: 1.44 / Max: 1.631. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

CentOS Stream 9: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory

Fedora Server 39: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyUbuntu Linux 23.10Arch Linux150K300K450K600K750KSE +/- 22056.84, N = 12SE +/- 16477.93, N = 126793176987341. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyUbuntu Linux 23.10Arch Linux120K240K360K480K600KMin: 553584.39 / Avg: 679316.56 / Max: 817093.8Min: 614487.45 / Avg: 698733.82 / Max: 796201.31. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

CentOS Stream 9: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory

Fedora Server 39: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyUbuntu Linux 23.10Arch Linux1224364860SE +/- 0.97, N = 9SE +/- 0.82, N = 1225.6254.091. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyUbuntu Linux 23.10Arch Linux1122334455Min: 20.95 / Avg: 25.62 / Max: 28.4Min: 50.27 / Avg: 54.09 / Max: 58.321. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

CentOS Stream 9: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory

Fedora Server 39: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteUbuntu Linux 23.10Arch Linux8K16K24K32K40KSE +/- 1662.84, N = 9SE +/- 280.04, N = 1239542185361. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteUbuntu Linux 23.10Arch Linux7K14K21K28K35KMin: 35211.76 / Avg: 39541.55 / Max: 47743.45Min: 17147.32 / Avg: 18535.89 / Max: 19894.321. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

CentOS Stream 9: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory

Fedora Server 39: The test run did not produce a result. E: pgbench: line 21: pg_/bin/pgbench: No such file or directory

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux7K14K21K28K35KSE +/- 600.94, N = 15SE +/- 1255.46, N = 15SE +/- 467.39, N = 15331742752423687
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux6K12K18K24K30KMin: 31361 / Avg: 33173.6 / Max: 36971Min: 24291 / Avg: 27524.47 / Max: 36847Min: 23045 / Avg: 23686.53 / Max: 30217

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux7K14K21K28K35KSE +/- 481.26, N = 15SE +/- 1257.60, N = 15SE +/- 740.65, N = 15322792803523884
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux6K12K18K24K30KMin: 31255 / Avg: 32278.87 / Max: 36955Min: 24219 / Avg: 28034.87 / Max: 35564Min: 22912 / Avg: 23883.8 / Max: 34238

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux48121620SE +/- 1.403, N = 7SE +/- 0.323, N = 12SE +/- 0.850, N = 12SE +/- 1.257, N = 159.6305.9397.18013.6381. (CXX) g++ options: -O3 -lm
OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux48121620Min: 6.17 / Avg: 9.63 / Max: 15.53Min: 3.9 / Avg: 5.94 / Max: 7.3Min: 5.02 / Avg: 7.18 / Max: 15.08Min: 7.66 / Avg: 13.64 / Max: 19.241. (CXX) g++ options: -O3 -lm

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2M4M6M8M10MSE +/- 20632.12, N = 3SE +/- 20448.57, N = 10SE +/- 380886.14, N = 12SE +/- 121500.81, N = 153477137.282615816.738983240.529633352.441. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2M4M6M8M10MMin: 3441407.94 / Avg: 3477137.28 / Max: 3512879.71Min: 2474573.07 / Avg: 2615816.73 / Max: 2694276.59Min: 8196370.3 / Avg: 8983240.52 / Max: 13111858.34Min: 8268469.5 / Avg: 9633352.44 / Max: 9970939.261. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

VVenC

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.65251.3051.95752.613.2625SE +/- 0.035, N = 3SE +/- 0.026, N = 3SE +/- 0.017, N = 3SE +/- 0.007, N = 32.7852.8232.8342.9001. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FastUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 2.72 / Avg: 2.79 / Max: 2.83Min: 2.8 / Avg: 2.82 / Max: 2.88Min: 2.81 / Avg: 2.83 / Max: 2.87Min: 2.89 / Avg: 2.9 / Max: 2.921. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/pathtracer/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux20406080100SE +/- 0.35, N = 3SE +/- 0.23, N = 3SE +/- 0.58, N = 3SE +/- 0.87, N = 482.9783.5782.1482.51
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/pathtracer/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1632486480Min: 82.34 / Avg: 82.97 / Max: 83.55Min: 83.26 / Avg: 83.57 / Max: 84.01Min: 81.21 / Avg: 82.14 / Max: 83.2Min: 80.72 / Avg: 82.51 / Max: 84.77

NAMD

NAMD is a parallel molecular dynamics code designed for high-performance simulation of large biomolecular systems. NAMD was developed by the Theoretical and Computational Biophysics Group in the Beckman Institute for Advanced Science and Technology at the University of Illinois at Urbana-Champaign. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.25992.51983.77975.03966.2995SE +/- 0.33618, N = 15SE +/- 0.30866, N = 12SE +/- 0.33952, N = 15SE +/- 0.21129, N = 124.707113.203285.407065.59956
OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 1.54 / Avg: 4.71 / Max: 6.53Min: 1.14 / Avg: 3.2 / Max: 4.52Min: 3.61 / Avg: 5.41 / Max: 7.32Min: 4.36 / Avg: 5.6 / Max: 6.82

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux100K200K300K400K500KSE +/- 39319.74, N = 3SE +/- 2615.74, N = 15SE +/- 14994.49, N = 7SE +/- 19128.23, N = 154550564342004286014820761. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux80K160K240K320K400KMin: 388489 / Avg: 455056 / Max: 524599Min: 411625 / Avg: 434199.73 / Max: 447865Min: 357109 / Avg: 428600.86 / Max: 465646Min: 367080 / Avg: 482075.93 / Max: 5682881. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux160K320K480K640K800KSE +/- 4291.24, N = 3SE +/- 5583.39, N = 15SE +/- 4508.27, N = 7SE +/- 9120.21, N = 154648137510704961387592791. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux130K260K390K520K650KMin: 459959 / Avg: 464813.33 / Max: 473370Min: 693545 / Avg: 751069.53 / Max: 774190Min: 486386 / Avg: 496138 / Max: 521611Min: 658110 / Avg: 759279.07 / Max: 7878221. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Xcompact3d Incompact3d

Xcompact3d Incompact3d is a Fortran-MPI based, finite difference high-performance code for solving the incompressible Navier-Stokes equation and as many as you need scalar transport equations. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200SE +/- 0.44, N = 3SE +/- 0.56, N = 3SE +/- 0.67, N = 3SE +/- 0.25, N = 3169.18184.19168.67187.27-lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz1. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi
OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux306090120150Min: 168.69 / Avg: 169.18 / Max: 170.07Min: 183.26 / Avg: 184.19 / Max: 185.2Min: 167.4 / Avg: 168.67 / Max: 169.64Min: 186.92 / Avg: 187.27 / Max: 187.751. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.18680.37360.56040.74720.934SE +/- 0.00, N = 15SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 150.800.830.830.77-pie - MIN: 0.2 / MAX: 28.24-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 0.21 / MAX: 20.36-pie - MIN: 0.2 / MAX: 31.65-pie - MIN: 0.19 / MAX: 28.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 0.76 / Avg: 0.8 / Max: 0.83Min: 0.82 / Avg: 0.83 / Max: 0.83Min: 0.83 / Avg: 0.83 / Max: 0.83Min: 0.72 / Avg: 0.77 / Max: 0.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux14K28K42K56K70KSE +/- 827.51, N = 15SE +/- 478.67, N = 3SE +/- 271.02, N = 3SE +/- 941.42, N = 1561020.1660429.5456624.9864056.00-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux11K22K33K44K55KMin: 56084.04 / Avg: 61020.16 / Max: 68078.7Min: 59663.92 / Avg: 60429.54 / Max: 61310.1Min: 56157.41 / Avg: 56624.98 / Max: 57096.22Min: 59002.39 / Avg: 64056 / Max: 71252.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

High Performance Conjugate Gradient

HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 104 104 104 - RT: 60Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1632486480SE +/- 0.19, N = 3SE +/- 0.12, N = 3SE +/- 0.14, N = 3SE +/- 0.32, N = 371.1471.1372.4671.13-lmpi_cxx-lmpi_cxx-lmpi_cxx1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi
OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 104 104 104 - RT: 60Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1428425670Min: 70.76 / Avg: 71.14 / Max: 71.36Min: 70.9 / Avg: 71.13 / Max: 71.26Min: 72.28 / Avg: 72.46 / Max: 72.72Min: 70.51 / Avg: 71.13 / Max: 71.561. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux400K800K1200K1600K2000KSE +/- 15103.72, N = 15SE +/- 19161.91, N = 15SE +/- 30474.05, N = 15SE +/- 19370.21, N = 151541713.801821521.391838671.431777534.651. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux300K600K900K1200K1500KMin: 1474952.62 / Avg: 1541713.8 / Max: 1710593.5Min: 1724823 / Avg: 1821521.39 / Max: 2007234.5Min: 1598034.38 / Avg: 1838671.43 / Max: 2054015.38Min: 1660552.5 / Avg: 1777534.65 / Max: 1957825.121. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read Random Write RandomUbuntu Linux 23.10Fedora Server 39Arch Linux300K600K900K1200K1500KSE +/- 5328.60, N = 3SE +/- 13512.70, N = 15SE +/- 9325.25, N = 159554611184837932034-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read Random Write RandomUbuntu Linux 23.10Fedora Server 39Arch Linux200K400K600K800K1000KMin: 947338 / Avg: 955461 / Max: 965497Min: 1133150 / Avg: 1184837.27 / Max: 1336153Min: 890459 / Avg: 932034.33 / Max: 10507411. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Read Random Write Random

CentOS Stream 9: The test quit with a non-zero exit status. E: rocksdb: line 4: ./db_bench: No such file or directory

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1224364860SE +/- 0.11, N = 3SE +/- 1.14, N = 15SE +/- 0.27, N = 9SE +/- 0.30, N = 327.9352.0932.6729.23-pie - MIN: 19.99 / MAX: 261.46-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 17.25 / MAX: 578.83-pie - MIN: 19.33 / MAX: 484.58-pie - MIN: 21.95 / MAX: 117.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1020304050Min: 27.72 / Avg: 27.93 / Max: 28.09Min: 44.38 / Avg: 52.09 / Max: 61.15Min: 31.59 / Avg: 32.67 / Max: 33.87Min: 28.63 / Avg: 29.23 / Max: 29.591. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2004006008001000SE +/- 4.60, N = 3SE +/- 13.25, N = 15SE +/- 8.04, N = 9SE +/- 11.59, N = 31143.25617.45978.701092.75-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2004006008001000Min: 1136.31 / Avg: 1143.25 / Max: 1151.95Min: 522.61 / Avg: 617.45 / Max: 720.01Min: 943.53 / Avg: 978.7 / Max: 1011.74Min: 1079.21 / Avg: 1092.75 / Max: 1115.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Memcached

Memcached is a high performance, distributed memory object caching system. This Memcached test profiles makes use of memtier_benchmark for excuting this CPU/memory-focused server benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:10Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.2M2.4M3.6M4.8M6MSE +/- 36897.17, N = 5SE +/- 43085.73, N = 13SE +/- 65254.44, N = 3SE +/- 45099.83, N = 83370014.383337339.105054518.765462773.671. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:10Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux900K1800K2700K3600K4500KMin: 3236499.45 / Avg: 3370014.38 / Max: 3446989Min: 2858704.26 / Avg: 3337339.1 / Max: 3462851.64Min: 4933706.05 / Avg: 5054518.76 / Max: 5157676.04Min: 5161867.77 / Avg: 5462773.67 / Max: 5554566.171. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1428425670SE +/- 0.42, N = 3SE +/- 0.46, N = 3SE +/- 0.40, N = 3SE +/- 0.44, N = 356.6857.8457.6862.991. (CXX) g++ options: -O3 -lm -ldl
OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1224364860Min: 56.25 / Avg: 56.68 / Max: 57.52Min: 57.12 / Avg: 57.84 / Max: 58.69Min: 56.88 / Avg: 57.68 / Max: 58.08Min: 62.11 / Avg: 62.99 / Max: 63.431. (CXX) g++ options: -O3 -lm -ldl

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux500K1000K1500K2000K2500KSE +/- 48178.71, N = 15SE +/- 47416.25, N = 15SE +/- 73166.31, N = 15SE +/- 46614.18, N = 152134872.891978937.182125843.972231227.611. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3
OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux400K800K1200K1600K2000KMin: 1790093.75 / Avg: 2134872.89 / Max: 2349004Min: 1781927.88 / Avg: 1978937.18 / Max: 2361540.5Min: 1584362.5 / Avg: 2125843.97 / Max: 2402849.5Min: 1847301 / Avg: 2231227.61 / Max: 23512131. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Graph500

This is a benchmark of the reference implementation of Graph500, an HPC benchmark focused on data intensive loads and commonly tested on supercomputers for complex data problems. Graph500 primarily stresses the communication subsystem of the hardware under test. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsssp max_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux150M300M450M600M750M6649910006407940006634120006928930001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

OpenBenchmarking.orgsssp median_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux110M220M330M440M550M4835340004663980004930310005099640001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

OpenBenchmarking.orgbfs max_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux300M600M900M1200M1500M12895800001499600000125325000013234800001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

OpenBenchmarking.orgbfs median_TEPS, More Is BetterGraph500 3.0Scale: 26Ubuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux300M600M900M1200M1500M12265500001464120000119551000012756900001. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux510152025SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 320.7720.4420.5420.78
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/scivis/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux510152025Min: 20.68 / Avg: 20.77 / Max: 20.93Min: 20.41 / Avg: 20.44 / Max: 20.49Min: 20.51 / Avg: 20.54 / Max: 20.59Min: 20.73 / Avg: 20.78 / Max: 20.85

LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenUbuntu Linux 23.1080160240320400SE +/- 4.52, N = 43801. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenUbuntu Linux 23.1070140210280350Min: 368 / Avg: 380.25 / Max: 3881. (CXX) g++ options: -flto -pthread

Backend: Eigen

CentOS Stream 9: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory

Fedora Server 39: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory

Arch Linux: The test quit with a non-zero exit status. E: lczero: line 4: ./lc0: No such file or directory

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read While WritingUbuntu Linux 23.10Fedora Server 39Arch Linux2M4M6M8M10MSE +/- 81611.31, N = 8SE +/- 133209.05, N = 14SE +/- 87416.61, N = 3977598985670069385652-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Read While WritingUbuntu Linux 23.10Fedora Server 39Arch Linux2M4M6M8M10MMin: 9400712 / Avg: 9775988.5 / Max: 10211885Min: 7891665 / Avg: 8567006.21 / Max: 10036829Min: 9230333 / Avg: 9385652.33 / Max: 95328241. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Read While Writing

CentOS Stream 9: The test quit with a non-zero exit status. E: rocksdb: line 4: ./db_bench: No such file or directory

VVenC

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.3372.6744.0115.3486.685SE +/- 0.061, N = 4SE +/- 0.013, N = 3SE +/- 0.035, N = 3SE +/- 0.050, N = 35.6115.8085.8045.9421. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.11Video Input: Bosphorus 4K - Video Preset: FasterUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 5.51 / Avg: 5.61 / Max: 5.79Min: 5.78 / Avg: 5.81 / Max: 5.83Min: 5.73 / Avg: 5.8 / Max: 5.85Min: 5.84 / Avg: 5.94 / Max: 5.991. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/ao/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux816243240SE +/- 0.05, N = 3SE +/- 0.26, N = 15SE +/- 0.10, N = 3SE +/- 0.29, N = 328.6129.7628.6634.05
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/ao/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux714212835Min: 28.51 / Avg: 28.61 / Max: 28.68Min: 28.7 / Avg: 29.76 / Max: 31.92Min: 28.47 / Avg: 28.66 / Max: 28.78Min: 33.55 / Avg: 34.05 / Max: 34.55

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux816243240SE +/- 0.05, N = 3SE +/- 0.48, N = 15SE +/- 0.12, N = 3SE +/- 0.10, N = 332.3233.2931.7033.37
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux714212835Min: 32.24 / Avg: 32.32 / Max: 32.42Min: 32.05 / Avg: 33.29 / Max: 37.14Min: 31.45 / Avg: 31.7 / Max: 31.85Min: 33.25 / Avg: 33.37 / Max: 33.56

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux714212835SE +/- 0.11, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 3SE +/- 0.48, N = 1528.9229.5128.4331.58
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux714212835Min: 28.75 / Avg: 28.92 / Max: 29.11Min: 29.23 / Avg: 29.51 / Max: 29.81Min: 28.14 / Avg: 28.43 / Max: 28.74Min: 29.53 / Avg: 31.58 / Max: 34.19

GPAW

GPAW is a density-functional theory (DFT) Python code based on the projector-augmented wave (PAW) method and the atomic simulation environment (ASE). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeUbuntu Linux 23.10Fedora Server 394080120160200SE +/- 0.35, N = 15SE +/- 0.94, N = 338.64194.51-fwrapv -O2-fno-strict-overflow -fcf-protection -fexceptions -fPIC -UNDEBUG -std=c991. (CC) gcc options: -shared -lxc -lblas -lmpi
OpenBenchmarking.orgSeconds, Fewer Is BetterGPAW 23.6Input: Carbon NanotubeUbuntu Linux 23.10Fedora Server 394080120160200Min: 37.5 / Avg: 38.64 / Max: 41.1Min: 192.94 / Avg: 194.51 / Max: 196.191. (CC) gcc options: -shared -lxc -lblas -lmpi

Input: Carbon Nanotube

CentOS Stream 9: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'gpaw'

Arch Linux: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'gpaw'

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Random ReadUbuntu Linux 23.10Fedora Server 39Arch Linux140M280M420M560M700MSE +/- 7527805.83, N = 15SE +/- 3865049.53, N = 3SE +/- 7708164.70, N = 3599822046652854125608345894-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Random ReadUbuntu Linux 23.10Fedora Server 39Arch Linux110M220M330M440M550MMin: 549190504 / Avg: 599822045.93 / Max: 620705442Min: 645213220 / Avg: 652854125 / Max: 657688605Min: 593015193 / Avg: 608345894.33 / Max: 6174164521. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Random Read

CentOS Stream 9: The test quit with a non-zero exit status. E: rocksdb: line 4: ./db_bench: No such file or directory

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux50100150200250SE +/- 2.84, N = 4SE +/- 0.55, N = 3SE +/- 2.84, N = 4SE +/- 2.90, N = 4245.98241.67241.70240.65-pie - MIN: 176.44 / MAX: 390.61-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 160.04 / MAX: 556.9-pie - MIN: 163.92 / MAX: 559.83-pie - MIN: 175.12 / MAX: 455.81. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200Min: 241.93 / Avg: 245.98 / Max: 254.37Min: 240.67 / Avg: 241.67 / Max: 242.57Min: 237.14 / Avg: 241.7 / Max: 249.99Min: 235.77 / Avg: 240.65 / Max: 248.941. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux110220330440550SE +/- 5.90, N = 4SE +/- 1.20, N = 3SE +/- 6.06, N = 4SE +/- 6.17, N = 4519.83528.79529.14531.53-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux90180270360450Min: 502.36 / Avg: 519.83 / Max: 528.08Min: 527 / Avg: 528.79 / Max: 531.07Min: 511.4 / Avg: 529.14 / Max: 538.69Min: 513.84 / Avg: 531.53 / Max: 541.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux510152025SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 320.6520.5020.4420.67
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.1Benchmark: particle_volume/ao/real_timeUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux510152025Min: 20.6 / Avg: 20.65 / Max: 20.73Min: 20.49 / Avg: 20.5 / Max: 20.52Min: 20.33 / Avg: 20.44 / Max: 20.5Min: 20.6 / Avg: 20.67 / Max: 20.77

RawTherapee

RawTherapee is a cross-platform, open-source multi-threaded RAW image processing program. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRawTherapeeTotal Benchmark TimeUbuntu Linux 23.10Fedora Server 39Arch Linux306090120150SE +/- 0.65, N = 3SE +/- 0.45, N = 3SE +/- 0.34, N = 3129.08118.23107.051. Ubuntu Linux 23.10: RawTherapee, version 5.9, command line.2. Fedora Server 39: RawTherapee, version 5.10, command line.3. Arch Linux: RawTherapee, version 5.10, command line.
OpenBenchmarking.orgSeconds, Fewer Is BetterRawTherapeeTotal Benchmark TimeUbuntu Linux 23.10Fedora Server 39Arch Linux20406080100Min: 128.34 / Avg: 129.08 / Max: 130.37Min: 117.74 / Avg: 118.23 / Max: 119.13Min: 106.39 / Avg: 107.05 / Max: 107.511. Ubuntu Linux 23.10: RawTherapee, version 5.9, command line.2. Fedora Server 39: RawTherapee, version 5.10, command line.3. Arch Linux: RawTherapee, version 5.10, command line.

Total Benchmark Time

CentOS Stream 9: The test run did not produce a result.

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux3691215SE +/- 0.18, N = 3SE +/- 0.14, N = 5SE +/- 0.16, N = 4SE +/- 0.16, N = 312.7412.6512.6912.54-pie - MIN: 10.88 / MAX: 73.62-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 10.9 / MAX: 74.36-pie - MIN: 10.9 / MAX: 75.69-pie - MIN: 10.74 / MAX: 50.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux48121620Min: 12.53 / Avg: 12.74 / Max: 13.1Min: 12.51 / Avg: 12.65 / Max: 13.19Min: 12.51 / Avg: 12.69 / Max: 13.17Min: 12.38 / Avg: 12.54 / Max: 12.851. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2K4K6K8K10KSE +/- 140.94, N = 3SE +/- 104.96, N = 5SE +/- 124.93, N = 4SE +/- 125.31, N = 310033.9510113.4710082.9310197.22-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2K4K6K8K10KMin: 9753.41 / Avg: 10033.95 / Max: 10197.96Min: 9693.66 / Avg: 10113.47 / Max: 10221.13Min: 9708.61 / Avg: 10082.93 / Max: 10219.99Min: 9946.78 / Avg: 10197.22 / Max: 10330.731. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux14002800420056007000SE +/- 60.98, N = 6SE +/- 28.01, N = 3SE +/- 44.43, N = 3632463036399
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux11002200330044005500Min: 6161 / Avg: 6323.67 / Max: 6598Min: 6254 / Avg: 6303.33 / Max: 6351Min: 6327 / Avg: 6398.67 / Max: 6480

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux8K16K24K32K40KSE +/- 564.37, N = 15SE +/- 119.27, N = 3SE +/- 138.45, N = 3372853469833976
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux6K12K18K24K30KMin: 35880 / Avg: 37285.13 / Max: 41754Min: 34545 / Avg: 34698 / Max: 34933Min: 33748 / Avg: 33975.67 / Max: 34226

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux3K6K9K12K15KSE +/- 177.62, N = 4SE +/- 37.95, N = 3SE +/- 37.30, N = 3145081442213639
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux3K6K9K12K15KMin: 14307 / Avg: 14508.25 / Max: 15040Min: 14376 / Avg: 14421.67 / Max: 14497Min: 13565 / Avg: 13639.33 / Max: 13682

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadUbuntu Linux 23.10Fedora Server 39Arch Linux130M260M390M520M650MSE +/- 5282775.06, N = 8SE +/- 8524314.28, N = 3SE +/- 6923132.62, N = 4600703384626261826616573385-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadUbuntu Linux 23.10Fedora Server 39Arch Linux110M220M330M440M550MMin: 564474811 / Avg: 600703384.25 / Max: 609550741Min: 609376698 / Avg: 626261826.33 / Max: 636744276Min: 595836457 / Avg: 616573384.5 / Max: 6241065351. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Random Read

CentOS Stream 9: The test quit with a non-zero exit status. E: speedb: line 4: ./db_bench: No such file or directory

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.53891.07781.61672.15562.6945SE +/- 0.007, N = 3SE +/- 0.009, N = 3SE +/- 0.008, N = 3SE +/- 0.009, N = 32.3072.3582.3462.3951. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 2.29 / Avg: 2.31 / Max: 2.32Min: 2.34 / Avg: 2.36 / Max: 2.37Min: 2.34 / Avg: 2.35 / Max: 2.36Min: 2.38 / Avg: 2.39 / Max: 2.411. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux14002800420056007000SE +/- 77.79, N = 4SE +/- 13.35, N = 3SE +/- 40.01, N = 3644863146380
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux11002200330044005500Min: 6237 / Avg: 6448.25 / Max: 6612Min: 6292 / Avg: 6313.67 / Max: 6338Min: 6315 / Avg: 6380.33 / Max: 6453

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux3K6K9K12K15KSE +/- 25.12, N = 3SE +/- 36.03, N = 3SE +/- 13.00, N = 3122431226211658
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux2K4K6K8K10KMin: 12199 / Avg: 12242.67 / Max: 12286Min: 12220 / Avg: 12262.33 / Max: 12334Min: 11632 / Avg: 11658 / Max: 11671

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux48121620SE +/- 0.13, N = 7SE +/- 0.13, N = 7SE +/- 0.18, N = 314.0614.3214.10
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux48121620Min: 13.91 / Avg: 14.06 / Max: 14.85Min: 14.11 / Avg: 14.32 / Max: 15.1Min: 13.92 / Avg: 14.1 / Max: 14.45

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux10002000300040005000SE +/- 40.60, N = 7SE +/- 40.12, N = 7SE +/- 55.62, N = 34547.544462.534534.89
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux8001600240032004000Min: 4304.15 / Avg: 4547.54 / Max: 4591.83Min: 4228.43 / Avg: 4462.53 / Max: 4525.46Min: 4423.65 / Avg: 4534.89 / Max: 4590.59

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux3K6K9K12K15KSE +/- 3.51, N = 3SE +/- 22.15, N = 3SE +/- 32.00, N = 3120861218711575
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux2K4K6K8K10KMin: 12079 / Avg: 12086 / Max: 12090Min: 12159 / Avg: 12187.33 / Max: 12231Min: 11515 / Avg: 11575.33 / Max: 11624

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux16003200480064008000SE +/- 31.90, N = 3SE +/- 91.12, N = 4SE +/- 29.16, N = 3732174247043
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux13002600390052006500Min: 7277 / Avg: 7321 / Max: 7383Min: 7308 / Avg: 7424 / Max: 7696Min: 6992 / Avg: 7043 / Max: 7093

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux9001800270036004500SE +/- 47.59, N = 4SE +/- 21.55, N = 3SE +/- 13.25, N = 3435343774173
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux8001600240032004000Min: 4248 / Avg: 4352.5 / Max: 4479Min: 4353 / Avg: 4377 / Max: 4420Min: 4157 / Avg: 4172.67 / Max: 4199

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1224364860SE +/- 0.36, N = 3SE +/- 0.23, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 353.7953.0253.6753.08-pie - MIN: 44.62 / MAX: 198.12-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 42.98 / MAX: 178.63-pie - MIN: 43.29 / MAX: 161.25-pie - MIN: 44.51 / MAX: 131.91. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1122334455Min: 53.4 / Avg: 53.79 / Max: 54.51Min: 52.64 / Avg: 53.02 / Max: 53.42Min: 53.52 / Avg: 53.67 / Max: 53.86Min: 52.87 / Avg: 53.08 / Max: 53.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux5001000150020002500SE +/- 15.67, N = 3SE +/- 10.50, N = 3SE +/- 4.46, N = 3SE +/- 6.39, N = 32377.902412.512383.222409.76-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux400800120016002000Min: 2346.58 / Avg: 2377.9 / Max: 2394.64Min: 2394.21 / Avg: 2412.51 / Max: 2430.59Min: 2374.98 / Avg: 2383.22 / Max: 2390.28Min: 2397.62 / Avg: 2409.76 / Max: 2419.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux90180270360450SE +/- 2.51, N = 3SE +/- 0.86, N = 3SE +/- 3.56, N = 3409.01416.68413.38
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux70140210280350Min: 406.41 / Avg: 409.01 / Max: 414.02Min: 415.09 / Avg: 416.68 / Max: 418.06Min: 409.19 / Avg: 413.38 / Max: 420.47

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150SE +/- 0.87, N = 3SE +/- 0.32, N = 3SE +/- 1.36, N = 3155.82152.57154.32
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150Min: 154.08 / Avg: 155.82 / Max: 156.83Min: 151.98 / Avg: 152.57 / Max: 153.09Min: 151.65 / Avg: 154.32 / Max: 156.07

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux20406080100SE +/- 0.11, N = 3SE +/- 0.81, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 385.0697.3493.7481.35-pie - MIN: 39.38 / MAX: 260.96-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.82 / MAX: 325.84-pie - MIN: 34.75 / MAX: 283.24-pie - MIN: 38.9 / MAX: 148.691. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux20406080100Min: 84.92 / Avg: 85.06 / Max: 85.27Min: 96.4 / Avg: 97.34 / Max: 98.94Min: 93.38 / Avg: 93.74 / Max: 93.94Min: 81.23 / Avg: 81.35 / Max: 81.551. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux90180270360450SE +/- 0.48, N = 3SE +/- 2.69, N = 3SE +/- 0.63, N = 3SE +/- 0.49, N = 3375.75328.37340.97392.84-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux70140210280350Min: 374.81 / Avg: 375.75 / Max: 376.38Min: 323.02 / Avg: 328.37 / Max: 331.55Min: 340.27 / Avg: 340.97 / Max: 342.23Min: 391.88 / Avg: 392.84 / Max: 393.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux48121620SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 314.3714.3614.4314.28-pie - MIN: 12.05 / MAX: 72.49-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 12.55 / MAX: 76.83-pie - MIN: 12.18 / MAX: 71.66-pie - MIN: 12.05 / MAX: 46.921. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux48121620Min: 14.33 / Avg: 14.37 / Max: 14.43Min: 14.34 / Avg: 14.36 / Max: 14.38Min: 14.4 / Avg: 14.43 / Max: 14.46Min: 14.22 / Avg: 14.28 / Max: 14.391. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux2K4K6K8K10KSE +/- 20.48, N = 3SE +/- 7.04, N = 3SE +/- 9.74, N = 3SE +/- 34.95, N = 38901.618908.748862.078956.37-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux16003200480064008000Min: 8860.79 / Avg: 8901.61 / Max: 8925.05Min: 8895.89 / Avg: 8908.74 / Max: 8920.14Min: 8843.94 / Avg: 8862.07 / Max: 8877.29Min: 8886.47 / Avg: 8956.37 / Max: 8992.071. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.18132.36263.54394.72525.9065SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 35.205.255.255.24-pie - MIN: 4.59 / MAX: 31.78-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 4.69 / MAX: 58.72-pie - MIN: 4.62 / MAX: 31.26-pie - MIN: 4.62 / MAX: 25.21. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 5.15 / Avg: 5.2 / Max: 5.29Min: 5.24 / Avg: 5.25 / Max: 5.26Min: 5.2 / Avg: 5.25 / Max: 5.29Min: 5.18 / Avg: 5.24 / Max: 5.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux5K10K15K20K25KSE +/- 208.25, N = 3SE +/- 36.89, N = 3SE +/- 130.19, N = 3SE +/- 269.84, N = 324570.1024295.7124296.5424355.33-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4K8K12K16K20KMin: 24154.22 / Avg: 24570.1 / Max: 24797.67Min: 24249.83 / Avg: 24295.71 / Max: 24368.69Min: 24104.46 / Avg: 24296.54 / Max: 24544.82Min: 23816.73 / Avg: 24355.33 / Max: 24654.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux918273645SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.05, N = 339.7640.0239.3040.11-pie - MIN: 37.84 / MAX: 104.98-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 33.6 / MAX: 102.02-pie - MIN: 33.26 / MAX: 101.52-pie - MIN: 38.25 / MAX: 97.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux816243240Min: 39.72 / Avg: 39.76 / Max: 39.79Min: 40.01 / Avg: 40.02 / Max: 40.05Min: 39.19 / Avg: 39.3 / Max: 39.38Min: 40.03 / Avg: 40.11 / Max: 40.191. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux7001400210028003500SE +/- 1.65, N = 3SE +/- 1.03, N = 3SE +/- 4.78, N = 3SE +/- 3.83, N = 33217.843196.473255.163189.70-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux6001200180024003000Min: 3214.96 / Avg: 3217.84 / Max: 3220.69Min: 3194.43 / Avg: 3196.47 / Max: 3197.78Min: 3248.91 / Avg: 3255.16 / Max: 3264.54Min: 3182.78 / Avg: 3189.7 / Max: 3196.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.67951.3592.03852.7183.3975SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 32.853.022.862.94-pie - MIN: 2.08 / MAX: 32.04-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF - MIN: 2.07 / MAX: 29.73-pie - MIN: 1.94 / MAX: 41.9-pie - MIN: 2.09 / MAX: 30.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 2.85 / Avg: 2.85 / Max: 2.85Min: 2.98 / Avg: 3.02 / Max: 3.06Min: 2.83 / Avg: 2.86 / Max: 2.87Min: 2.9 / Avg: 2.94 / Max: 2.961. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux9K18K27K36K45KSE +/- 43.54, N = 3SE +/- 347.22, N = 3SE +/- 194.22, N = 3SE +/- 312.18, N = 343516.9840187.3442419.8941472.25-pie-isystem -std=c++11 -fPIC -fvisibility=hidden -MD -MT -MF-pie-pie1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux8K16K24K32K40KMin: 43430.19 / Avg: 43516.98 / Max: 43566.52Min: 39688.93 / Avg: 40187.34 / Max: 40855.31Min: 42181.29 / Avg: 42419.89 / Max: 42804.65Min: 41153.06 / Avg: 41472.25 / Max: 42096.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux8001600240032004000SE +/- 3.21, N = 3SE +/- 16.22, N = 3SE +/- 21.20, N = 3371836833591
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux6001200180024003000Min: 3713 / Avg: 3718 / Max: 3724Min: 3656 / Avg: 3682.67 / Max: 3712Min: 3565 / Avg: 3591 / Max: 3633

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux60120180240300SE +/- 0.00, N = 3SE +/- 1.45, N = 3SE +/- 0.67, N = 3276276265
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux50100150200250Min: 276 / Avg: 276 / Max: 276Min: 273 / Avg: 275.67 / Max: 278Min: 264 / Avg: 264.67 / Max: 266

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux1.30122.60243.90365.20486.506SE +/- 0.0557, N = 7SE +/- 0.0226, N = 3SE +/- 0.0549, N = 75.75155.78335.6953
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux246810Min: 5.67 / Avg: 5.75 / Max: 6.08Min: 5.76 / Avg: 5.78 / Max: 5.83Min: 5.62 / Avg: 5.7 / Max: 6.02

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux2K4K6K8K10KSE +/- 102.73, N = 7SE +/- 43.63, N = 3SE +/- 102.84, N = 711099.6411022.3011213.16
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux2K4K6K8K10KMin: 10503.83 / Avg: 11099.64 / Max: 11258.92Min: 10935.63 / Avg: 11022.3 / Max: 11074.41Min: 10599.98 / Avg: 11213.16 / Max: 11357.68

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux50100150200250SE +/- 0.33, N = 3SE +/- 0.88, N = 3SE +/- 0.33, N = 3234235226
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux4080120160200Min: 234 / Avg: 234.33 / Max: 235Min: 234 / Avg: 235.33 / Max: 237Min: 225 / Avg: 225.67 / Max: 226

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux8001600240032004000SE +/- 7.45, N = 3SE +/- 43.59, N = 3SE +/- 5.13, N = 3369436553544
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux6001200180024003000Min: 3680 / Avg: 3694.33 / Max: 3705Min: 3579 / Avg: 3654.67 / Max: 3730Min: 3534 / Avg: 3544 / Max: 3551

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux50100150200250SE +/- 0.33, N = 3SE +/- 0.33, N = 3SE +/- 0.00, N = 3233233223
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux4080120160200Min: 233 / Avg: 233.33 / Max: 234Min: 233 / Avg: 233.33 / Max: 234Min: 223 / Avg: 223 / Max: 223

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux2004006008001000SE +/- 3.48, N = 3SE +/- 9.82, N = 4SE +/- 3.93, N = 3914902874
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux160320480640800Min: 908 / Avg: 913.67 / Max: 920Min: 884 / Avg: 902 / Max: 930Min: 869 / Avg: 874.33 / Max: 882

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

CloverLeaf

CloverLeaf is a Lagrangian-Eulerian hydrodynamics benchmark. This test profile currently makes use of CloverLeaf's OpenMP version. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux714212835SE +/- 0.23, N = 11SE +/- 0.12, N = 3SE +/- 0.40, N = 3SE +/- 0.27, N = 332.1025.0131.6330.301. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp
OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux714212835Min: 30.88 / Avg: 32.1 / Max: 33.56Min: 24.82 / Avg: 25.01 / Max: 25.24Min: 30.96 / Avg: 31.63 / Max: 32.33Min: 29.97 / Avg: 30.3 / Max: 30.831. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

OSPRay Studio

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux2004006008001000SE +/- 3.53, N = 3SE +/- 2.03, N = 3SE +/- 3.18, N = 3911897867
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux160320480640800Min: 906 / Avg: 911.33 / Max: 918Min: 894 / Avg: 897.33 / Max: 901Min: 863 / Avg: 866.67 / Max: 873

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux2004006008001000SE +/- 2.40, N = 3SE +/- 2.96, N = 3SE +/- 2.33, N = 3107910581026
OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUUbuntu Linux 23.10Fedora Server 39Arch Linux2004006008001000Min: 1074 / Avg: 1078.67 / Max: 1082Min: 1052 / Avg: 1057.67 / Max: 1062Min: 1022 / Avg: 1025.67 / Max: 1030

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

CentOS Stream 9: The test quit with a non-zero exit status. E: ospStudio: /lib64/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by ospStudio)

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 5BUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux816243240SE +/- 0.07, N = 3SE +/- 0.17, N = 3SE +/- 0.43, N = 3SE +/- 0.37, N = 529.8232.8533.7333.65
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 5BUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux714212835Min: 29.69 / Avg: 29.82 / Max: 29.89Min: 32.53 / Avg: 32.85 / Max: 33.1Min: 33.28 / Avg: 33.73 / Max: 34.6Min: 33.11 / Avg: 33.65 / Max: 35.1

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Update RandomUbuntu Linux 23.10Fedora Server 39Arch Linux30K60K90K120K150KSE +/- 440.29, N = 3SE +/- 1187.74, N = 3SE +/- 1143.37, N = 3125560123092127451-lpthread1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti
OpenBenchmarking.orgOp/s, More Is BetterRocksDB 8.0Test: Update RandomUbuntu Linux 23.10Fedora Server 39Arch Linux20K40K60K80K100KMin: 124805 / Avg: 125560 / Max: 126330Min: 121863 / Avg: 123092 / Max: 125467Min: 126103 / Avg: 127451.33 / Max: 1297251. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Test: Update Random

CentOS Stream 9: The test quit with a non-zero exit status. E: rocksdb: line 4: ./db_bench: No such file or directory

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150SE +/- 0.29, N = 3SE +/- 0.30, N = 3SE +/- 0.47, N = 3132.68132.91134.21
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150Min: 132.12 / Avg: 132.68 / Max: 133.08Min: 132.31 / Avg: 132.91 / Max: 133.3Min: 133.28 / Avg: 134.21 / Max: 134.77

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux100200300400500SE +/- 0.91, N = 3SE +/- 0.62, N = 3SE +/- 1.54, N = 3478.76478.03474.24
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux80160240320400Min: 477.5 / Avg: 478.76 / Max: 480.53Min: 477.29 / Avg: 478.03 / Max: 479.26Min: 472.29 / Avg: 474.24 / Max: 477.28

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1632486480SE +/- 0.48, N = 15SE +/- 0.39, N = 3SE +/- 0.99, N = 3SE +/- 0.15, N = 366.8669.8771.5273.721. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1428425670Min: 64.49 / Avg: 66.86 / Max: 70.29Min: 69.36 / Avg: 69.87 / Max: 70.64Min: 70.01 / Avg: 71.52 / Max: 73.39Min: 73.42 / Avg: 73.72 / Max: 73.91. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux80160240320400SE +/- 2.37, N = 3SE +/- 0.14, N = 3SE +/- 4.23, N = 4361.29366.38351.75
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux70140210280350Min: 358.07 / Avg: 361.29 / Max: 365.9Min: 366.1 / Avg: 366.38 / Max: 366.55Min: 343.03 / Avg: 351.75 / Max: 362.02

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux4080120160200SE +/- 1.16, N = 3SE +/- 0.21, N = 3SE +/- 2.15, N = 4176.57173.95181.33
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150Min: 174.37 / Avg: 176.57 / Max: 178.29Min: 173.71 / Avg: 173.95 / Max: 174.37Min: 176.24 / Avg: 181.33 / Max: 185.84

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

LAMMPS Molecular Dynamics Simulator

LAMMPS is a classical molecular dynamics code, and an acronym for Large-scale Atomic/Molecular Massively Parallel Simulator. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1020304050SE +/- 0.93, N = 15SE +/- 0.76, N = 15SE +/- 0.95, N = 15SE +/- 0.85, N = 1237.5239.8039.0142.751. (CXX) g++ options: -O3 -lm -ldl
OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux918273645Min: 30.91 / Avg: 37.52 / Max: 42.28Min: 37.01 / Avg: 39.79 / Max: 48.79Min: 33.95 / Avg: 39.01 / Max: 47.89Min: 40.99 / Avg: 42.75 / Max: 49.641. (CXX) g++ options: -O3 -lm -ldl

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux100200300400500SE +/- 0.78, N = 3SE +/- 0.34, N = 3SE +/- 1.04, N = 3477.14476.58471.82
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux80160240320400Min: 476.07 / Avg: 477.14 / Max: 478.65Min: 476.13 / Avg: 476.58 / Max: 477.25Min: 469.98 / Avg: 471.82 / Max: 473.58

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150SE +/- 0.24, N = 3SE +/- 0.09, N = 3SE +/- 0.39, N = 3133.21133.28134.93
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux306090120150Min: 132.76 / Avg: 133.21 / Max: 133.58Min: 133.14 / Avg: 133.28 / Max: 133.46Min: 134.24 / Avg: 134.93 / Max: 135.6

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux816243240SE +/- 0.38, N = 3SE +/- 0.32, N = 3SE +/- 0.42, N = 334.2535.2834.04
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux816243240Min: 33.68 / Avg: 34.25 / Max: 34.97Min: 34.73 / Avg: 35.28 / Max: 35.82Min: 33.59 / Avg: 34.04 / Max: 34.88

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux400800120016002000SE +/- 20.52, N = 3SE +/- 16.06, N = 3SE +/- 22.85, N = 31866.231810.951878.45
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux30060090012001500Min: 1827.66 / Avg: 1866.23 / Max: 1897.64Min: 1783.7 / Avg: 1810.95 / Max: 1839.3Min: 1832.77 / Avg: 1878.45 / Max: 1902.62

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux510152025SE +/- 0.19, N = 3SE +/- 0.21, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 321.3221.5621.1622.051. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux510152025Min: 20.93 / Avg: 21.32 / Max: 21.51Min: 21.2 / Avg: 21.56 / Max: 21.94Min: 20.99 / Avg: 21.16 / Max: 21.32Min: 21.9 / Avg: 22.05 / Max: 22.181. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux1224364860SE +/- 0.63, N = 3SE +/- 0.70, N = 3SE +/- 0.55, N = 352.2852.2452.12
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux1020304050Min: 51.64 / Avg: 52.28 / Max: 53.54Min: 51.32 / Avg: 52.24 / Max: 53.62Min: 51.57 / Avg: 52.12 / Max: 53.21

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux30060090012001500SE +/- 14.85, N = 3SE +/- 15.64, N = 3SE +/- 12.68, N = 31223.161223.651227.37
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux2004006008001000Min: 1193.47 / Avg: 1223.16 / Max: 1238.18Min: 1192.97 / Avg: 1223.65 / Max: 1244.28Min: 1202.02 / Avg: 1227.37 / Max: 1240.25

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux816243240SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 334.7634.2934.21
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux714212835Min: 34.58 / Avg: 34.76 / Max: 34.97Min: 34.15 / Avg: 34.29 / Max: 34.46Min: 33.95 / Avg: 34.21 / Max: 34.56

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux400800120016002000SE +/- 7.36, N = 3SE +/- 4.86, N = 3SE +/- 9.98, N = 31837.111863.341868.77
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux30060090012001500Min: 1823.18 / Avg: 1837.11 / Max: 1848.19Min: 1854.38 / Avg: 1863.34 / Max: 1871.08Min: 1849.83 / Avg: 1868.77 / Max: 1883.71

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux20406080100SE +/- 0.46, N = 3SE +/- 0.41, N = 3SE +/- 0.21, N = 377.0277.1776.66
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux1530456075Min: 76.55 / Avg: 77.02 / Max: 77.94Min: 76.44 / Avg: 77.17 / Max: 77.88Min: 76.31 / Avg: 76.66 / Max: 77.03

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux2004006008001000SE +/- 5.31, N = 3SE +/- 4.43, N = 3SE +/- 2.18, N = 3829.51827.99834.19
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux150300450600750Min: 818.89 / Avg: 829.51 / Max: 834.87Min: 820.13 / Avg: 827.99 / Max: 835.46Min: 830.34 / Avg: 834.19 / Max: 837.89

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux816243240SE +/- 0.31, N = 3SE +/- 0.07, N = 3SE +/- 0.14, N = 334.9934.2334.74
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux714212835Min: 34.6 / Avg: 34.99 / Max: 35.61Min: 34.09 / Avg: 34.23 / Max: 34.33Min: 34.48 / Avg: 34.74 / Max: 34.92

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux400800120016002000SE +/- 16.26, N = 3SE +/- 3.56, N = 3SE +/- 7.12, N = 31826.041866.521839.98
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux30060090012001500Min: 1794.11 / Avg: 1826.04 / Max: 1847.36Min: 1860.92 / Avg: 1866.52 / Max: 1873.12Min: 1830.6 / Avg: 1839.98 / Max: 1853.95

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux20406080100SE +/- 0.50, N = 3SE +/- 0.70, N = 3SE +/- 0.70, N = 374.8874.8074.53
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux1428425670Min: 74.35 / Avg: 74.88 / Max: 75.88Min: 74.07 / Avg: 74.8 / Max: 76.2Min: 73.73 / Avg: 74.53 / Max: 75.92

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux2004006008001000SE +/- 6.05, N = 3SE +/- 8.06, N = 3SE +/- 8.02, N = 3853.21853.34857.85
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamUbuntu Linux 23.10CentOS Stream 9Arch Linux150300450600750Min: 841.12 / Avg: 853.21 / Max: 859.47Min: 837.23 / Avg: 853.34 / Max: 861.9Min: 841.91 / Avg: 857.85 / Max: 867.34

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

Fedora Server 39: The test quit with a non-zero exit status. E: deepsparse: line 2: /.local/bin/deepsparse.benchmark: No such file or directory

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux0.56481.12961.69442.25922.824SE +/- 0.01, N = 3SE +/- 0.03, N = 4SE +/- 0.01, N = 15SE +/- 0.03, N = 32.182.512.252.36
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RTLightmap.hdr.4096x4096 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 2.17 / Avg: 2.18 / Max: 2.19Min: 2.42 / Avg: 2.51 / Max: 2.55Min: 2.14 / Avg: 2.25 / Max: 2.36Min: 2.3 / Avg: 2.36 / Max: 2.39

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux306090120150SE +/- 0.25, N = 3SE +/- 1.24, N = 15SE +/- 1.32, N = 15SE +/- 0.13, N = 3100.34105.62142.17118.74MIN: 95.92 / MAX: 109.46MIN: 95.01 / MAX: 132.75MIN: 115.81 / MAX: 164.58MIN: 113.06 / MAX: 135.85
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux306090120150Min: 99.99 / Avg: 100.34 / Max: 100.82Min: 99.1 / Avg: 105.62 / Max: 114.68Min: 132.06 / Avg: 142.17 / Max: 148.27Min: 118.53 / Avg: 118.74 / Max: 118.96

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1632486480SE +/- 0.74, N = 5SE +/- 0.99, N = 3SE +/- 0.53, N = 3SE +/- 0.36, N = 366.4369.7270.8772.911. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1428425670Min: 64.81 / Avg: 66.43 / Max: 69.02Min: 67.84 / Avg: 69.72 / Max: 71.2Min: 70.2 / Avg: 70.87 / Max: 71.91Min: 72.52 / Avg: 72.91 / Max: 73.631. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.10252.2053.30754.415.5125SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 15SE +/- 0.02, N = 34.544.904.704.75
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 4.48 / Avg: 4.54 / Max: 4.65Min: 4.84 / Avg: 4.9 / Max: 4.95Min: 4.45 / Avg: 4.7 / Max: 4.86Min: 4.72 / Avg: 4.75 / Max: 4.78

Y-Cruncher

Y-Cruncher is a multi-threaded Pi benchmark capable of computing Pi to trillions of digits. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810SE +/- 0.037, N = 3SE +/- 0.045, N = 3SE +/- 0.088, N = 5SE +/- 0.109, N = 37.2077.9138.2707.561
OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.3Pi Digits To Calculate: 1BUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux3691215Min: 7.16 / Avg: 7.21 / Max: 7.28Min: 7.83 / Avg: 7.91 / Max: 7.97Min: 7.95 / Avg: 8.27 / Max: 8.42Min: 7.41 / Avg: 7.56 / Max: 7.77

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux4080120160200SE +/- 0.50, N = 3SE +/- 3.90, N = 15SE +/- 0.73, N = 3SE +/- 0.19, N = 3144.92177.80179.54148.60MIN: 137.85 / MAX: 155.04MIN: 142.88 / MAX: 210.57MIN: 145.33 / MAX: 207.47MIN: 140.37 / MAX: 169.21
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux306090120150Min: 143.93 / Avg: 144.92 / Max: 145.48Min: 150.94 / Avg: 177.8 / Max: 196.85Min: 178.13 / Avg: 179.54 / Max: 180.54Min: 148.34 / Avg: 148.6 / Max: 148.97

ACES DGEMM

This is a multi-threaded DGEMM benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1428425670SE +/- 0.09, N = 3SE +/- 0.51, N = 3SE +/- 0.04, N = 3SE +/- 0.91, N = 1337.9763.6437.7243.671. (CC) gcc options: -O3 -march=native -fopenmp
OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1224364860Min: 37.86 / Avg: 37.97 / Max: 38.14Min: 62.83 / Avg: 63.64 / Max: 64.57Min: 37.65 / Avg: 37.72 / Max: 37.8Min: 37.1 / Avg: 43.67 / Max: 50.471. (CC) gcc options: -O3 -march=native -fopenmp

Intel Open Image Denoise

Open Image Denoise is a denoising library for ray-tracing and part of the Intel oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux1.1342.2683.4024.5365.67SE +/- 0.02, N = 3SE +/- 0.07, N = 3SE +/- 0.06, N = 3SE +/- 0.01, N = 34.535.044.684.75
OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.2Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-OnlyUbuntu Linux 23.10CentOS Stream 9Fedora Server 39Arch Linux246810Min: 4.49 / Avg: 4.53 / Max: 4.55Min: 4.9 / Avg: 5.04 / Max: 5.15Min: 4.6 / Avg: 4.68 / Max: 4.79Min: 4.74 / Avg: 4.75 / Max: 4.77

125 Results Shown

NWChem
Quicksilver:
  CTS2
  CORAL2 P2
OpenVKL
easyWave
Quicksilver
TensorFlow
NAMD
ClickHouse:
  100M Rows Hits Dataset, Third Run
  100M Rows Hits Dataset, Second Run
  100M Rows Hits Dataset, First Run / Cold Cache
High Performance Conjugate Gradient
LeelaChessZero
CloverLeaf
PostgreSQL:
  100 - 1000 - Read Only - Average Latency
  100 - 1000 - Read Only
  100 - 1000 - Read Write - Average Latency
  100 - 1000 - Read Write
OSPRay Studio:
  2 - 4K - 32 - Path Tracer - CPU
  1 - 4K - 32 - Path Tracer - CPU
GROMACS
Memcached
VVenC
OSPRay
NAMD
7-Zip Compression:
  Decompression Rating
  Compression Rating
Xcompact3d Incompact3d
OpenVINO:
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    ms
    FPS
High Performance Conjugate Gradient
Redis
RocksDB
OpenVINO:
  Machine Translation EN To DE FP16 - CPU:
    ms
    FPS
Memcached
LAMMPS Molecular Dynamics Simulator
Redis
Graph500:
  26:
    sssp max_TEPS
    sssp median_TEPS
    bfs max_TEPS
    bfs median_TEPS
OSPRay
LeelaChessZero
RocksDB
VVenC
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
GPAW
RocksDB
OpenVINO:
  Face Detection FP16-INT8 - CPU:
    ms
    FPS
OSPRay
RawTherapee
OpenVINO:
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
OSPRay Studio:
  2 - 1080p - 32 - Path Tracer - CPU
  3 - 4K - 32 - Path Tracer - CPU
  3 - 4K - 16 - Path Tracer - CPU
Speedb
SVT-AV1
OSPRay Studio:
  1 - 1080p - 32 - Path Tracer - CPU
  2 - 4K - 16 - Path Tracer - CPU
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream:
    ms/batch
    items/sec
OSPRay Studio:
  1 - 4K - 16 - Path Tracer - CPU
  3 - 1080p - 32 - Path Tracer - CPU
  3 - 1080p - 16 - Path Tracer - CPU
OpenVINO:
  Road Segmentation ADAS FP16-INT8 - CPU:
    ms
    FPS
Neural Magic DeepSparse:
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream:
    ms/batch
    items/sec
OpenVINO:
  Person Detection FP16 - CPU:
    ms
    FPS
  Vehicle Detection FP16-INT8 - CPU:
    ms
    FPS
  Face Detection Retail FP16-INT8 - CPU:
    ms
    FPS
  Handwritten English Recognition FP16-INT8 - CPU:
    ms
    FPS
  Weld Porosity Detection FP16-INT8 - CPU:
    ms
    FPS
OSPRay Studio:
  1 - 1080p - 16 - Path Tracer - CPU
  3 - 1080p - 1 - Path Tracer - CPU
Neural Magic DeepSparse:
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream:
    ms/batch
    items/sec
OSPRay Studio:
  1 - 1080p - 1 - Path Tracer - CPU
  2 - 1080p - 16 - Path Tracer - CPU
  2 - 1080p - 1 - Path Tracer - CPU
  1 - 4K - 1 - Path Tracer - CPU
CloverLeaf
OSPRay Studio:
  2 - 4K - 1 - Path Tracer - CPU
  3 - 4K - 1 - Path Tracer - CPU
Y-Cruncher
RocksDB
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream:
    items/sec
    ms/batch
SVT-AV1
Neural Magic DeepSparse:
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream:
    ms/batch
    items/sec
LAMMPS Molecular Dynamics Simulator
Neural Magic DeepSparse:
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream:
    ms/batch
    items/sec
SVT-AV1
Neural Magic DeepSparse:
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  ResNet-50, Baseline - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    ms/batch
    items/sec
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream:
    ms/batch
    items/sec
Intel Open Image Denoise
Embree
SVT-AV1
Intel Open Image Denoise
Y-Cruncher
Embree
ACES DGEMM
Intel Open Image Denoise