New Tests

2 x Intel Xeon Platinum 8380 testing with a Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) and ASPEED on CentOS Stream 9 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2209017-NE-NEWTESTS349&grr.

New TestsProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionCentOS Stream 92 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Intel Device 0998512GB7682GB INTEL SSDPF2KX076TZASPEEDVE2282 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFPCentOS Stream 95.14.0-148.el9.x86_64 (x86_64)GNOME Shell 40.10X ServerGCC 11.3.1 20220421xfs1920x1080OpenBenchmarking.org- Transparent Huge Pages: always- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl - NONE / attr2,inode64,logbsize=32k,logbufs=8,noquota,relatime,rw,seclabel / Block Size: 4096 - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xd000363 - OpenJDK Runtime Environment (Red_Hat-11.0.16.0.8-2.el9) (build 11.0.16+8-LTS)- Python 3.9.13- SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

New Testsmnn: inception-v3mnn: mobilenet-v1-1.0mnn: MobileNetV2_224mnn: SqueezeNetV1.0mnn: resnet-v2-50mnn: squeezenetv1.1mnn: mobilenetV3mnn: nasnetpgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 500 - Read Onlyonnx: GPT-2 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardrenaissance: Finagle HTTP Requestsapache: 1000stockfish: Total Timerenaissance: ALS Movie Lensonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUospray: particle_volume/scivis/real_timeopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUrenaissance: In-Memory Database Shootoutopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUtensorflow-lite: Inception V4onednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUrenaissance: Savina Reactors.IOgraphics-magick: Rotateospray: particle_volume/pathtracer/real_timespark: 40000000 - 500 - Calculate Pi Benchmark Using Dataframespark: 40000000 - 500 - Calculate Pi Benchmarkspark: 40000000 - 500 - SHA-512 Benchmark Timetnn: CPU - DenseNetmemtier-benchmark: Redis - 50 - 5:1memtier-benchmark: Redis - 50 - 1:10natron: Spaceshipclickhouse: 100M Rows Web Analytics Dataset, Third Runclickhouse: 100M Rows Web Analytics Dataset, Second Runclickhouse: 100M Rows Web Analytics Dataset, First Run / Cold Cacheblender: Barbershop - CPU-Onlyospray: particle_volume/ao/real_timelammps: 20k Atomsopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUblosc: blosclz bitshuffletensorflow-lite: NASNet Mobiletensorflow-lite: SqueezeNettensorflow-lite: Mobilenet Floatgraphics-magick: HWB Color Spacewebp2: Quality 95, Compression Effort 7vpxenc: Speed 0 - Bosphorus 4Khpcg: blosc: blosclz shuffleredis: GET - 500ospray-studio: 3 - 4K - 32 - Path Tracerstress-ng: Atomicinfluxdb: 4 - 10000 - 2,5000,1 - 10000stress-ng: Futexstress-ng: Socket Activityospray-studio: 1 - 4K - 16 - Path Tracercompress-zstd: 8 - Decompression Speedcompress-zstd: 8 - Compression Speedpyhpc: CPU - Aesara - 4194304 - Isoneutral Mixingpgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 500 - Read Writeospray: gravity_spheres_volume/dim_512/scivis/real_timepgbench: 100 - 250 - Read Write - Average Latencypgbench: 100 - 250 - Read Writeospray: gravity_spheres_volume/dim_512/ao/real_timeredis: SET - 1000pgbench: 100 - 250 - Read Only - Average Latencypgbench: 100 - 250 - Read Onlyospray-studio: 2 - 4K - 32 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerbuild-llvm: Ninjaospray: gravity_spheres_volume/dim_512/pathtracer/real_timeredis: SET - 500pyhpc: CPU - Numpy - 4194304 - Isoneutral Mixingbuild-linux-kernel: defconfigsvt-av1: Preset 4 - Bosphorus 4Kospray-studio: 2 - 4K - 16 - Path Traceronnx: fcn-resnet101-11 - CPU - Parallelonnx: ArcFace ResNet-100 - CPU - Parallelonnx: GPT-2 - CPU - Parallelonnx: bertsquad-12 - CPU - Parallelonnx: yolov4 - CPU - Parallelonnx: bertsquad-12 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: super-resolution-10 - CPU - Parallelonnx: super-resolution-10 - CPU - Standardwebp2: Quality 75, Compression Effort 7ospray-studio: 3 - 4K - 16 - Path Tracerpyhpc: CPU - PyTorch - 4194304 - Isoneutral Mixingnode-express-loadtest: stress-ng: CPU Cachebuild-gdb: Time To Compilenginx: 1000x264: Bosphorus 4Kpyhpc: CPU - JAX - 4194304 - Isoneutral Mixingavifenc: 0blender: Pabellon Barcelona - CPU-Onlypyhpc: CPU - Numba - 4194304 - Isoneutral Mixingnode-web-tooling: renaissance: Rand Forestonednn: IP Shapes 1D - bf16bf16bf16 - CPUcompress-zstd: 19, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedsimdjson: PartialTweetssimdjson: DistinctUserIDsimdjson: TopTweetopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUpyhpc: CPU - Numpy - 4194304 - Equation of Stateopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUblender: Classroom - CPU-Onlyopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUtensorflow-lite: Inception ResNet V2tensorflow-lite: Mobilenet Quantgraphics-magick: Resizinggraphics-magick: Enhancedgraphics-magick: Sharpengraphics-magick: Noise-Gaussiangraphics-magick: Swirlsimdjson: Kostyasimdjson: LargeRandunpack-linux: linux-5.19.tar.xzrenaissance: Apache Spark Bayesavifenc: 2redis: GET - 1000avifenc: 6, Losslessonednn: IP Shapes 3D - bf16bf16bf16 - CPUwebp: Quality 100, Highest Compressioncompress-zstd: 19 - Decompression Speedcompress-zstd: 19 - Compression Speedcompress-7zip: Decompression Ratingcompress-7zip: Compression Ratingdacapobench: Jythonwebp: Quality 100, Lossless, Highest Compressionstress-ng: System V Message Passingstress-ng: Glibc C String Functionscompress-zstd: 8, Long Mode - Decompression Speedcompress-zstd: 8, Long Mode - Compression Speedtnn: CPU - MobileNet v2compress-zstd: 3 - Decompression Speedcompress-zstd: 3 - Compression Speedcompress-zstd: 3, Long Mode - Decompression Speedcompress-zstd: 3, Long Mode - Compression Speeddacapobench: Tradebeansblender: Fishy Cat - CPU-Onlypyhpc: CPU - PyTorch - 4194304 - Equation of Stategromacs: MPI CPU - water_GMX50_bareavifenc: 10, Losslessnamd: ATPase Simulation - 327,506 Atomsastcenc: Mediumstress-ng: NUMAstress-ng: x86_64 RdRandstress-ng: Forkingstress-ng: Mallocstress-ng: Memory Copyingstress-ng: MMAPstress-ng: Context Switchingstress-ng: Semaphoresstress-ng: CPU Stressstress-ng: SENDFILEstress-ng: MEMFDstress-ng: Glibc Qsort Data Sortingstress-ng: Cryptostress-ng: Matrix Mathstress-ng: Vector Mathredis: SET - 50pyhpc: CPU - TensorFlow - 4194304 - Equation of Stateredis: GET - 50openssl: openssl: blender: BMW27 - CPU-Onlytnn: CPU - SqueezeNet v1.1pyhpc: CPU - JAX - 4194304 - Equation of Statewebp: Quality 100, Losslessonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUdacapobench: H2svt-av1: Preset 8 - Bosphorus 4Kpyhpc: CPU - Aesara - 4194304 - Equation of Statesvt-vp9: PSNR/SSIM Optimized - Bosphorus 4Kwebp: Quality 100svt-vp9: Visual Quality Optimized - Bosphorus 4Kastcenc: Exhaustivesvt-vp9: VMAF Optimized - Bosphorus 4Kwebp2: Defaultonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUsvt-hevc: 7 - Bosphorus 4Kwebp: Defaultsvt-av1: Preset 10 - Bosphorus 4Kpyhpc: CPU - Numba - 4194304 - Equation of Stateastcenc: Thoroughsvt-av1: Preset 12 - Bosphorus 4Ksvt-hevc: 10 - Bosphorus 4Kastcenc: Fastonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUavifenc: 6tnn: CPU - SqueezeNet v2lammps: Rhodopsin Proteinpyhpc: CPU - TensorFlow - 4194304 - Isoneutral MixingCentOS Stream 920.0912.0902.6633.9568.6632.3561.75312.0970.27018556561104518818693.9131349.6017947312917123.9447.61624.295113.601478.6417787.21.5042731.9373896.5697.28221219.41030100.66962.7936.2188.833955.0461339297.911398073.701.9243.95244.38231.48257.1524.352735.12318.671071.703704.168713.016614.414240.411138233.7503.0440.28124916.72018201.0948319187775.77666008.71088788.922460.37201523017.51244.02.07826.7241871022.021512.0512074522.41741847194.120.15016693884085240580135.01925.58521931278.622.87829.6701.32720261236169352697996301093443694325912260111.920239672.060491016.2695.415200945.4934.570.86484.31682.891.37510.551455.25.406032635.743.44.855.775.621424.5713.92819.6324.291451.6213.671.936239.8683.2664.8285.47233.3332.002478.961.3647224.778.279657.994.524414.9437.9577847297.89540.862748115364173823402.910.969.1941075.348.7102406986.659.2602.385638.8022571.386.6371131467866560041.2087093379.739473078.173201.0307.5378.8793022.97026.13208.0281.01607033.370.1098.9966.6050.28138316.374310.37667284.3663484.45306750258.8412812.453747.586233126.457186364.51135517.461271967.054098.84934.2683808.91286293.40322923.092189377.080.2222284227.21112427.216866.125.04366.4930.03121.1153.81155984738.6750.303115.503.04499.274.5054112.932.6673.6840486.672.16365.6200.26446.384892.832113.23799.11202.159386.05675.88030.870OpenBenchmarking.org

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3CentOS Stream 9510152025SE +/- 0.19, N = 1520.09MIN: 17.31 / MAX: 37.291. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenet-v1-1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenet-v1-1.0CentOS Stream 90.47030.94061.41091.88122.3515SE +/- 0.047, N = 152.090MIN: 1.76 / MAX: 3.931. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: MobileNetV2_224

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: MobileNetV2_224CentOS Stream 90.59921.19841.79762.39682.996SE +/- 0.014, N = 152.663MIN: 2.48 / MAX: 5.571. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0CentOS Stream 90.89011.78022.67033.56044.4505SE +/- 0.075, N = 153.956MIN: 3.51 / MAX: 9.331. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50CentOS Stream 9246810SE +/- 0.088, N = 158.663MIN: 7.71 / MAX: 20.481. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: squeezenetv1.1

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: squeezenetv1.1CentOS Stream 90.53011.06021.59032.12042.6505SE +/- 0.050, N = 152.356MIN: 2.03 / MAX: 5.761. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: mobilenetV3CentOS Stream 90.39440.78881.18321.57761.972SE +/- 0.020, N = 151.753MIN: 1.61 / MAX: 4.191. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: nasnet

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: nasnetCentOS Stream 93691215SE +/- 0.23, N = 1512.10MIN: 10.54 / MAX: 23.031. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 14.0Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average LatencyCentOS Stream 90.06080.12160.18240.24320.304SE +/- 0.005, N = 120.2701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 500 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 14.0Scaling Factor: 100 - Clients: 500 - Mode: Read OnlyCentOS Stream 9400K800K1200K1600K2000KSE +/- 30425.21, N = 1218556561. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: StandardCentOS Stream 92K4K6K8K10KSE +/- 388.59, N = 12110451. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardCentOS Stream 9400800120016002000SE +/- 16.82, N = 1218811. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

Renaissance

Test: Finagle HTTP Requests

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Finagle HTTP RequestsCentOS Stream 92K4K6K8K10KSE +/- 154.17, N = 128693.9MIN: 6648.05 / MAX: 15659.82

Apache HTTP Server

Concurrent Requests: 1000

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.48Concurrent Requests: 1000CentOS Stream 930K60K90K120K150KSE +/- 1558.40, N = 15131349.601. (CC) gcc options: -shared -fPIC -O2

Stockfish

Total Time

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 15Total TimeCentOS Stream 940M80M120M160M200MSE +/- 2364357.21, N = 151794731291. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -msse -msse3 -mpopcnt -mavx2 -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto=jobserver

Renaissance

Test: ALS Movie Lens

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: ALS Movie LensCentOS Stream 94K8K12K16K20KSE +/- 73.46, N = 317123.9MIN: 16240.16 / MAX: 19195.87

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUCentOS Stream 9100200300400500SE +/- 7.22, N = 15447.62MIN: 376.511. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/scivis/real_timeCentOS Stream 9612182430SE +/- 0.29, N = 324.30

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUCentOS Stream 93691215SE +/- 0.30, N = 1513.60MIN: 8.57 / MAX: 68.281. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUCentOS Stream 930060090012001500SE +/- 39.85, N = 151478.641. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Renaissance

Test: In-Memory Database Shootout

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: In-Memory Database ShootoutCentOS Stream 94K8K12K16K20KSE +/- 197.42, N = 317787.2MIN: 17444.33 / MAX: 21383.13

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUCentOS Stream 90.33750.6751.01251.351.6875SE +/- 0.05, N = 151.50MIN: 0.34 / MAX: 29.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUCentOS Stream 99K18K27K36K45KSE +/- 1567.95, N = 1542731.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

TensorFlow Lite

Model: Inception V4

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Inception V4CentOS Stream 916K32K48K64K80KSE +/- 21727.22, N = 1573896.5

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUCentOS Stream 9150300450600750SE +/- 6.94, N = 12697.28MIN: 605.851. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

Renaissance

Test: Savina Reactors.IO

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Savina Reactors.IOCentOS Stream 95K10K15K20K25KSE +/- 296.93, N = 321219.4MIN: 20627.9 / MAX: 32602.9

GraphicsMagick

Operation: Rotate

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: RotateCentOS Stream 92004006008001000SE +/- 7.69, N = 1510301. (CC) gcc options: -fopenmp -O2 -ljpeg -lXext -lX11 -lbz2 -lz -lm -lpthread

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/pathtracer/real_timeCentOS Stream 920406080100SE +/- 0.72, N = 3100.67

Apache Spark

Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using Dataframe

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark Using DataframeCentOS Stream 90.62781.25561.88342.51123.139SE +/- 0.09, N = 32.79

Apache Spark

Row Count: 40000000 - Partitions: 500 - Calculate Pi Benchmark

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - Calculate Pi BenchmarkCentOS Stream 9816243240SE +/- 0.12, N = 336.21

Apache Spark

Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark Time

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark 3.3Row Count: 40000000 - Partitions: 500 - SHA-512 Benchmark TimeCentOS Stream 920406080100SE +/- 0.53, N = 388.83

TNN

Target: CPU - Model: DenseNet

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: DenseNetCentOS Stream 98001600240032004000SE +/- 27.70, N = 33955.05MIN: 3833.99 / MAX: 5510.151. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 5:1

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 5:1CentOS Stream 9300K600K900K1200K1500KSE +/- 63962.41, N = 121339297.911. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is Bettermemtier_benchmark 1.4Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10CentOS Stream 9300K600K900K1200K1500KSE +/- 67672.39, N = 121398073.701. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Natron

Input: Spaceship

OpenBenchmarking.orgFPS, More Is BetterNatron 2.4.3Input: SpaceshipCentOS Stream 90.42750.8551.28251.712.1375SE +/- 0.01, N = 151.9

ClickHouse

100M Rows Web Analytics Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Third RunCentOS Stream 950100150200250SE +/- 1.95, N = 15243.95MIN: 42.11 / MAX: 60001. ClickHouse server version 22.5.4.19 (official build).

ClickHouse

100M Rows Web Analytics Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, Second RunCentOS Stream 950100150200250SE +/- 1.48, N = 15244.38MIN: 44.09 / MAX: 5454.551. ClickHouse server version 22.5.4.19 (official build).

ClickHouse

100M Rows Web Analytics Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.5.4.19100M Rows Web Analytics Dataset, First Run / Cold CacheCentOS Stream 950100150200250SE +/- 2.21, N = 15231.48MIN: 41.47 / MAX: 5454.551. ClickHouse server version 22.5.4.19 (official build).

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.2Blend File: Barbershop - Compute: CPU-OnlyCentOS Stream 960120180240300SE +/- 0.55, N = 3257.15

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: particle_volume/ao/real_timeCentOS Stream 9612182430SE +/- 0.07, N = 324.35

LAMMPS Molecular Dynamics Simulator

Model: 20k Atoms

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: 20k AtomsCentOS Stream 9816243240SE +/- 0.05, N = 335.121. (CXX) g++ options: -O3 -lm -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUCentOS Stream 9510152025SE +/- 0.29, N = 1218.67MIN: 11.54 / MAX: 79.431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUCentOS Stream 92004006008001000SE +/- 14.44, N = 121071.701. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

C-Blosc

Test: blosclz bitshuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz bitshuffleCentOS Stream 98001600240032004000SE +/- 6.11, N = 33704.11. (CC) gcc options: -std=gnu99 -O3 -lrt -lm

TensorFlow Lite

Model: NASNet Mobile

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: NASNet MobileCentOS Stream 915K30K45K60K75KSE +/- 3728.57, N = 1268713.0

TensorFlow Lite

Model: SqueezeNet

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: SqueezeNetCentOS Stream 94K8K12K16K20KSE +/- 5506.54, N = 1216614.41

TensorFlow Lite

Model: Mobilenet Float

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Mobilenet FloatCentOS Stream 99001800270036004500SE +/- 499.70, N = 124240.41

GraphicsMagick

Operation: HWB Color Space

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: HWB Color SpaceCentOS Stream 92004006008001000SE +/- 28.49, N = 1211381. (CC) gcc options: -fopenmp -O2 -ljpeg -lXext -lX11 -lbz2 -lz -lm -lpthread

WebP2 Image Encode

Encode Settings: Quality 95, Compression Effort 7

OpenBenchmarking.orgSeconds, Fewer Is BetterWebP2 Image Encode 20220422Encode Settings: Quality 95, Compression Effort 7CentOS Stream 950100150200250SE +/- 0.09, N = 3233.751. (CXX) g++ options: -fno-rtti -O3

VP9 libvpx Encoding

Speed: Speed 0 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.10.0Speed: Speed 0 - Input: Bosphorus 4KCentOS Stream 90.6841.3682.0522.7363.42SE +/- 0.02, N = 33.041. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

High Performance Conjugate Gradient

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1CentOS Stream 9918273645SE +/- 0.08, N = 340.281. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

C-Blosc

Test: blosclz shuffle

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.3Test: blosclz shuffleCentOS Stream 911002200330044005500SE +/- 23.45, N = 34916.71. (CC) gcc options: -std=gnu99 -O3 -lrt -lm

Redis

Test: GET - Parallel Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500CentOS Stream 9400K800K1200K1600K2000KSE +/- 89203.76, N = 152018201.091. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerCentOS Stream 910K20K30K40K50KSE +/- 81.93, N = 3483191. (CXX) g++ options: -O3 -ldl

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: AtomicCentOS Stream 940K80K120K160K200KSE +/- 3961.98, N = 15187775.771. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

InfluxDB

Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000

OpenBenchmarking.orgval/sec, More Is BetterInfluxDB 1.8.2Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000CentOS Stream 9140K280K420K560K700KSE +/- 2481.53, N = 3666008.7

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: FutexCentOS Stream 9200K400K600K800K1000KSE +/- 73263.26, N = 151088788.921. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Socket ActivityCentOS Stream 95001000150020002500SE +/- 900.65, N = 152460.371. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerCentOS Stream 94K8K12K16K20KSE +/- 58.89, N = 3201521. (CXX) g++ options: -O3 -ldl

Zstd Compression

Compression Level: 8 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 8 - Decompression SpeedCentOS Stream 96001200180024003000SE +/- 6.19, N = 123017.51. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

Zstd Compression

Compression Level: 8 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 8 - Compression SpeedCentOS Stream 930060090012001500SE +/- 18.11, N = 121244.01. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

PyHPC Benchmarks

Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Isoneutral Mixing

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Isoneutral MixingCentOS Stream 90.46760.93521.40281.87042.338SE +/- 0.024, N = 32.078

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 14.0Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average LatencyCentOS Stream 9612182430SE +/- 0.05, N = 326.721. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 500 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 14.0Scaling Factor: 100 - Clients: 500 - Mode: Read WriteCentOS Stream 94K8K12K16K20KSE +/- 32.56, N = 3187101. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeCentOS Stream 9510152025SE +/- 0.15, N = 322.02

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 14.0Scaling Factor: 100 - Clients: 250 - Mode: Read Write - Average LatencyCentOS Stream 93691215SE +/- 0.01, N = 312.051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 250 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 14.0Scaling Factor: 100 - Clients: 250 - Mode: Read WriteCentOS Stream 94K8K12K16K20KSE +/- 21.44, N = 3207451. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeCentOS Stream 9510152025SE +/- 0.06, N = 322.42

Redis

Test: SET - Parallel Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 1000CentOS Stream 9400K800K1200K1600K2000KSE +/- 55692.46, N = 121847194.121. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL pgbench 14.0Scaling Factor: 100 - Clients: 250 - Mode: Read Only - Average LatencyCentOS Stream 90.03380.06760.10140.13520.169SE +/- 0.001, N = 30.1501. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL pgbench

Scaling Factor: 100 - Clients: 250 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL pgbench 14.0Scaling Factor: 100 - Clients: 250 - Mode: Read OnlyCentOS Stream 9400K800K1200K1600K2000KSE +/- 9583.19, N = 316693881. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerCentOS Stream 99K18K27K36K45KSE +/- 38.89, N = 3408521. (CXX) g++ options: -O3 -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerCentOS Stream 99K18K27K36K45KSE +/- 74.23, N = 3405801. (CXX) g++ options: -O3 -ldl

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: NinjaCentOS Stream 9306090120150SE +/- 0.23, N = 3135.02

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeCentOS Stream 9612182430SE +/- 0.04, N = 325.59

Redis

Test: SET - Parallel Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500CentOS Stream 9400K800K1200K1600K2000KSE +/- 47157.16, N = 121931278.621. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

PyHPC Benchmarks

Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Isoneutral Mixing

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Isoneutral MixingCentOS Stream 90.64761.29521.94282.59043.238SE +/- 0.033, N = 32.878

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 5.18Build: defconfigCentOS Stream 9714212835SE +/- 0.39, N = 1329.67

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 4 - Input: Bosphorus 4KCentOS Stream 90.29860.59720.89581.19441.493SE +/- 0.001, N = 31.3271. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerCentOS Stream 94K8K12K16K20KSE +/- 49.21, N = 3202611. (CXX) g++ options: -O3 -ldl

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: ParallelCentOS Stream 950100150200250SE +/- 0.17, N = 32361. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: ParallelCentOS Stream 9400800120016002000SE +/- 3.09, N = 316931. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: GPT-2 - Device: CPU - Executor: ParallelCentOS Stream 911002200330044005500SE +/- 32.87, N = 352691. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: ParallelCentOS Stream 92004006008001000SE +/- 2.02, N = 37991. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: yolov4 - Device: CPU - Executor: ParallelCentOS Stream 9140280420560700SE +/- 1.04, N = 36301. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: StandardCentOS Stream 92004006008001000SE +/- 0.50, N = 310931. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: StandardCentOS Stream 9100200300400500SE +/- 1.17, N = 34431. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: yolov4 - Device: CPU - Executor: StandardCentOS Stream 9150300450600750SE +/- 1.17, N = 36941. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Parallel

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: ParallelCentOS Stream 97001400210028003500SE +/- 4.91, N = 332591. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: StandardCentOS Stream 93K6K9K12K15KSE +/- 43.63, N = 3122601. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt

WebP2 Image Encode

Encode Settings: Quality 75, Compression Effort 7

OpenBenchmarking.orgSeconds, Fewer Is BetterWebP2 Image Encode 20220422Encode Settings: Quality 75, Compression Effort 7CentOS Stream 9306090120150SE +/- 0.09, N = 3111.921. (CXX) g++ options: -fno-rtti -O3

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerCentOS Stream 95K10K15K20K25KSE +/- 79.25, N = 3239671. (CXX) g++ options: -O3 -ldl

PyHPC Benchmarks

Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Isoneutral Mixing

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Isoneutral MixingCentOS Stream 90.46350.9271.39051.8542.3175SE +/- 0.004, N = 32.060

Node.js Express HTTP Load Test

OpenBenchmarking.orgRequests Per Second, More Is BetterNode.js Express HTTP Load TestCentOS Stream 911002200330044005500SE +/- 73.75, N = 1549101. Nodejs

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: CPU CacheCentOS Stream 948121620SE +/- 0.13, N = 1016.261. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Timed GDB GNU Debugger Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GDB GNU Debugger Compilation 10.2Time To CompileCentOS Stream 920406080100SE +/- 0.27, N = 395.42

nginx

Concurrent Requests: 1000

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.21.1Concurrent Requests: 1000CentOS Stream 940K80K120K160K200KSE +/- 1519.57, N = 3200945.491. (CC) gcc options: -lcrypt -lz -O3 -march=native

x264

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx264 2022-02-22Video Input: Bosphorus 4KCentOS Stream 9816243240SE +/- 0.49, N = 1534.571. (CC) gcc options: -ldl -m64 -lm -lpthread -O3 -flto

PyHPC Benchmarks

Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Isoneutral Mixing

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Isoneutral MixingCentOS Stream 90.19440.38880.58320.77760.972SE +/- 0.004, N = 30.864

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 0CentOS Stream 920406080100SE +/- 0.66, N = 384.321. (CXX) g++ options: -O3 -fPIC -lm

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.2Blend File: Pabellon Barcelona - Compute: CPU-OnlyCentOS Stream 920406080100SE +/- 0.02, N = 382.89

PyHPC Benchmarks

Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Isoneutral Mixing

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Isoneutral MixingCentOS Stream 90.30940.61880.92821.23761.547SE +/- 0.001, N = 31.375

Node.js V8 Web Tooling Benchmark

OpenBenchmarking.orgruns/s, More Is BetterNode.js V8 Web Tooling BenchmarkCentOS Stream 93691215SE +/- 0.06, N = 310.55

Renaissance

Test: Random Forest

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Random ForestCentOS Stream 930060090012001500SE +/- 6.85, N = 31455.2MIN: 1315.52 / MAX: 1806.24

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUCentOS Stream 91.21642.43283.64924.86566.082SE +/- 0.32475, N = 155.40603MIN: 3.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 19, Long Mode - Decompression SpeedCentOS Stream 96001200180024003000SE +/- 4.30, N = 52635.71. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 19, Long Mode - Compression SpeedCentOS Stream 91020304050SE +/- 0.45, N = 543.41. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsCentOS Stream 91.09132.18263.27394.36525.4565SE +/- 0.01, N = 34.851. (CXX) g++ options: -O3

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDCentOS Stream 91.29832.59663.89495.19326.4915SE +/- 0.01, N = 35.771. (CXX) g++ options: -O3

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: TopTweetCentOS Stream 91.26452.5293.79355.0586.3225SE +/- 0.01, N = 35.621. (CXX) g++ options: -O3

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUCentOS Stream 930060090012001500SE +/- 0.41, N = 31424.57MIN: 1046.08 / MAX: 1657.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUCentOS Stream 948121620SE +/- 0.00, N = 313.921. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUCentOS Stream 92004006008001000SE +/- 0.67, N = 3819.63MIN: 519.3 / MAX: 967.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUCentOS Stream 9612182430SE +/- 0.02, N = 324.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUCentOS Stream 930060090012001500SE +/- 1.03, N = 31451.62MIN: 1039.96 / MAX: 1708.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUCentOS Stream 948121620SE +/- 0.02, N = 313.671. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

PyHPC Benchmarks

Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of State

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of StateCentOS Stream 90.43560.87121.30681.74242.178SE +/- 0.001, N = 31.936

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUCentOS Stream 950100150200250SE +/- 0.22, N = 3239.86MIN: 178.86 / MAX: 348.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUCentOS Stream 920406080100SE +/- 0.07, N = 383.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.2Blend File: Classroom - Compute: CPU-OnlyCentOS Stream 91428425670SE +/- 0.04, N = 364.82

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUCentOS Stream 920406080100SE +/- 0.18, N = 385.47MIN: 76.11 / MAX: 195.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUCentOS Stream 950100150200250SE +/- 0.51, N = 3233.331. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUCentOS Stream 9714212835SE +/- 0.01, N = 332.00MIN: 21.78 / MAX: 67.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUCentOS Stream 95001000150020002500SE +/- 1.20, N = 32478.961. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUCentOS Stream 90.3060.6120.9181.2241.53SE +/- 0.00, N = 31.36MIN: 0.99 / MAX: 13.441. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUCentOS Stream 910K20K30K40K50KSE +/- 99.47, N = 347224.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUCentOS Stream 9246810SE +/- 0.01, N = 38.27MIN: 7.23 / MAX: 27.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUCentOS Stream 92K4K6K8K10KSE +/- 8.29, N = 39657.991. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUCentOS Stream 91.0172.0343.0514.0685.085SE +/- 0.00, N = 34.52MIN: 4.11 / MAX: 44.741. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUCentOS Stream 99001800270036004500SE +/- 1.33, N = 34414.941. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUCentOS Stream 9918273645SE +/- 5.68, N = 1537.96MIN: 3.481. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

TensorFlow Lite

Model: Inception ResNet V2

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Inception ResNet V2CentOS Stream 910K20K30K40K50KSE +/- 268.62, N = 347297.8

TensorFlow Lite

Model: Mobilenet Quant

OpenBenchmarking.orgMicroseconds, Fewer Is BetterTensorFlow Lite 2022-05-18Model: Mobilenet QuantCentOS Stream 92K4K6K8K10KSE +/- 100.45, N = 39540.86

GraphicsMagick

Operation: Resizing

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: ResizingCentOS Stream 96001200180024003000SE +/- 27.10, N = 327481. (CC) gcc options: -fopenmp -O2 -ljpeg -lXext -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: Enhanced

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: EnhancedCentOS Stream 92004006008001000SE +/- 1.76, N = 311531. (CC) gcc options: -fopenmp -O2 -ljpeg -lXext -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: Sharpen

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SharpenCentOS Stream 9140280420560700SE +/- 1.76, N = 36411. (CC) gcc options: -fopenmp -O2 -ljpeg -lXext -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: Noise-Gaussian

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: Noise-GaussianCentOS Stream 9160320480640800SE +/- 0.88, N = 37381. (CC) gcc options: -fopenmp -O2 -ljpeg -lXext -lX11 -lbz2 -lz -lm -lpthread

GraphicsMagick

Operation: Swirl

OpenBenchmarking.orgIterations Per Minute, More Is BetterGraphicsMagick 1.3.38Operation: SwirlCentOS Stream 95001000150020002500SE +/- 10.48, N = 323401. (CC) gcc options: -fopenmp -O2 -ljpeg -lXext -lX11 -lbz2 -lz -lm -lpthread

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: KostyaCentOS Stream 90.65481.30961.96442.61923.274SE +/- 0.00, N = 32.911. (CXX) g++ options: -O3

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: LargeRandomCentOS Stream 90.2160.4320.6480.8641.08SE +/- 0.00, N = 30.961. (CXX) g++ options: -O3

Unpacking The Linux Kernel

linux-5.19.tar.xz

OpenBenchmarking.orgSeconds, Fewer Is BetterUnpacking The Linux Kernel 5.19linux-5.19.tar.xzCentOS Stream 93691215SE +/- 0.116, N = 179.194

Renaissance

Test: Apache Spark Bayes

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.14Test: Apache Spark BayesCentOS Stream 92004006008001000SE +/- 11.23, N = 31075.3MIN: 628.33 / MAX: 1551.11

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 2CentOS Stream 91122334455SE +/- 0.53, N = 348.711. (CXX) g++ options: -O3 -fPIC -lm

Redis

Test: GET - Parallel Connections: 1000

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 1000CentOS Stream 9500K1000K1500K2000K2500KSE +/- 26860.41, N = 52406986.651. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 6, LosslessCentOS Stream 93691215SE +/- 0.070, N = 159.2601. (CXX) g++ options: -O3 -fPIC -lm

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUCentOS Stream 90.53681.07361.61042.14722.684SE +/- 0.07640, N = 152.38563MIN: 1.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

WebP Image Encode

Encode Settings: Quality 100, Highest Compression

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Highest CompressionCentOS Stream 9246810SE +/- 0.061, N = 158.8021. (CC) gcc options: -fvisibility=hidden -O2 -lm -lpng16 -ljpeg

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 19 - Decompression SpeedCentOS Stream 96001200180024003000SE +/- 6.30, N = 32571.31. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 19 - Compression SpeedCentOS Stream 920406080100SE +/- 0.52, N = 386.61. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingCentOS Stream 980K160K240K320K400KSE +/- 2273.35, N = 33711311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingCentOS Stream 9100K200K300K400K500KSE +/- 5624.44, N = 34678661. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: JythonCentOS Stream 912002400360048006000SE +/- 189.31, N = 165600

WebP Image Encode

Encode Settings: Quality 100, Lossless, Highest Compression

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, Lossless, Highest CompressionCentOS Stream 9918273645SE +/- 0.22, N = 341.211. (CC) gcc options: -fvisibility=hidden -O2 -lm -lpng16 -ljpeg

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: System V Message PassingCentOS Stream 91.5M3M4.5M6M7.5MSE +/- 85352.98, N = 47093379.731. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Glibc C String FunctionsCentOS Stream 92M4M6M8M10MSE +/- 103735.47, N = 49473078.171. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Zstd Compression

Compression Level: 8, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 8, Long Mode - Decompression SpeedCentOS Stream 97001400210028003500SE +/- 10.41, N = 33201.01. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

Zstd Compression

Compression Level: 8, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 8, Long Mode - Compression SpeedCentOS Stream 970140210280350SE +/- 0.78, N = 3307.51. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

TNN

Target: CPU - Model: MobileNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: MobileNet v2CentOS Stream 980160240320400SE +/- 4.68, N = 4378.88MIN: 371.88 / MAX: 634.441. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

Zstd Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 3 - Decompression SpeedCentOS Stream 96001200180024003000SE +/- 0.65, N = 23022.91. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

Zstd Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 3 - Compression SpeedCentOS Stream 915003000450060007500SE +/- 78.16, N = 37026.11. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

Zstd Compression

Compression Level: 3, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 3, Long Mode - Decompression SpeedCentOS Stream 97001400210028003500SE +/- 13.60, N = 33208.01. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

Zstd Compression

Compression Level: 3, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd CompressionCompression Level: 3, Long Mode - Compression SpeedCentOS Stream 960120180240300SE +/- 4.03, N = 3281.01. *** zstd command line interface 64-bits v1.5.1, by Yann Collet ***

DaCapo Benchmark

Java Test: Tradebeans

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: TradebeansCentOS Stream 93K6K9K12K15KSE +/- 116.64, N = 416070

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.2Blend File: Fishy Cat - Compute: CPU-OnlyCentOS Stream 9816243240SE +/- 0.07, N = 333.37

PyHPC Benchmarks

Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Equation of State

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Equation of StateCentOS Stream 90.02450.0490.07350.0980.1225SE +/- 0.001, N = 30.109

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2022.1Implementation: MPI CPU - Input: water_GMX50_bareCentOS Stream 93691215SE +/- 0.002, N = 38.9961. (CXX) g++ options: -O3

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 10, LosslessCentOS Stream 9246810SE +/- 0.073, N = 156.6051. (CXX) g++ options: -O3 -fPIC -lm

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 AtomsCentOS Stream 90.06330.12660.18990.25320.3165SE +/- 0.00094, N = 30.28138

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: MediumCentOS Stream 970140210280350SE +/- 2.47, N = 15316.371. (CXX) g++ options: -O3 -flto -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: NUMACentOS Stream 93691215SE +/- 0.02, N = 310.371. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: x86_64 RdRandCentOS Stream 9140K280K420K560K700KSE +/- 2562.02, N = 3667284.361. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: ForkingCentOS Stream 914K28K42K56K70KSE +/- 123.25, N = 363484.451. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: MallocCentOS Stream 970M140M210M280M350MSE +/- 452266.97, N = 3306750258.841. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Memory CopyingCentOS Stream 93K6K9K12K15KSE +/- 5.23, N = 312812.451. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: MMAPCentOS Stream 98001600240032004000SE +/- 34.11, N = 33747.581. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Context SwitchingCentOS Stream 91.3M2.6M3.9M5.2M6.5MSE +/- 78706.86, N = 36233126.451. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: SemaphoresCentOS Stream 91.5M3M4.5M6M7.5MSE +/- 27158.37, N = 37186364.511. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: CPU StressCentOS Stream 930K60K90K120K150KSE +/- 758.69, N = 3135517.461. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: SENDFILECentOS Stream 9300K600K900K1200K1500KSE +/- 2669.03, N = 31271967.051. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: MEMFDCentOS Stream 99001800270036004500SE +/- 35.16, N = 34098.841. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Glibc Qsort Data SortingCentOS Stream 92004006008001000SE +/- 2.69, N = 3934.261. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: CryptoCentOS Stream 920K40K60K80K100KSE +/- 289.31, N = 383808.911. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Matrix MathCentOS Stream 960K120K180K240K300KSE +/- 512.51, N = 3286293.401. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14Test: Vector MathCentOS Stream 970K140K210K280K350KSE +/- 944.66, N = 3322923.091. (CC) gcc options: -O2 -std=gnu99 -lm -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Redis

Test: SET - Parallel Connections: 50

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 50CentOS Stream 9500K1000K1500K2000K2500KSE +/- 29696.58, N = 32189377.081. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

PyHPC Benchmarks

Device: CPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Equation of State

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Equation of StateCentOS Stream 90.050.10.150.20.25SE +/- 0.003, N = 40.222

Redis

Test: GET - Parallel Connections: 50

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 50CentOS Stream 9500K1000K1500K2000K2500KSE +/- 2019.92, N = 32284227.21. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

OpenSSL

OpenBenchmarking.orgverify/s, More Is BetterOpenSSLCentOS Stream 9200K400K600K800K1000KSE +/- 4686.71, N = 41112427.21. OpenSSL 3.0.1 14 Dec 2021 (Library: OpenSSL 3.0.1 14 Dec 2021)

OpenSSL

OpenBenchmarking.orgsign/s, More Is BetterOpenSSLCentOS Stream 94K8K12K16K20KSE +/- 205.54, N = 416866.11. OpenSSL 3.0.1 14 Dec 2021 (Library: OpenSSL 3.0.1 14 Dec 2021)

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.2Blend File: BMW27 - Compute: CPU-OnlyCentOS Stream 9612182430SE +/- 0.03, N = 325.04

TNN

Target: CPU - Model: SqueezeNet v1.1

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v1.1CentOS Stream 980160240320400SE +/- 0.03, N = 3366.49MIN: 366.26 / MAX: 366.871. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

PyHPC Benchmarks

Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Equation of State

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Equation of StateCentOS Stream 90.0070.0140.0210.0280.035SE +/- 0.000, N = 30.031

WebP Image Encode

Encode Settings: Quality 100, Lossless

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100, LosslessCentOS Stream 9510152025SE +/- 0.17, N = 321.121. (CC) gcc options: -fvisibility=hidden -O2 -lm -lpng16 -ljpeg

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUCentOS Stream 90.85761.71522.57283.43044.288SE +/- 0.01173, N = 33.81155MIN: 3.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

DaCapo Benchmark

Java Test: H2

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 9.12-MR1Java Test: H2CentOS Stream 92K4K6K8K10KSE +/- 54.95, N = 49847

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 8 - Input: Bosphorus 4KCentOS Stream 9918273645SE +/- 0.30, N = 338.681. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

PyHPC Benchmarks

Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Equation of State

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Equation of StateCentOS Stream 90.06820.13640.20460.27280.341SE +/- 0.001, N = 30.303

SVT-VP9

Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4KCentOS Stream 9306090120150SE +/- 1.37, N = 4115.501. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

WebP Image Encode

Encode Settings: Quality 100

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: Quality 100CentOS Stream 90.68491.36982.05472.73963.4245SE +/- 0.065, N = 153.0441. (CC) gcc options: -fvisibility=hidden -O2 -lm -lpng16 -ljpeg

SVT-VP9

Tuning: Visual Quality Optimized - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: Visual Quality Optimized - Input: Bosphorus 4KCentOS Stream 920406080100SE +/- 1.23, N = 399.271. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ExhaustiveCentOS Stream 91.01372.02743.04114.05485.0685SE +/- 0.0017, N = 34.50541. (CXX) g++ options: -O3 -flto -pthread

SVT-VP9

Tuning: VMAF Optimized - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: VMAF Optimized - Input: Bosphorus 4KCentOS Stream 9306090120150SE +/- 0.07, N = 3112.931. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

WebP2 Image Encode

Encode Settings: Default

OpenBenchmarking.orgSeconds, Fewer Is BetterWebP2 Image Encode 20220422Encode Settings: DefaultCentOS Stream 90.60011.20021.80032.40043.0005SE +/- 0.033, N = 152.6671. (CXX) g++ options: -fno-rtti -O3

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUCentOS Stream 90.82891.65782.48673.31564.1445SE +/- 0.03477, N = 143.68404MIN: 3.541. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

SVT-HEVC

Tuning: 7 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 7 - Input: Bosphorus 4KCentOS Stream 920406080100SE +/- 1.08, N = 486.671. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt

WebP Image Encode

Encode Settings: Default

OpenBenchmarking.orgEncode Time - Seconds, Fewer Is BetterWebP Image Encode 1.1Encode Settings: DefaultCentOS Stream 90.48670.97341.46011.94682.4335SE +/- 0.069, N = 152.1631. (CC) gcc options: -fvisibility=hidden -O2 -lm -lpng16 -ljpeg

SVT-AV1

Encoder Mode: Preset 10 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 10 - Input: Bosphorus 4KCentOS Stream 91530456075SE +/- 0.26, N = 365.621. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

PyHPC Benchmarks

Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Equation of State

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Equation of StateCentOS Stream 90.05940.11880.17820.23760.297SE +/- 0.002, N = 30.264

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: ThoroughCentOS Stream 91122334455SE +/- 0.05, N = 346.381. (CXX) g++ options: -O3 -flto -pthread

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.2Encoder Mode: Preset 12 - Input: Bosphorus 4KCentOS Stream 920406080100SE +/- 0.83, N = 392.831. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-HEVC

Tuning: 10 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-HEVC 1.5.0Tuning: 10 - Input: Bosphorus 4KCentOS Stream 9306090120150SE +/- 1.63, N = 3113.231. (CC) gcc options: -fPIE -fPIC -O3 -O2 -pie -rdynamic -lpthread -lrt

ASTC Encoder

Preset: Fast

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 4.0Preset: FastCentOS Stream 92004006008001000SE +/- 3.69, N = 3799.111. (CXX) g++ options: -O3 -flto -pthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.6Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUCentOS Stream 90.48590.97181.45771.94362.4295SE +/- 0.01538, N = 32.15938MIN: 2.041. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -std=c++11 -pie -ldl -lpthread

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.10Encoder Speed: 6CentOS Stream 9246810SE +/- 0.037, N = 36.0561. (CXX) g++ options: -O3 -fPIC -lm

TNN

Target: CPU - Model: SqueezeNet v2

OpenBenchmarking.orgms, Fewer Is BetterTNN 0.3Target: CPU - Model: SqueezeNet v2CentOS Stream 920406080100SE +/- 0.78, N = 375.88MIN: 74.63 / MAX: 111.71. (CXX) g++ options: -fopenmp -pthread -fvisibility=hidden -fvisibility=default -O3 -rdynamic -ldl

LAMMPS Molecular Dynamics Simulator

Model: Rhodopsin Protein

OpenBenchmarking.orgns/day, More Is BetterLAMMPS Molecular Dynamics Simulator 23Jun2022Model: Rhodopsin ProteinCentOS Stream 9714212835SE +/- 0.06, N = 330.871. (CXX) g++ options: -O3 -lm -ldl


Phoronix Test Suite v10.8.4