2 x Intel Xeon Platinum 8490H testing with a Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2302080-NE-LINUX62KE20 Linux 6.2 Kernel Benchmarking Intel SPR - Phoronix Test Suite Linux 6.2 Kernel Benchmarking Intel SPR 2 x Intel Xeon Platinum 8490H testing with a Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2302080-NE-LINUX62KE20&grs&sro&rro .
Linux 6.2 Kernel Benchmarking Intel SPR Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server Vulkan Compiler File-System Screen Resolution Linux 6.1.10 Linux 6.2 8 Feb 2 x Intel Xeon Platinum 8490H @ 3.50GHz (120 Cores / 240 Threads) Quanta Cloud S6Q-MB-MPS (3A10.uh BIOS) Intel Device 1bce 16 x 64 GB 4800MT/s Samsung M321R8GA0BB0-CQKEG 2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007 + 960GB INTEL SSDSC2KG96 ASPEED VGA HDMI 4 x Intel E810-C for QSFP + 2 x Intel X710 for 10GBASE-T Ubuntu 22.04 6.1.10-060110-generic (x86_64) GNOME Shell 42.2 X Server 1.21.1.3 1.2.204 GCC 11.3.0 + Clang 14.0.0-1ubuntu1 ext4 1920x1080 6.2.0-060200rc7daily20230208-generic (x86_64) OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x2b0000c0 Python Details - Python 3.10.6 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Linux 6.2 Kernel Benchmarking Intel SPR stress-ng: Context Switching namd: ATPase Simulation - 327,506 Atoms aom-av1: Speed 6 Realtime - Bosphorus 4K x265: Bosphorus 1080p stress-ng: MMAP stress-ng: Semaphores stress-ng: NUMA pgbench: 100 - 1000 - Read Write - Average Latency pgbench: 100 - 1000 - Read Write pgbench: 100 - 800 - Read Write - Average Latency pgbench: 100 - 800 - Read Write clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache stress-ng: Memory Copying uvg266: Bosphorus 4K - Very Fast stress-ng: MEMFD stress-ng: Forking aom-av1: Speed 8 Realtime - Bosphorus 4K compress-7zip: Compression Rating aom-av1: Speed 9 Realtime - Bosphorus 4K clickhouse: 100M Rows Hits Dataset, Second Run stress-ng: Malloc clickhouse: 100M Rows Hits Dataset, Third Run stress-ng: IO_uring aom-av1: Speed 10 Realtime - Bosphorus 4K x265: Bosphorus 4K build-linux-kernel: defconfig uvg266: Bosphorus 4K - Super Fast deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream ospray: particle_volume/pathtracer/real_time vvenc: Bosphorus 4K - Fast deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream gromacs: MPI CPU - water_GMX50_bare deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream build-llvm: Ninja deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream nekrs: TurboPipe Periodic uvg266: Bosphorus 4K - Ultra Fast deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream build-linux-kernel: allmodconfig uvg266: Bosphorus 4K - Slow svt-av1: Preset 12 - Bosphorus 4K deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream ospray: particle_volume/ao/real_time svt-av1: Preset 13 - Bosphorus 4K deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream vvenc: Bosphorus 4K - Faster uvg266: Bosphorus 4K - Medium stress-ng: Matrix Math svt-av1: Preset 8 - Bosphorus 4K ospray: gravity_spheres_volume/dim_512/ao/real_time compress-7zip: Decompression Rating stress-ng: Vector Math stress-ng: Crypto stress-ng: x86_64 RdRand stress-ng: SENDFILE deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream embree: Pathtracer ISPC - Asian Dragon Obj embree: Pathtracer ISPC - Asian Dragon embree: Pathtracer - Asian Dragon Obj embree: Pathtracer - Asian Dragon embree: Pathtracer ISPC - Crown embree: Pathtracer - Crown gromacs: MPI CPU - water_GMX50_bare brl-cad: VGR Performance Metric rocksdb: Read Rand Write Rand rocksdb: Rand Fill Sync rocksdb: Seq Fill rocksdb: Update Rand rocksdb: Rand Read rocksdb: Rand Fill openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Age Gender Recognition Retail 0013 FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Person Vehicle Bike Detection FP16 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Weld Porosity Detection FP16-INT8 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Machine Translation EN To DE FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Weld Porosity Detection FP16 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Face Detection FP16-INT8 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Vehicle Detection FP16 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP32 - CPU openvino: Person Detection FP16 - CPU openvino: Person Detection FP16 - CPU openvino: Face Detection FP16 - CPU openvino: Face Detection FP16 - CPU ctx-clock: Context Switch Time blender: Barbershop - CPU-Only blender: BMW27 - CPU-Only stress-ng: System V Message Passing stress-ng: Glibc Qsort Data Sorting stress-ng: Glibc C String Functions stress-ng: CPU Cache rocksdb: Read While Writing stress-ng: Socket Activity stress-ng: CPU Stress stress-ng: Atomic stress-ng: Mutex stress-ng: Futex pgbench: 100 - 1000 - Read Only - Average Latency pgbench: 100 - 1000 - Read Only pgbench: 100 - 800 - Read Only - Average Latency pgbench: 100 - 800 - Read Only memcached: 1:100 memcached: 1:10 memcached: 1:5 Linux 6.1.10 Linux 6.2 8 Feb 2724155.67 0.24487 70.60 81.28 4446.69 8636757.37 823.73 14.984 66739 11.069 72276 452.20 11600.05 52.45 3069.37 56227.91 62.61 550657 68.67 486.73 295983025.53 505.85 47408.70 70.48 27.49 21.942 55.98 91.7729 177.666 4.820 358.5744 14.716 591.4723 166.9653 101.2039 93.670 1204.6339 49.7500 68.4827 875.2055 526288000000 56.00 424.4621 416.5371 178.316 25.14 201.374 141.1997 40.3879 1483.3330 34.7197 208.412 143.5932 649.0147 648.7734 9.120 28.09 587722.85 78.135 36.4473 564063 591428.07 156594.14 668883.47 2013997.03 91.9603 137.3453 158.2884 117.3313 129.9208 126.8349 110.7370 14.558 4132367 2079783 448145 498671 488635 579300652 495943 1.84 64547.57 1.05 106848.95 24.81 4833.68 5.15 23212.12 81.55 735.16 7.82 15301.88 19.73 6073.13 416.63 287.42 33.79 1774.66 1513.58 39.34 1521.31 39.13 465.02 128.73 130 149.50 14.07 19548475.12 1733.71 16667098.52 15.90 9981816 76754.34 174656.38 24444.51 918817.43 85353.10 1.296 771740 0.824 989367 556683.75 925855.29 1129986.80 2396641.33 0.26420 66.86 85.16 4594.34 8411372.27 802.96 15.340 65191 11.294 70837 443.69 11382.46 53.39 3124.14 55255.59 61.56 558485 69.64 492.61 299262596.45 511.41 47925.54 69.83 27.28 22.100 55.64 92.3213 176.612 4.793 360.5874 14.795 594.1788 166.2135 100.7525 94.083 1200.4125 49.9123 68.2626 877.9576 527807000000 56.15 423.3809 415.5078 178.723 25.09 200.977 141.4765 40.3123 1485.9869 34.6688 208.714 143.7983 648.1519 649.5736 9.131 28.06 587129.80 78.068 36.4760 564497 591711.95 156524.58 669071.60 2014102.18 91.9597 15.90 63762.09 127960.65 22779.25 1201873.84 86702.87 1.171 878515 0.965 859012 566029.60 918906.70 1183430.44 OpenBenchmarking.org
Stress-NG Test: Context Switching OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Context Switching Linux 6.2 8 Feb Linux 6.1.10 600K 1200K 1800K 2400K 3000K SE +/- 4157.76, N = 3 SE +/- 398.70, N = 3 2396641.33 2724155.67 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
NAMD ATPase Simulation - 327,506 Atoms OpenBenchmarking.org days/ns, Fewer Is Better NAMD 2.14 ATPase Simulation - 327,506 Atoms Linux 6.2 8 Feb Linux 6.1.10 0.0594 0.1188 0.1782 0.2376 0.297 SE +/- 0.00152, N = 3 SE +/- 0.00256, N = 15 0.26420 0.24487
AOM AV1 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 16 32 48 64 80 SE +/- 0.83, N = 15 SE +/- 0.13, N = 3 66.86 70.60 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
x265 Video Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better x265 3.4 Video Input: Bosphorus 1080p Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.82, N = 15 SE +/- 0.82, N = 3 85.16 81.28 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
Stress-NG Test: MMAP OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MMAP Linux 6.2 8 Feb Linux 6.1.10 1000 2000 3000 4000 5000 SE +/- 12.46, N = 3 SE +/- 12.03, N = 3 4594.34 4446.69 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Semaphores Linux 6.2 8 Feb Linux 6.1.10 2M 4M 6M 8M 10M SE +/- 19775.62, N = 3 SE +/- 9813.90, N = 3 8411372.27 8636757.37 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: NUMA OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: NUMA Linux 6.2 8 Feb Linux 6.1.10 200 400 600 800 1000 SE +/- 0.65, N = 3 SE +/- 1.67, N = 3 802.96 823.73 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Linux 6.2 8 Feb Linux 6.1.10 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.05, N = 3 15.34 14.98 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Linux 6.2 8 Feb Linux 6.1.10 14K 28K 42K 56K 70K SE +/- 139.09, N = 3 SE +/- 232.63, N = 3 65191 66739 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency Linux 6.2 8 Feb Linux 6.1.10 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 11.29 11.07 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write Linux 6.2 8 Feb Linux 6.1.10 15K 30K 45K 60K 75K SE +/- 74.72, N = 3 SE +/- 156.03, N = 3 70837 72276 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Linux 6.2 8 Feb Linux 6.1.10 100 200 300 400 500 SE +/- 3.02, N = 3 SE +/- 3.45, N = 3 443.69 452.20 MIN: 24.63 / MAX: 4615.38 MIN: 26.58 / MAX: 4615.38
Stress-NG Test: Memory Copying OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Memory Copying Linux 6.2 8 Feb Linux 6.1.10 2K 4K 6K 8K 10K SE +/- 30.89, N = 3 SE +/- 44.38, N = 3 11382.46 11600.05 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
uvg266 Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Linux 6.2 8 Feb Linux 6.1.10 12 24 36 48 60 SE +/- 0.25, N = 3 SE +/- 0.28, N = 3 53.39 52.45
Stress-NG Test: MEMFD OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MEMFD Linux 6.2 8 Feb Linux 6.1.10 700 1400 2100 2800 3500 SE +/- 2.20, N = 3 SE +/- 4.75, N = 3 3124.14 3069.37 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Forking OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Forking Linux 6.2 8 Feb Linux 6.1.10 12K 24K 36K 48K 60K SE +/- 499.08, N = 3 SE +/- 802.76, N = 3 55255.59 56227.91 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
AOM AV1 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 14 28 42 56 70 SE +/- 0.60, N = 15 SE +/- 0.73, N = 15 61.56 62.61 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Compression Rating Linux 6.2 8 Feb Linux 6.1.10 120K 240K 360K 480K 600K SE +/- 2538.64, N = 3 SE +/- 2390.42, N = 3 558485 550657 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
AOM AV1 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 15 30 45 60 75 SE +/- 0.82, N = 15 SE +/- 0.49, N = 3 69.64 68.67 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Linux 6.2 8 Feb Linux 6.1.10 110 220 330 440 550 SE +/- 2.84, N = 3 SE +/- 4.45, N = 3 492.61 486.73 MIN: 57.64 / MAX: 5454.55 MIN: 58.77 / MAX: 4615.38
Stress-NG Test: Malloc OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Malloc Linux 6.2 8 Feb Linux 6.1.10 60M 120M 180M 240M 300M SE +/- 602446.22, N = 3 SE +/- 244537.72, N = 3 299262596.45 295983025.53 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Linux 6.2 8 Feb Linux 6.1.10 110 220 330 440 550 SE +/- 1.26, N = 3 SE +/- 1.94, N = 3 511.41 505.85 MIN: 62.31 / MAX: 5454.55 MIN: 64.66 / MAX: 6000
Stress-NG Test: IO_uring OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: IO_uring Linux 6.2 8 Feb Linux 6.1.10 10K 20K 30K 40K 50K SE +/- 59.90, N = 3 SE +/- 107.10, N = 3 47925.54 47408.70 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
AOM AV1 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better AOM AV1 3.6 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 16 32 48 64 80 SE +/- 0.62, N = 15 SE +/- 0.60, N = 8 69.83 70.48 1. (CXX) g++ options: -O3 -std=c++11 -U_FORTIFY_SOURCE -lm
x265 Video Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better x265 3.4 Video Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 6 12 18 24 30 SE +/- 0.29, N = 3 SE +/- 0.14, N = 3 27.28 27.49 1. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig Linux 6.2 8 Feb Linux 6.1.10 5 10 15 20 25 SE +/- 0.22, N = 6 SE +/- 0.19, N = 8 22.10 21.94
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Linux 6.2 8 Feb Linux 6.1.10 13 26 39 52 65 SE +/- 0.26, N = 3 SE +/- 0.63, N = 3 55.64 55.98
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.11, N = 3 SE +/- 0.12, N = 3 92.32 91.77
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/pathtracer/real_time Linux 6.2 8 Feb Linux 6.1.10 40 80 120 160 200 SE +/- 0.67, N = 3 SE +/- 1.62, N = 3 176.61 177.67
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast Linux 6.2 8 Feb Linux 6.1.10 1.0845 2.169 3.2535 4.338 5.4225 SE +/- 0.029, N = 3 SE +/- 0.046, N = 3 4.793 4.820 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 80 160 240 320 400 SE +/- 1.10, N = 3 SE +/- 3.07, N = 3 360.59 358.57
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare Linux 6.2 8 Feb Linux 6.1.10 4 8 12 16 20 SE +/- 0.05, N = 3 SE +/- 0.01, N = 3 14.80 14.72 1. (CXX) g++ options: -O3
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 130 260 390 520 650 SE +/- 0.55, N = 3 SE +/- 0.40, N = 3 594.18 591.47
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 40 80 120 160 200 SE +/- 0.42, N = 3 SE +/- 1.35, N = 3 166.21 166.97
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.07, N = 3 100.75 101.20
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Ninja Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.05, N = 3 SE +/- 0.65, N = 3 94.08 93.67
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 300 600 900 1200 1500 SE +/- 5.52, N = 3 SE +/- 2.07, N = 3 1200.41 1204.63
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 11 22 33 44 55 SE +/- 0.22, N = 3 SE +/- 0.08, N = 3 49.91 49.75
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 15 30 45 60 75 SE +/- 0.22, N = 3 SE +/- 0.09, N = 3 68.26 68.48
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 200 400 600 800 1000 SE +/- 3.10, N = 3 SE +/- 1.04, N = 3 877.96 875.21
nekRS Input: TurboPipe Periodic OpenBenchmarking.org FLOP/s, More Is Better nekRS 22.0 Input: TurboPipe Periodic Linux 6.2 8 Feb Linux 6.1.10 110000M 220000M 330000M 440000M 550000M SE +/- 1225626778.43, N = 3 SE +/- 1046863091.97, N = 3 527807000000 526288000000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Linux 6.2 8 Feb Linux 6.1.10 13 26 39 52 65 SE +/- 0.45, N = 3 SE +/- 0.64, N = 3 56.15 56.00
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 90 180 270 360 450 SE +/- 0.09, N = 3 SE +/- 0.45, N = 3 423.38 424.46
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 90 180 270 360 450 SE +/- 1.02, N = 3 SE +/- 0.86, N = 3 415.51 416.54
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: allmodconfig Linux 6.2 8 Feb Linux 6.1.10 40 80 120 160 200 SE +/- 0.43, N = 3 SE +/- 0.52, N = 3 178.72 178.32
uvg266 Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow Linux 6.2 8 Feb Linux 6.1.10 6 12 18 24 30 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 25.09 25.14
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 40 80 120 160 200 SE +/- 1.12, N = 3 SE +/- 2.37, N = 3 200.98 201.37
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 30 60 90 120 150 SE +/- 0.04, N = 3 SE +/- 0.11, N = 3 141.48 141.20
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 9 18 27 36 45 SE +/- 0.04, N = 3 SE +/- 0.05, N = 3 40.31 40.39
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 300 600 900 1200 1500 SE +/- 1.24, N = 3 SE +/- 1.95, N = 3 1485.99 1483.33
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: particle_volume/ao/real_time Linux 6.2 8 Feb Linux 6.1.10 8 16 24 32 40 SE +/- 0.04, N = 3 SE +/- 0.00, N = 3 34.67 34.72
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 13 - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 50 100 150 200 250 SE +/- 1.24, N = 3 SE +/- 1.54, N = 3 208.71 208.41
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 30 60 90 120 150 SE +/- 0.30, N = 3 SE +/- 0.27, N = 3 143.80 143.59
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 140 280 420 560 700 SE +/- 1.20, N = 3 SE +/- 0.26, N = 3 648.15 649.01
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 140 280 420 560 700 SE +/- 1.07, N = 3 SE +/- 1.70, N = 3 649.57 648.77
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster Linux 6.2 8 Feb Linux 6.1.10 3 6 9 12 15 SE +/- 0.039, N = 3 SE +/- 0.097, N = 3 9.131 9.120 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
uvg266 Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium Linux 6.2 8 Feb Linux 6.1.10 7 14 21 28 35 SE +/- 0.05, N = 3 SE +/- 0.03, N = 3 28.06 28.09
Stress-NG Test: Matrix Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Matrix Math Linux 6.2 8 Feb Linux 6.1.10 130K 260K 390K 520K 650K SE +/- 326.52, N = 3 SE +/- 956.79, N = 3 587129.80 587722.85 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 4K Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.81, N = 12 SE +/- 0.67, N = 15 78.07 78.14
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time Linux 6.2 8 Feb Linux 6.1.10 8 16 24 32 40 SE +/- 0.16, N = 3 SE +/- 0.05, N = 3 36.48 36.45
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating Linux 6.2 8 Feb Linux 6.1.10 120K 240K 360K 480K 600K SE +/- 318.16, N = 3 SE +/- 2141.74, N = 3 564497 564063 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
Stress-NG Test: Vector Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Vector Math Linux 6.2 8 Feb Linux 6.1.10 130K 260K 390K 520K 650K SE +/- 392.81, N = 3 SE +/- 229.10, N = 3 591711.95 591428.07 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Crypto OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Crypto Linux 6.2 8 Feb Linux 6.1.10 30K 60K 90K 120K 150K SE +/- 56.34, N = 3 SE +/- 101.77, N = 3 156524.58 156594.14 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: x86_64 RdRand OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: x86_64 RdRand Linux 6.2 8 Feb Linux 6.1.10 140K 280K 420K 560K 700K SE +/- 50.78, N = 3 SE +/- 14.30, N = 3 669071.60 668883.47 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: SENDFILE OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: SENDFILE Linux 6.2 8 Feb Linux 6.1.10 400K 800K 1200K 1600K 2000K SE +/- 3872.08, N = 3 SE +/- 6709.63, N = 3 2014102.18 2013997.03 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux 6.2 8 Feb Linux 6.1.10 20 40 60 80 100 SE +/- 0.27, N = 3 SE +/- 0.29, N = 3 91.96 91.96
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon Obj Linux 6.1.10 30 60 90 120 150 SE +/- 0.24, N = 3 137.35 MIN: 129.6 / MAX: 154.23
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Asian Dragon Linux 6.1.10 30 60 90 120 150 SE +/- 0.15, N = 3 158.29 MIN: 148.72 / MAX: 175.63
Embree Binary: Pathtracer - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon Obj Linux 6.1.10 30 60 90 120 150 SE +/- 0.04, N = 3 117.33 MIN: 111.28 / MAX: 131.46
Embree Binary: Pathtracer - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Asian Dragon Linux 6.1.10 30 60 90 120 150 SE +/- 0.08, N = 3 129.92 MIN: 122.68 / MAX: 142.47
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer ISPC - Model: Crown Linux 6.1.10 30 60 90 120 150 SE +/- 0.67, N = 3 126.83 MIN: 114.94 / MAX: 144.11
Embree Binary: Pathtracer - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0 Binary: Pathtracer - Model: Crown Linux 6.1.10 20 40 60 80 100 SE +/- 0.04, N = 3 110.74 MIN: 99.51 / MAX: 128.5
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare Linux 6.1.10 4 8 12 16 20 SE +/- 0.05, N = 3 14.56 1. (CXX) g++ options: -O3
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.34 VGR Performance Metric Linux 6.1.10 900K 1800K 2700K 3600K 4500K 4132367 1. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6
RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read Random Write Random Linux 6.1.10 400K 800K 1200K 1600K 2000K SE +/- 14631.68, N = 3 2079783 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
RocksDB Test: Random Fill Sync OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill Sync Linux 6.1.10 100K 200K 300K 400K 500K SE +/- 689.81, N = 3 448145 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
RocksDB Test: Sequential Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Sequential Fill Linux 6.1.10 110K 220K 330K 440K 550K SE +/- 107.17, N = 3 498671 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Update Random Linux 6.1.10 100K 200K 300K 400K 500K SE +/- 304.35, N = 3 488635 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read Linux 6.1.10 120M 240M 360M 480M 600M SE +/- 1279720.50, N = 3 579300652 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
RocksDB Test: Random Fill OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Fill Linux 6.1.10 110K 220K 330K 440K 550K SE +/- 955.26, N = 3 495943 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Linux 6.1.10 0.414 0.828 1.242 1.656 2.07 SE +/- 0.01, N = 3 1.84 MIN: 0.56 / MAX: 105.91 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU Linux 6.1.10 14K 28K 42K 56K 70K SE +/- 362.34, N = 3 64547.57 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Linux 6.1.10 0.2363 0.4726 0.7089 0.9452 1.1815 SE +/- 0.00, N = 3 1.05 MIN: 0.28 / MAX: 92.06 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU Linux 6.1.10 20K 40K 60K 80K 100K SE +/- 287.95, N = 3 106848.95 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU Linux 6.1.10 6 12 18 24 30 SE +/- 0.05, N = 3 24.81 MIN: 12.19 / MAX: 126.11 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Vehicle Bike Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU Linux 6.1.10 1000 2000 3000 4000 5000 SE +/- 10.52, N = 3 4833.68 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Linux 6.1.10 1.1588 2.3176 3.4764 4.6352 5.794 SE +/- 0.03, N = 3 5.15 MIN: 1.43 / MAX: 102.95 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU Linux 6.1.10 5K 10K 15K 20K 25K SE +/- 141.00, N = 3 23212.12 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU Linux 6.1.10 20 40 60 80 100 SE +/- 0.81, N = 3 81.55 MIN: 31.38 / MAX: 2204.77 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Machine Translation EN To DE FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU Linux 6.1.10 160 320 480 640 800 SE +/- 7.46, N = 3 735.16 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU Linux 6.1.10 2 4 6 8 10 SE +/- 0.06, N = 3 7.82 MIN: 2.22 / MAX: 100.14 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Weld Porosity Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU Linux 6.1.10 3K 6K 9K 12K 15K SE +/- 116.05, N = 3 15301.88 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU Linux 6.1.10 5 10 15 20 25 SE +/- 0.01, N = 3 19.73 MIN: 8.72 / MAX: 152.2 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU Linux 6.1.10 1300 2600 3900 5200 6500 SE +/- 2.67, N = 3 6073.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU Linux 6.1.10 90 180 270 360 450 SE +/- 2.00, N = 3 416.63 MIN: 162.2 / MAX: 599.62 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16-INT8 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU Linux 6.1.10 60 120 180 240 300 SE +/- 1.41, N = 3 287.42 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU Linux 6.1.10 8 16 24 32 40 SE +/- 0.21, N = 3 33.79 MIN: 10.56 / MAX: 128.62 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Vehicle Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU Linux 6.1.10 400 800 1200 1600 2000 SE +/- 10.79, N = 3 1774.66 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU Linux 6.1.10 300 600 900 1200 1500 SE +/- 4.98, N = 3 1513.58 MIN: 827.53 / MAX: 3243.59 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP32 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU Linux 6.1.10 9 18 27 36 45 SE +/- 0.13, N = 3 39.34 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU Linux 6.1.10 300 600 900 1200 1500 SE +/- 7.49, N = 3 1521.31 MIN: 764.65 / MAX: 3475.74 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Person Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU Linux 6.1.10 9 18 27 36 45 SE +/- 0.19, N = 3 39.13 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org ms, Fewer Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU Linux 6.1.10 100 200 300 400 500 SE +/- 5.81, N = 3 465.02 MIN: 174.45 / MAX: 1220.77 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
OpenVINO Model: Face Detection FP16 - Device: CPU OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU Linux 6.1.10 30 60 90 120 150 SE +/- 1.60, N = 3 128.73 1. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl
ctx_clock Context Switch Time OpenBenchmarking.org Clocks, Fewer Is Better ctx_clock Context Switch Time Linux 6.1.10 30 60 90 120 150 SE +/- 0.00, N = 3 130
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Barbershop - Compute: CPU-Only Linux 6.1.10 30 60 90 120 150 SE +/- 0.44, N = 3 149.50
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only Linux 6.1.10 4 8 12 16 20 SE +/- 0.18, N = 3 14.07
Stress-NG Test: System V Message Passing OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: System V Message Passing Linux 6.1.10 4M 8M 12M 16M 20M SE +/- 135205.89, N = 3 19548475.12 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Glibc Qsort Data Sorting OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc Qsort Data Sorting Linux 6.1.10 400 800 1200 1600 2000 SE +/- 1.57, N = 3 1733.71 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Glibc C String Functions OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc C String Functions Linux 6.1.10 4M 8M 12M 16M 20M SE +/- 113403.85, N = 3 16667098.52 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: CPU Cache OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: CPU Cache Linux 6.2 8 Feb Linux 6.1.10 4 8 12 16 20 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 15.90 15.90 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read While Writing Linux 6.1.10 2M 4M 6M 8M 10M SE +/- 219959.46, N = 15 9981816 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Stress-NG Test: Socket Activity OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Socket Activity Linux 6.2 8 Feb Linux 6.1.10 16K 32K 48K 64K 80K SE +/- 304.61, N = 3 SE +/- 9156.51, N = 15 63762.09 76754.34 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: CPU Stress OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: CPU Stress Linux 6.2 8 Feb Linux 6.1.10 40K 80K 120K 160K 200K SE +/- 443.88, N = 3 SE +/- 19184.46, N = 15 127960.65 174656.38 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Atomic OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Atomic Linux 6.2 8 Feb Linux 6.1.10 5K 10K 15K 20K 25K SE +/- 327.04, N = 3 SE +/- 1573.75, N = 12 22779.25 24444.51 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Mutex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Mutex Linux 6.2 8 Feb Linux 6.1.10 300K 600K 900K 1200K 1500K SE +/- 190782.11, N = 15 SE +/- 3233.27, N = 3 1201873.84 918817.43 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
Stress-NG Test: Futex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Futex Linux 6.2 8 Feb Linux 6.1.10 20K 40K 60K 80K 100K SE +/- 2751.08, N = 12 SE +/- 3894.69, N = 12 86702.87 85353.10 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -lEGL -lGLESv2 -ljpeg -lrt -lsctp -lz -pthread
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Linux 6.2 8 Feb Linux 6.1.10 0.2916 0.5832 0.8748 1.1664 1.458 SE +/- 0.056, N = 12 SE +/- 0.010, N = 3 1.171 1.296 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Linux 6.2 8 Feb Linux 6.1.10 200K 400K 600K 800K 1000K SE +/- 46919.14, N = 12 SE +/- 6076.06, N = 3 878515 771740 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency Linux 6.2 8 Feb Linux 6.1.10 0.2171 0.4342 0.6513 0.8684 1.0855 SE +/- 0.055, N = 12 SE +/- 0.034, N = 12 0.965 0.824 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Only Linux 6.2 8 Feb Linux 6.1.10 200K 400K 600K 800K 1000K SE +/- 48886.22, N = 12 SE +/- 40184.05, N = 12 859012 989367 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Memcached Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:100 Linux 6.2 8 Feb Linux 6.1.10 120K 240K 360K 480K 600K SE +/- 11341.32, N = 15 SE +/- 5530.48, N = 3 566029.60 556683.75 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Memcached Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:10 Linux 6.2 8 Feb Linux 6.1.10 200K 400K 600K 800K 1000K SE +/- 34560.71, N = 15 SE +/- 38865.28, N = 12 918906.70 925855.29 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Memcached Set To Get Ratio: 1:5 OpenBenchmarking.org Ops/sec, More Is Better Memcached 1.6.18 Set To Get Ratio: 1:5 Linux 6.2 8 Feb Linux 6.1.10 300K 600K 900K 1200K 1500K SE +/- 71770.95, N = 12 SE +/- 27371.85, N = 12 1183430.44 1129986.80 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Phoronix Test Suite v10.8.4