Benchmarks for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301271-NE-XEONPLATI60 Xeon Platinum 8380 DODT Mitigation Impact - Phoronix Test Suite Xeon Platinum 8380 DODT Mitigation Impact Benchmarks for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2301271-NE-XEONPLATI60&sro&grr .
Xeon Platinum 8380 DODT Mitigation Impact Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server Vulkan Compiler File-System Screen Resolution Linux w DODT doitm=off 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads) Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) Intel Ice Lake IEH 512GB 7682GB INTEL SSDPF2KX076TZ ASPEED VE228 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP Ubuntu 22.10 6.2.0-rc5-phx-dodt (x86_64) GNOME Shell X Server 1.21.1.3 1.3.211 GCC 12.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Wbc0TK/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Wbc0TK/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375 Python Details - Python 3.10.6 Security Details - Linux w DODT: dodt: Mitigation of DOITM + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - doitm=off: dodt: Vulnerable + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Xeon Platinum 8380 DODT Mitigation Impact pgbench: 100 - 1000 - Read Only - Average Latency pgbench: 100 - 1000 - Read Only cockroach: KV, 10% Reads - 256 cockroach: KV, 60% Reads - 256 cockroach: KV, 95% Reads - 256 cryptopp: Keyed Algorithms build-linux-kernel: allmodconfig clickhouse: 100M Rows Hits Dataset, Third Run clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache build-nodejs: Time To Compile build-llvm: Ninja openradioss: Bird Strike on Windshield pgbench: 100 - 1000 - Read Write - Average Latency pgbench: 100 - 1000 - Read Write pgbench: 100 - 800 - Read Write - Average Latency pgbench: 100 - 800 - Read Write cockroach: MoVR - 256 nekrs: TurboPipe Periodic stress-ng: Futex openradioss: Rubber O-Ring Seal Installation openradioss: Bumper Beam avifenc: 0 cryptopp: Unkeyed Algorithms blender: Classroom - CPU-Only deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream rocksdb: Update Rand rocksdb: Rand Read deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream build-linux-kernel: defconfig build-godot: Time To Compile avifenc: 2 spacy: en_core_web_trf spacy: en_core_web_lg uvg266: Bosphorus 4K - Super Fast deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream xmrig: Monero - 1M deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream kvazaar: Bosphorus 4K - Super Fast cryptsetup: Serpent-XTS 512b Decryption cryptsetup: Twofish-XTS 512b Decryption cryptsetup: Twofish-XTS 512b Encryption cryptsetup: Serpent-XTS 512b Encryption cryptsetup: AES-XTS 512b Decryption cryptsetup: AES-XTS 512b Encryption cryptsetup: Twofish-XTS 256b Decryption cryptsetup: Twofish-XTS 256b Encryption cryptsetup: Serpent-XTS 256b Decryption cryptsetup: Serpent-XTS 256b Encryption cryptsetup: AES-XTS 256b Decryption cryptsetup: AES-XTS 256b Encryption cryptsetup: PBKDF2-whirlpool cryptsetup: PBKDF2-sha512 stress-ng: x86_64 RdRand stress-ng: Malloc stress-ng: Crypto stress-ng: MEMFD stress-ng: IO_uring stress-ng: SENDFILE stress-ng: Mutex kvazaar: Bosphorus 4K - Ultra Fast xmrig: Wownero - 1M blender: BMW27 - CPU-Only openssl: openssl: uvg266: Bosphorus 4K - Ultra Fast avifenc: 6 webp: Quality 100, Highest Compression minibude: OpenMP - BM1 minibude: OpenMP - BM1 webp: Quality 100 webp: Default Linux w DODT doitm=off 0.506 2021337 81359.8 102448.9 119187.4 565.089482 261.028 427.42 423.13 398.75 170.929 146.956 138.61 14.635 68328 10.635 75223 974.8 295621666667 699147.73 78.06 85.13 79.482 361.672421 62.71 487.3610 81.8802 592576 278841535 823.5023 48.5123 821.2112 48.4603 178.6233 223.6458 182.2006 219.3059 44.8577 890.9486 34.515 44.646 44.038 3169 10971 42.68 87.8377 454.9543 125.9126 316.8622 26451.3 48.1234 830.5710 47.06 527.2 357.5 352.2 561.0 3449.8 3445.4 357.7 351.4 527.6 559.5 3891.5 3864.3 583195 1392546 669198.10 195951844.81 85533.02 3592.88 26508.09 1128077.91 41364067.75 47.95 41450.1 23.44 1188255.4 17781.6 42.61 3.519 2.81 94.725 2368.116 8.42 13.09 0.504 2020130 564.749237 261.454 424.96 421.39 392.39 170.361 147.340 139.19 14.695 68055 10.650 75123 298310333333 958957.41 78.00 84.63 79.684 361.884748 62.68 481.3864 82.7051 588787 278886510 821.5239 48.4485 818.3017 48.4895 178.2763 224.0542 182.6993 218.7781 44.3071 902.0563 34.393 44.951 43.995 3225 10888 42.72 87.8216 455.1038 125.9736 316.8167 26578.0 48.0139 832.3903 46.47 527.3 358.1 352.2 560.5 3446.3 3458.6 358.5 351.5 527.3 559.1 3886.1 3876.2 582551 1396866 669178.00 201328390.34 84975.84 3624.42 26532.30 1146358.16 41978074.41 47.75 41317.2 23.30 1188684.8 17837.9 42.62 3.499 2.81 94.940 2373.489 8.43 13.09 OpenBenchmarking.org
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Linux w DODT doitm=off 0.1139 0.2278 0.3417 0.4556 0.5695 SE +/- 0.024, N = 12 SE +/- 0.021, N = 12 0.506 0.504 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Linux w DODT doitm=off 400K 800K 1200K 1600K 2000K SE +/- 89751.30, N = 12 SE +/- 80874.14, N = 12 2021337 2020130 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
CockroachDB Workload: KV, 10% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 256 Linux w DODT 20K 40K 60K 80K 100K SE +/- 849.68, N = 15 81359.8
CockroachDB Workload: KV, 60% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 256 Linux w DODT 20K 40K 60K 80K 100K SE +/- 1847.96, N = 15 102448.9
CockroachDB Workload: KV, 95% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 256 Linux w DODT 30K 60K 90K 120K 150K SE +/- 2483.59, N = 15 119187.4
Crypto++ Test: Keyed Algorithms OpenBenchmarking.org MiB/second, More Is Better Crypto++ 8.2 Test: Keyed Algorithms Linux w DODT doitm=off 120 240 360 480 600 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 565.09 564.75 1. (CXX) g++ options: -g2 -O3 -fPIC -pthread -pipe
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: allmodconfig Linux w DODT doitm=off 60 120 180 240 300 SE +/- 0.63, N = 3 SE +/- 0.84, N = 3 261.03 261.45
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Linux w DODT doitm=off 90 180 270 360 450 SE +/- 3.25, N = 3 SE +/- 0.79, N = 3 427.42 424.96 MIN: 35.99 / MAX: 5454.55 MIN: 36.19 / MAX: 5454.55
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Linux w DODT doitm=off 90 180 270 360 450 SE +/- 1.99, N = 3 SE +/- 1.56, N = 3 423.13 421.39 MIN: 35.89 / MAX: 5000 MIN: 34.86 / MAX: 5454.55
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Linux w DODT doitm=off 90 180 270 360 450 SE +/- 3.64, N = 3 SE +/- 1.76, N = 3 398.75 392.39 MIN: 34.82 / MAX: 4615.38 MIN: 33.75 / MAX: 5000
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 18.8 Time To Compile Linux w DODT doitm=off 40 80 120 160 200 SE +/- 1.24, N = 3 SE +/- 0.77, N = 3 170.93 170.36
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Ninja Linux w DODT doitm=off 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.50, N = 3 146.96 147.34
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Linux w DODT doitm=off 30 60 90 120 150 SE +/- 0.54, N = 3 SE +/- 0.51, N = 3 138.61 139.19
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Linux w DODT doitm=off 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 14.64 14.70 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Linux w DODT doitm=off 15K 30K 45K 60K 75K SE +/- 95.69, N = 3 SE +/- 295.57, N = 3 68328 68055 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency Linux w DODT doitm=off 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 10.64 10.65 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write Linux w DODT doitm=off 16K 32K 48K 64K 80K SE +/- 197.73, N = 3 SE +/- 295.95, N = 3 75223 75123 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
CockroachDB Workload: MoVR - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 256 Linux w DODT 200 400 600 800 1000 SE +/- 3.64, N = 3 974.8
nekRS Input: TurboPipe Periodic OpenBenchmarking.org FLOP/s, More Is Better nekRS 22.0 Input: TurboPipe Periodic Linux w DODT doitm=off 60000M 120000M 180000M 240000M 300000M SE +/- 500223394.54, N = 3 SE +/- 1474277940.03, N = 3 295621666667 298310333333 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi
Stress-NG Test: Futex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Futex Linux w DODT doitm=off 200K 400K 600K 800K 1000K SE +/- 6957.32, N = 3 SE +/- 56672.45, N = 15 699147.73 958957.41 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.08, N = 3 78.06 78.00
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.28, N = 3 SE +/- 0.06, N = 3 85.13 84.63
libavif avifenc Encoder Speed: 0 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 0 Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.31, N = 3 79.48 79.68 1. (CXX) g++ options: -O3 -fPIC -lm
Crypto++ Test: Unkeyed Algorithms OpenBenchmarking.org MiB/second, More Is Better Crypto++ 8.2 Test: Unkeyed Algorithms Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 361.67 361.88 1. (CXX) g++ options: -g2 -O3 -fPIC -pthread -pipe
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Classroom - Compute: CPU-Only Linux w DODT doitm=off 14 28 42 56 70 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 62.71 62.68
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 110 220 330 440 550 SE +/- 0.57, N = 3 SE +/- 3.55, N = 3 487.36 481.39
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.12, N = 3 SE +/- 0.60, N = 3 81.88 82.71
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Update Random Linux w DODT doitm=off 130K 260K 390K 520K 650K SE +/- 1503.74, N = 3 SE +/- 3603.95, N = 3 592576 588787 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read Linux w DODT doitm=off 60M 120M 180M 240M 300M SE +/- 2251545.82, N = 3 SE +/- 2757403.57, N = 3 278841535 278886510 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 200 400 600 800 1000 SE +/- 0.30, N = 3 SE +/- 0.15, N = 3 823.50 821.52
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 48.51 48.45
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 200 400 600 800 1000 SE +/- 0.79, N = 3 SE +/- 2.36, N = 3 821.21 818.30
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 48.46 48.49
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 40 80 120 160 200 SE +/- 0.19, N = 3 SE +/- 0.20, N = 3 178.62 178.28
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 50 100 150 200 250 SE +/- 0.20, N = 3 SE +/- 0.28, N = 3 223.65 224.05
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 40 80 120 160 200 SE +/- 0.39, N = 3 SE +/- 2.12, N = 3 182.20 182.70
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 50 100 150 200 250 SE +/- 0.42, N = 3 SE +/- 2.51, N = 3 219.31 218.78
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 44.86 44.31
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 200 400 600 800 1000 SE +/- 2.39, N = 3 SE +/- 3.12, N = 3 890.95 902.06
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig Linux w DODT doitm=off 8 16 24 32 40 SE +/- 0.39, N = 4 SE +/- 0.40, N = 4 34.52 34.39
Timed Godot Game Engine Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 3.2.3 Time To Compile Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.20, N = 3 SE +/- 0.31, N = 3 44.65 44.95
libavif avifenc Encoder Speed: 2 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 2 Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 44.04 44.00 1. (CXX) g++ options: -O3 -fPIC -lm
spaCy Model: en_core_web_trf OpenBenchmarking.org tokens/sec, More Is Better spaCy 3.4.1 Model: en_core_web_trf Linux w DODT doitm=off 700 1400 2100 2800 3500 SE +/- 30.17, N = 3 SE +/- 48.89, N = 3 3169 3225
spaCy Model: en_core_web_lg OpenBenchmarking.org tokens/sec, More Is Better spaCy 3.4.1 Model: en_core_web_lg Linux w DODT doitm=off 2K 4K 6K 8K 10K SE +/- 10.12, N = 3 SE +/- 69.82, N = 3 10971 10888
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.33, N = 10 SE +/- 0.36, N = 8 42.68 42.72
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 87.84 87.82
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 100 200 300 400 500 SE +/- 0.28, N = 3 SE +/- 0.57, N = 3 454.95 455.10
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.38, N = 3 125.91 125.97
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 70 140 210 280 350 SE +/- 0.14, N = 3 SE +/- 1.00, N = 3 316.86 316.82
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Monero - Hash Count: 1M Linux w DODT doitm=off 6K 12K 18K 24K 30K SE +/- 76.73, N = 3 SE +/- 48.01, N = 3 26451.3 26578.0 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 48.12 48.01
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 200 400 600 800 1000 SE +/- 0.98, N = 3 SE +/- 0.57, N = 3 830.57 832.39
Kvazaar Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.46, N = 15 SE +/- 0.63, N = 3 47.06 46.47 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Cryptsetup Serpent-XTS 512b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Serpent-XTS 512b Decryption Linux w DODT doitm=off 110 220 330 440 550 527.2 527.3
Cryptsetup Twofish-XTS 512b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Twofish-XTS 512b Decryption Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.25, N = 2 SE +/- 0.23, N = 3 357.5 358.1
Cryptsetup Twofish-XTS 512b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Twofish-XTS 512b Encryption Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 352.2 352.2
Cryptsetup Serpent-XTS 512b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Serpent-XTS 512b Encryption Linux w DODT doitm=off 120 240 360 480 600 SE +/- 0.45, N = 2 SE +/- 0.06, N = 3 561.0 560.5
Cryptsetup AES-XTS 512b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup AES-XTS 512b Decryption Linux w DODT doitm=off 700 1400 2100 2800 3500 SE +/- 13.35, N = 3 SE +/- 2.54, N = 3 3449.8 3446.3
Cryptsetup AES-XTS 512b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup AES-XTS 512b Encryption Linux w DODT doitm=off 700 1400 2100 2800 3500 SE +/- 13.51, N = 3 SE +/- 3.15, N = 3 3445.4 3458.6
Cryptsetup Twofish-XTS 256b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Twofish-XTS 256b Decryption Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.17, N = 3 SE +/- 0.21, N = 3 357.7 358.5
Cryptsetup Twofish-XTS 256b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Twofish-XTS 256b Encryption Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.92, N = 3 SE +/- 0.88, N = 3 351.4 351.5
Cryptsetup Serpent-XTS 256b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Serpent-XTS 256b Decryption Linux w DODT doitm=off 110 220 330 440 550 SE +/- 0.27, N = 3 SE +/- 0.09, N = 3 527.6 527.3
Cryptsetup Serpent-XTS 256b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Serpent-XTS 256b Encryption Linux w DODT doitm=off 120 240 360 480 600 SE +/- 1.27, N = 3 SE +/- 1.35, N = 3 559.5 559.1
Cryptsetup AES-XTS 256b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup AES-XTS 256b Decryption Linux w DODT doitm=off 800 1600 2400 3200 4000 SE +/- 17.78, N = 3 SE +/- 3.34, N = 3 3891.5 3886.1
Cryptsetup AES-XTS 256b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup AES-XTS 256b Encryption Linux w DODT doitm=off 800 1600 2400 3200 4000 SE +/- 16.70, N = 3 SE +/- 7.45, N = 3 3864.3 3876.2
Cryptsetup PBKDF2-whirlpool OpenBenchmarking.org Iterations Per Second, More Is Better Cryptsetup PBKDF2-whirlpool Linux w DODT doitm=off 120K 240K 360K 480K 600K SE +/- 1294.67, N = 3 SE +/- 1624.74, N = 3 583195 582551
Cryptsetup PBKDF2-sha512 OpenBenchmarking.org Iterations Per Second, More Is Better Cryptsetup PBKDF2-sha512 Linux w DODT doitm=off 300K 600K 900K 1200K 1500K SE +/- 3203.15, N = 3 SE +/- 2233.59, N = 3 1392546 1396866
Stress-NG Test: x86_64 RdRand OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: x86_64 RdRand Linux w DODT doitm=off 140K 280K 420K 560K 700K SE +/- 68.80, N = 3 SE +/- 67.49, N = 3 669198.10 669178.00 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Malloc OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Malloc Linux w DODT doitm=off 40M 80M 120M 160M 200M SE +/- 655475.74, N = 3 SE +/- 454146.57, N = 3 195951844.81 201328390.34 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Crypto OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Crypto Linux w DODT doitm=off 20K 40K 60K 80K 100K SE +/- 445.46, N = 3 SE +/- 991.74, N = 3 85533.02 84975.84 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: MEMFD OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MEMFD Linux w DODT doitm=off 800 1600 2400 3200 4000 SE +/- 2.24, N = 3 SE +/- 1.55, N = 3 3592.88 3624.42 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: IO_uring OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: IO_uring Linux w DODT doitm=off 6K 12K 18K 24K 30K SE +/- 16.56, N = 3 SE +/- 1.30, N = 3 26508.09 26532.30 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: SENDFILE OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: SENDFILE Linux w DODT doitm=off 200K 400K 600K 800K 1000K SE +/- 8091.69, N = 3 SE +/- 8323.86, N = 3 1128077.91 1146358.16 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Mutex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Mutex Linux w DODT doitm=off 9M 18M 27M 36M 45M SE +/- 162165.00, N = 3 SE +/- 34997.86, N = 3 41364067.75 41978074.41 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Kvazaar Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.37, N = 10 SE +/- 0.60, N = 3 47.95 47.75 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Wownero - Hash Count: 1M Linux w DODT doitm=off 9K 18K 27K 36K 45K SE +/- 149.86, N = 3 SE +/- 35.05, N = 3 41450.1 41317.2 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only Linux w DODT doitm=off 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 23.44 23.30
OpenSSL OpenBenchmarking.org verify/s, More Is Better OpenSSL Linux w DODT doitm=off 300K 600K 900K 1200K 1500K SE +/- 1656.25, N = 3 SE +/- 1026.50, N = 3 1188255.4 1188684.8 1. OpenSSL 3.0.5 5 Jul 2022 (Library: OpenSSL 3.0.5 5 Jul 2022)
OpenSSL OpenBenchmarking.org sign/s, More Is Better OpenSSL Linux w DODT doitm=off 4K 8K 12K 16K 20K SE +/- 63.70, N = 3 SE +/- 20.72, N = 3 17781.6 17837.9 1. OpenSSL 3.0.5 5 Jul 2022 (Library: OpenSSL 3.0.5 5 Jul 2022)
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.45, N = 3 SE +/- 0.18, N = 3 42.61 42.62
libavif avifenc Encoder Speed: 6 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 6 Linux w DODT doitm=off 0.7918 1.5836 2.3754 3.1672 3.959 SE +/- 0.031, N = 15 SE +/- 0.014, N = 3 3.519 3.499 1. (CXX) g++ options: -O3 -fPIC -lm
WebP Image Encode Encode Settings: Quality 100, Highest Compression OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression Linux w DODT doitm=off 0.6323 1.2646 1.8969 2.5292 3.1615 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.81 2.81 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.72, N = 3 SE +/- 0.43, N = 3 94.73 94.94 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Linux w DODT doitm=off 500 1000 1500 2000 2500 SE +/- 17.94, N = 3 SE +/- 10.72, N = 3 2368.12 2373.49 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
WebP Image Encode Encode Settings: Quality 100 OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100 Linux w DODT doitm=off 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 8.42 8.43 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
WebP Image Encode Encode Settings: Default OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Default Linux w DODT doitm=off 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 13.09 13.09 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
Phoronix Test Suite v10.8.4