Benchmarks for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2301271-NE-XEONPLATI60 Xeon Platinum 8380 DODT Mitigation Impact - Phoronix Test Suite Xeon Platinum 8380 DODT Mitigation Impact Benchmarks for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2301271-NE-XEONPLATI60&grs&rdt .
Xeon Platinum 8380 DODT Mitigation Impact Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server Vulkan Compiler File-System Screen Resolution Linux w DODT doitm=off 2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads) Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS) Intel Ice Lake IEH 512GB 7682GB INTEL SSDPF2KX076TZ ASPEED VE228 2 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFP Ubuntu 22.10 6.2.0-rc5-phx-dodt (x86_64) GNOME Shell X Server 1.21.1.3 1.3.211 GCC 12.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Wbc0TK/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Wbc0TK/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375 Python Details - Python 3.10.6 Security Details - Linux w DODT: dodt: Mitigation of DOITM + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - doitm=off: dodt: Vulnerable + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
Xeon Platinum 8380 DODT Mitigation Impact stress-ng: Malloc spacy: en_core_web_trf clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache stress-ng: SENDFILE stress-ng: Mutex kvazaar: Bosphorus 4K - Super Fast deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream nekrs: TurboPipe Periodic stress-ng: MEMFD spacy: en_core_web_lg build-godot: Time To Compile stress-ng: Crypto rocksdb: Update Rand blender: BMW27 - CPU-Only openradioss: Bumper Beam clickhouse: 100M Rows Hits Dataset, Third Run avifenc: 6 xmrig: Monero - 1M kvazaar: Bosphorus 4K - Ultra Fast openradioss: Bird Strike on Windshield clickhouse: 100M Rows Hits Dataset, Second Run pgbench: 100 - 1000 - Read Write - Average Latency pgbench: 100 - 1000 - Read Write cryptsetup: AES-XTS 512b Encryption deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream build-linux-kernel: defconfig build-nodejs: Time To Compile xmrig: Wownero - 1M openssl: cryptsetup: PBKDF2-sha512 cryptsetup: AES-XTS 256b Encryption deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream build-llvm: Ninja avifenc: 0 deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream minibude: OpenMP - BM1 minibude: OpenMP - BM1 cryptsetup: Twofish-XTS 256b Decryption deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream cryptsetup: Twofish-XTS 512b Decryption build-linux-kernel: allmodconfig pgbench: 100 - 800 - Read Write - Average Latency cryptsetup: AES-XTS 256b Decryption pgbench: 100 - 800 - Read Write deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream webp: Quality 100 cryptsetup: PBKDF2-whirlpool cryptsetup: AES-XTS 512b Decryption avifenc: 2 uvg266: Bosphorus 4K - Super Fast stress-ng: IO_uring cryptsetup: Serpent-XTS 512b Encryption openradioss: Rubber O-Ring Seal Installation cryptsetup: Serpent-XTS 256b Encryption deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream cryptopp: Keyed Algorithms cryptopp: Unkeyed Algorithms cryptsetup: Serpent-XTS 256b Decryption deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream blender: Classroom - CPU-Only openssl: deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream cryptsetup: Twofish-XTS 256b Encryption uvg266: Bosphorus 4K - Ultra Fast cryptsetup: Serpent-XTS 512b Decryption deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream rocksdb: Rand Read deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream stress-ng: x86_64 RdRand cryptsetup: Twofish-XTS 512b Encryption cockroach: KV, 10% Reads - 256 cockroach: MoVR - 256 webp: Quality 100, Highest Compression webp: Default stress-ng: Futex pgbench: 100 - 1000 - Read Only - Average Latency pgbench: 100 - 1000 - Read Only cockroach: KV, 95% Reads - 256 cockroach: KV, 60% Reads - 256 Linux w DODT doitm=off 195951844.81 3169 398.75 1128077.91 41364067.75 47.06 890.9486 44.8577 487.3610 81.8802 295621666667 3592.88 10971 44.646 85533.02 592576 23.44 85.13 427.42 3.519 26451.3 47.95 138.61 423.13 14.635 68328 3445.4 821.2112 34.515 170.929 41450.1 17781.6 1392546 3864.3 182.2006 146.956 79.482 219.3059 823.5023 48.1234 94.725 2368.116 357.7 830.5710 178.6233 223.6458 357.5 261.028 10.635 3891.5 75223 48.5123 8.42 583195 3449.8 44.038 42.68 26508.09 561.0 78.06 559.5 48.4603 565.089482 361.672421 527.6 125.9126 62.71 1188255.4 454.9543 351.4 42.61 527.2 87.8377 278841535 316.8622 669198.10 352.2 81359.8 974.8 2.81 13.09 699147.73 0.506 2021337 119187.4 102448.9 201328390.34 3225 392.39 1146358.16 41978074.41 46.47 902.0563 44.3071 481.3864 82.7051 298310333333 3624.42 10888 44.951 84975.84 588787 23.30 84.63 424.96 3.499 26578.0 47.75 139.19 421.39 14.695 68055 3458.6 818.3017 34.393 170.361 41317.2 17837.9 1396866 3876.2 182.6993 147.340 79.684 218.7781 821.5239 48.0139 94.940 2373.489 358.5 832.3903 178.2763 224.0542 358.1 261.454 10.650 3886.1 75123 48.4485 8.43 582551 3446.3 43.995 42.72 26532.30 560.5 78.00 559.1 48.4895 564.749237 361.884748 527.3 125.9736 62.68 1188684.8 455.1038 351.5 42.62 527.3 87.8216 278886510 316.8167 669178.00 352.2 2.81 13.09 958957.41 0.504 2020130 OpenBenchmarking.org
Stress-NG Test: Malloc OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Malloc Linux w DODT doitm=off 40M 80M 120M 160M 200M SE +/- 655475.74, N = 3 SE +/- 454146.57, N = 3 195951844.81 201328390.34 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
spaCy Model: en_core_web_trf OpenBenchmarking.org tokens/sec, More Is Better spaCy 3.4.1 Model: en_core_web_trf Linux w DODT doitm=off 700 1400 2100 2800 3500 SE +/- 30.17, N = 3 SE +/- 48.89, N = 3 3169 3225
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Linux w DODT doitm=off 90 180 270 360 450 SE +/- 3.64, N = 3 SE +/- 1.76, N = 3 398.75 392.39 MIN: 34.82 / MAX: 4615.38 MIN: 33.75 / MAX: 5000
Stress-NG Test: SENDFILE OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: SENDFILE Linux w DODT doitm=off 200K 400K 600K 800K 1000K SE +/- 8091.69, N = 3 SE +/- 8323.86, N = 3 1128077.91 1146358.16 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Stress-NG Test: Mutex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Mutex Linux w DODT doitm=off 9M 18M 27M 36M 45M SE +/- 162165.00, N = 3 SE +/- 34997.86, N = 3 41364067.75 41978074.41 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Kvazaar Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Super Fast Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.46, N = 15 SE +/- 0.63, N = 3 47.06 46.47 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 200 400 600 800 1000 SE +/- 2.39, N = 3 SE +/- 3.12, N = 3 890.95 902.06
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.12, N = 3 SE +/- 0.16, N = 3 44.86 44.31
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 110 220 330 440 550 SE +/- 0.57, N = 3 SE +/- 3.55, N = 3 487.36 481.39
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.12, N = 3 SE +/- 0.60, N = 3 81.88 82.71
nekRS Input: TurboPipe Periodic OpenBenchmarking.org FLOP/s, More Is Better nekRS 22.0 Input: TurboPipe Periodic Linux w DODT doitm=off 60000M 120000M 180000M 240000M 300000M SE +/- 500223394.54, N = 3 SE +/- 1474277940.03, N = 3 295621666667 298310333333 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi
Stress-NG Test: MEMFD OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MEMFD Linux w DODT doitm=off 800 1600 2400 3200 4000 SE +/- 2.24, N = 3 SE +/- 1.55, N = 3 3592.88 3624.42 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
spaCy Model: en_core_web_lg OpenBenchmarking.org tokens/sec, More Is Better spaCy 3.4.1 Model: en_core_web_lg Linux w DODT doitm=off 2K 4K 6K 8K 10K SE +/- 10.12, N = 3 SE +/- 69.82, N = 3 10971 10888
Timed Godot Game Engine Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 3.2.3 Time To Compile Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.20, N = 3 SE +/- 0.31, N = 3 44.65 44.95
Stress-NG Test: Crypto OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Crypto Linux w DODT doitm=off 20K 40K 60K 80K 100K SE +/- 445.46, N = 3 SE +/- 991.74, N = 3 85533.02 84975.84 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Update Random Linux w DODT doitm=off 130K 260K 390K 520K 650K SE +/- 1503.74, N = 3 SE +/- 3603.95, N = 3 592576 588787 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only Linux w DODT doitm=off 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 23.44 23.30
OpenRadioss Model: Bumper Beam OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bumper Beam Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.28, N = 3 SE +/- 0.06, N = 3 85.13 84.63
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Linux w DODT doitm=off 90 180 270 360 450 SE +/- 3.25, N = 3 SE +/- 0.79, N = 3 427.42 424.96 MIN: 35.99 / MAX: 5454.55 MIN: 36.19 / MAX: 5454.55
libavif avifenc Encoder Speed: 6 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 6 Linux w DODT doitm=off 0.7918 1.5836 2.3754 3.1672 3.959 SE +/- 0.031, N = 15 SE +/- 0.014, N = 3 3.519 3.499 1. (CXX) g++ options: -O3 -fPIC -lm
Xmrig Variant: Monero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Monero - Hash Count: 1M Linux w DODT doitm=off 6K 12K 18K 24K 30K SE +/- 76.73, N = 3 SE +/- 48.01, N = 3 26451.3 26578.0 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
Kvazaar Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.37, N = 10 SE +/- 0.60, N = 3 47.95 47.75 1. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt
OpenRadioss Model: Bird Strike on Windshield OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Linux w DODT doitm=off 30 60 90 120 150 SE +/- 0.54, N = 3 SE +/- 0.51, N = 3 138.61 139.19
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Linux w DODT doitm=off 90 180 270 360 450 SE +/- 1.99, N = 3 SE +/- 1.56, N = 3 423.13 421.39 MIN: 35.89 / MAX: 5000 MIN: 34.86 / MAX: 5454.55
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency Linux w DODT doitm=off 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.06, N = 3 14.64 14.70 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Write Linux w DODT doitm=off 15K 30K 45K 60K 75K SE +/- 95.69, N = 3 SE +/- 295.57, N = 3 68328 68055 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Cryptsetup AES-XTS 512b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup AES-XTS 512b Encryption Linux w DODT doitm=off 700 1400 2100 2800 3500 SE +/- 13.51, N = 3 SE +/- 3.15, N = 3 3445.4 3458.6
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 200 400 600 800 1000 SE +/- 0.79, N = 3 SE +/- 2.36, N = 3 821.21 818.30
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig Linux w DODT doitm=off 8 16 24 32 40 SE +/- 0.39, N = 4 SE +/- 0.40, N = 4 34.52 34.39
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 18.8 Time To Compile Linux w DODT doitm=off 40 80 120 160 200 SE +/- 1.24, N = 3 SE +/- 0.77, N = 3 170.93 170.36
Xmrig Variant: Wownero - Hash Count: 1M OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Wownero - Hash Count: 1M Linux w DODT doitm=off 9K 18K 27K 36K 45K SE +/- 149.86, N = 3 SE +/- 35.05, N = 3 41450.1 41317.2 1. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc
OpenSSL OpenBenchmarking.org sign/s, More Is Better OpenSSL Linux w DODT doitm=off 4K 8K 12K 16K 20K SE +/- 63.70, N = 3 SE +/- 20.72, N = 3 17781.6 17837.9 1. OpenSSL 3.0.5 5 Jul 2022 (Library: OpenSSL 3.0.5 5 Jul 2022)
Cryptsetup PBKDF2-sha512 OpenBenchmarking.org Iterations Per Second, More Is Better Cryptsetup PBKDF2-sha512 Linux w DODT doitm=off 300K 600K 900K 1200K 1500K SE +/- 3203.15, N = 3 SE +/- 2233.59, N = 3 1392546 1396866
Cryptsetup AES-XTS 256b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup AES-XTS 256b Encryption Linux w DODT doitm=off 800 1600 2400 3200 4000 SE +/- 16.70, N = 3 SE +/- 7.45, N = 3 3864.3 3876.2
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 40 80 120 160 200 SE +/- 0.39, N = 3 SE +/- 2.12, N = 3 182.20 182.70
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 13.0 Build System: Ninja Linux w DODT doitm=off 30 60 90 120 150 SE +/- 0.07, N = 3 SE +/- 0.50, N = 3 146.96 147.34
libavif avifenc Encoder Speed: 0 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 0 Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.33, N = 3 SE +/- 0.31, N = 3 79.48 79.68 1. (CXX) g++ options: -O3 -fPIC -lm
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 50 100 150 200 250 SE +/- 0.42, N = 3 SE +/- 2.51, N = 3 219.31 218.78
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 200 400 600 800 1000 SE +/- 0.30, N = 3 SE +/- 0.15, N = 3 823.50 821.52
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.06, N = 3 SE +/- 0.03, N = 3 48.12 48.01
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org Billion Interactions/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.72, N = 3 SE +/- 0.43, N = 3 94.73 94.94 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
miniBUDE Implementation: OpenMP - Input Deck: BM1 OpenBenchmarking.org GFInst/s, More Is Better miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Linux w DODT doitm=off 500 1000 1500 2000 2500 SE +/- 17.94, N = 3 SE +/- 10.72, N = 3 2368.12 2373.49 1. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm
Cryptsetup Twofish-XTS 256b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Twofish-XTS 256b Decryption Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.17, N = 3 SE +/- 0.21, N = 3 357.7 358.5
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 200 400 600 800 1000 SE +/- 0.98, N = 3 SE +/- 0.57, N = 3 830.57 832.39
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 40 80 120 160 200 SE +/- 0.19, N = 3 SE +/- 0.20, N = 3 178.62 178.28
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 50 100 150 200 250 SE +/- 0.20, N = 3 SE +/- 0.28, N = 3 223.65 224.05
Cryptsetup Twofish-XTS 512b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Twofish-XTS 512b Decryption Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.25, N = 2 SE +/- 0.23, N = 3 357.5 358.1
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: allmodconfig Linux w DODT doitm=off 60 120 180 240 300 SE +/- 0.63, N = 3 SE +/- 0.84, N = 3 261.03 261.45
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency Linux w DODT doitm=off 3 6 9 12 15 SE +/- 0.03, N = 3 SE +/- 0.04, N = 3 10.64 10.65 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Cryptsetup AES-XTS 256b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup AES-XTS 256b Decryption Linux w DODT doitm=off 800 1600 2400 3200 4000 SE +/- 17.78, N = 3 SE +/- 3.34, N = 3 3891.5 3886.1
PostgreSQL Scaling Factor: 100 - Clients: 800 - Mode: Read Write OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 800 - Mode: Read Write Linux w DODT doitm=off 16K 32K 48K 64K 80K SE +/- 197.73, N = 3 SE +/- 295.95, N = 3 75223 75123 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.01, N = 3 SE +/- 0.02, N = 3 48.51 48.45
WebP Image Encode Encode Settings: Quality 100 OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100 Linux w DODT doitm=off 2 4 6 8 10 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 8.42 8.43 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
Cryptsetup PBKDF2-whirlpool OpenBenchmarking.org Iterations Per Second, More Is Better Cryptsetup PBKDF2-whirlpool Linux w DODT doitm=off 120K 240K 360K 480K 600K SE +/- 1294.67, N = 3 SE +/- 1624.74, N = 3 583195 582551
Cryptsetup AES-XTS 512b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup AES-XTS 512b Decryption Linux w DODT doitm=off 700 1400 2100 2800 3500 SE +/- 13.35, N = 3 SE +/- 2.54, N = 3 3449.8 3446.3
libavif avifenc Encoder Speed: 2 OpenBenchmarking.org Seconds, Fewer Is Better libavif avifenc 0.11 Encoder Speed: 2 Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.03, N = 3 SE +/- 0.23, N = 3 44.04 44.00 1. (CXX) g++ options: -O3 -fPIC -lm
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.33, N = 10 SE +/- 0.36, N = 8 42.68 42.72
Stress-NG Test: IO_uring OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: IO_uring Linux w DODT doitm=off 6K 12K 18K 24K 30K SE +/- 16.56, N = 3 SE +/- 1.30, N = 3 26508.09 26532.30 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Cryptsetup Serpent-XTS 512b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Serpent-XTS 512b Encryption Linux w DODT doitm=off 120 240 360 480 600 SE +/- 0.45, N = 2 SE +/- 0.06, N = 3 561.0 560.5
OpenRadioss Model: Rubber O-Ring Seal Installation OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.01, N = 3 SE +/- 0.08, N = 3 78.06 78.00
Cryptsetup Serpent-XTS 256b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Serpent-XTS 256b Encryption Linux w DODT doitm=off 120 240 360 480 600 SE +/- 1.27, N = 3 SE +/- 1.35, N = 3 559.5 559.1
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 11 22 33 44 55 SE +/- 0.18, N = 3 SE +/- 0.03, N = 3 48.46 48.49
Crypto++ Test: Keyed Algorithms OpenBenchmarking.org MiB/second, More Is Better Crypto++ 8.2 Test: Keyed Algorithms Linux w DODT doitm=off 120 240 360 480 600 SE +/- 0.07, N = 3 SE +/- 0.20, N = 3 565.09 564.75 1. (CXX) g++ options: -g2 -O3 -fPIC -pthread -pipe
Crypto++ Test: Unkeyed Algorithms OpenBenchmarking.org MiB/second, More Is Better Crypto++ 8.2 Test: Unkeyed Algorithms Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.04, N = 3 SE +/- 0.02, N = 3 361.67 361.88 1. (CXX) g++ options: -g2 -O3 -fPIC -pthread -pipe
Cryptsetup Serpent-XTS 256b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Serpent-XTS 256b Decryption Linux w DODT doitm=off 110 220 330 440 550 SE +/- 0.27, N = 3 SE +/- 0.09, N = 3 527.6 527.3
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 30 60 90 120 150 SE +/- 0.09, N = 3 SE +/- 0.38, N = 3 125.91 125.97
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Classroom - Compute: CPU-Only Linux w DODT doitm=off 14 28 42 56 70 SE +/- 0.10, N = 3 SE +/- 0.06, N = 3 62.71 62.68
OpenSSL OpenBenchmarking.org verify/s, More Is Better OpenSSL Linux w DODT doitm=off 300K 600K 900K 1200K 1500K SE +/- 1656.25, N = 3 SE +/- 1026.50, N = 3 1188255.4 1188684.8 1. OpenSSL 3.0.5 5 Jul 2022 (Library: OpenSSL 3.0.5 5 Jul 2022)
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 100 200 300 400 500 SE +/- 0.28, N = 3 SE +/- 0.57, N = 3 454.95 455.10
Cryptsetup Twofish-XTS 256b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Twofish-XTS 256b Encryption Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.92, N = 3 SE +/- 0.88, N = 3 351.4 351.5
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Linux w DODT doitm=off 10 20 30 40 50 SE +/- 0.45, N = 3 SE +/- 0.18, N = 3 42.61 42.62
Cryptsetup Serpent-XTS 512b Decryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Serpent-XTS 512b Decryption Linux w DODT doitm=off 110 220 330 440 550 527.2 527.3
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 20 40 60 80 100 SE +/- 0.05, N = 3 SE +/- 0.10, N = 3 87.84 87.82
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read Linux w DODT doitm=off 60M 120M 180M 240M 300M SE +/- 2251545.82, N = 3 SE +/- 2757403.57, N = 3 278841535 278886510 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream Linux w DODT doitm=off 70 140 210 280 350 SE +/- 0.14, N = 3 SE +/- 1.00, N = 3 316.86 316.82
Stress-NG Test: x86_64 RdRand OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: x86_64 RdRand Linux w DODT doitm=off 140K 280K 420K 560K 700K SE +/- 68.80, N = 3 SE +/- 67.49, N = 3 669198.10 669178.00 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
Cryptsetup Twofish-XTS 512b Encryption OpenBenchmarking.org MiB/s, More Is Better Cryptsetup Twofish-XTS 512b Encryption Linux w DODT doitm=off 80 160 240 320 400 SE +/- 0.12, N = 3 SE +/- 0.03, N = 3 352.2 352.2
CockroachDB Workload: KV, 10% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 256 Linux w DODT 20K 40K 60K 80K 100K SE +/- 849.68, N = 15 81359.8
CockroachDB Workload: MoVR - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 256 Linux w DODT 200 400 600 800 1000 SE +/- 3.64, N = 3 974.8
WebP Image Encode Encode Settings: Quality 100, Highest Compression OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression Linux w DODT doitm=off 0.6323 1.2646 1.8969 2.5292 3.1615 SE +/- 0.00, N = 3 SE +/- 0.00, N = 3 2.81 2.81 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
WebP Image Encode Encode Settings: Default OpenBenchmarking.org MP/s, More Is Better WebP Image Encode 1.2.4 Encode Settings: Default Linux w DODT doitm=off 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.01, N = 3 13.09 13.09 1. (CC) gcc options: -fvisibility=hidden -O2 -lm
Stress-NG Test: Futex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Futex Linux w DODT doitm=off 200K 400K 600K 800K 1000K SE +/- 6957.32, N = 3 SE +/- 56672.45, N = 15 699147.73 958957.41 1. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency OpenBenchmarking.org ms, Fewer Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency Linux w DODT doitm=off 0.1139 0.2278 0.3417 0.4556 0.5695 SE +/- 0.024, N = 12 SE +/- 0.021, N = 12 0.506 0.504 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
PostgreSQL Scaling Factor: 100 - Clients: 1000 - Mode: Read Only OpenBenchmarking.org TPS, More Is Better PostgreSQL 15 Scaling Factor: 100 - Clients: 1000 - Mode: Read Only Linux w DODT doitm=off 400K 800K 1200K 1600K 2000K SE +/- 89751.30, N = 12 SE +/- 80874.14, N = 12 2021337 2020130 1. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm
CockroachDB Workload: KV, 95% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 256 Linux w DODT 30K 60K 90K 120K 150K SE +/- 2483.59, N = 15 119187.4
CockroachDB Workload: KV, 60% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 256 Linux w DODT 20K 40K 60K 80K 100K SE +/- 1847.96, N = 15 102448.9
Phoronix Test Suite v10.8.4