Xeon Platinum 8380 DODT Mitigation Impact

Benchmarks for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2301271-NE-XEONPLATI60&grr&sor.

Xeon Platinum 8380 DODT Mitigation ImpactProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionLinux w DODTdoitm=off2 x Intel Xeon Platinum 8380 @ 3.40GHz (80 Cores / 160 Threads)Intel M50CYP2SB2U (SE5C6200.86B.0022.D08.2103221623 BIOS)Intel Ice Lake IEH512GB7682GB INTEL SSDPF2KX076TZASPEEDVE2282 x Intel X710 for 10GBASE-T + 2 x Intel E810-C for QSFPUbuntu 22.106.2.0-rc5-phx-dodt (x86_64)GNOME ShellX Server 1.21.1.31.3.211GCC 12.2.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-Wbc0TK/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-Wbc0TK/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0xd000375 Python Details- Python 3.10.6Security Details- Linux w DODT: dodt: Mitigation of DOITM + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected - doitm=off: dodt: Vulnerable + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Xeon Platinum 8380 DODT Mitigation Impactpgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlycockroach: KV, 10% Reads - 256cockroach: KV, 60% Reads - 256cockroach: KV, 95% Reads - 256cryptopp: Keyed Algorithmsbuild-linux-kernel: allmodconfigclickhouse: 100M Rows Hits Dataset, Third Runclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachebuild-nodejs: Time To Compilebuild-llvm: Ninjaopenradioss: Bird Strike on Windshieldpgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writepgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 800 - Read Writecockroach: MoVR - 256nekrs: TurboPipe Periodicstress-ng: Futexopenradioss: Rubber O-Ring Seal Installationopenradioss: Bumper Beamavifenc: 0cryptopp: Unkeyed Algorithmsblender: Classroom - CPU-Onlydeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamrocksdb: Update Randrocksdb: Rand Readdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streambuild-linux-kernel: defconfigbuild-godot: Time To Compileavifenc: 2spacy: en_core_web_trfspacy: en_core_web_lguvg266: Bosphorus 4K - Super Fastdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamxmrig: Monero - 1Mdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamkvazaar: Bosphorus 4K - Super Fastcryptsetup: Serpent-XTS 512b Decryptioncryptsetup: Twofish-XTS 512b Decryptioncryptsetup: Twofish-XTS 512b Encryptioncryptsetup: Serpent-XTS 512b Encryptioncryptsetup: AES-XTS 512b Decryptioncryptsetup: AES-XTS 512b Encryptioncryptsetup: Twofish-XTS 256b Decryptioncryptsetup: Twofish-XTS 256b Encryptioncryptsetup: Serpent-XTS 256b Decryptioncryptsetup: Serpent-XTS 256b Encryptioncryptsetup: AES-XTS 256b Decryptioncryptsetup: AES-XTS 256b Encryptioncryptsetup: PBKDF2-whirlpoolcryptsetup: PBKDF2-sha512stress-ng: x86_64 RdRandstress-ng: Mallocstress-ng: Cryptostress-ng: MEMFDstress-ng: IO_uringstress-ng: SENDFILEstress-ng: Mutexkvazaar: Bosphorus 4K - Ultra Fastxmrig: Wownero - 1Mblender: BMW27 - CPU-Onlyopenssl: openssl: uvg266: Bosphorus 4K - Ultra Fastavifenc: 6webp: Quality 100, Highest Compressionminibude: OpenMP - BM1minibude: OpenMP - BM1webp: Quality 100webp: DefaultLinux w DODTdoitm=off0.506202133781359.8102448.9119187.4565.089482261.028427.42423.13398.75170.929146.956138.6114.6356832810.63575223974.8295621666667699147.7378.0685.1379.482361.67242162.71487.361081.8802592576278841535823.502348.5123821.211248.4603178.6233223.6458182.2006219.305944.8577890.948634.51544.64644.03831691097142.6887.8377454.9543125.9126316.862226451.348.1234830.571047.06527.2357.5352.2561.03449.83445.4357.7351.4527.6559.53891.53864.35831951392546669198.10195951844.8185533.023592.8826508.091128077.9141364067.7547.9541450.123.441188255.417781.642.613.5192.8194.7252368.1168.4213.090.5042020130564.749237261.454424.96421.39392.39170.361147.340139.1914.6956805510.65075123298310333333958957.4178.0084.6379.684361.88474862.68481.386482.7051588787278886510821.523948.4485818.301748.4895178.2763224.0542182.6993218.778144.3071902.056334.39344.95143.99532251088842.7287.8216455.1038125.9736316.816726578.048.0139832.390346.47527.3358.1352.2560.53446.33458.6358.5351.5527.3559.13886.13876.25825511396866669178.00201328390.3484975.843624.4226532.301146358.1641978074.4147.7541317.223.301188684.817837.942.623.4992.8194.9402373.4898.4313.09OpenBenchmarking.org

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencydoitm=offLinux w DODT0.11390.22780.34170.45560.5695SE +/- 0.021, N = 12SE +/- 0.024, N = 120.5040.5061. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyLinux w DODTdoitm=off400K800K1200K1600K2000KSE +/- 89751.30, N = 12SE +/- 80874.14, N = 12202133720201301. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

CockroachDB

Workload: KV, 10% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 256Linux w DODT20K40K60K80K100KSE +/- 849.68, N = 1581359.8

CockroachDB

Workload: KV, 60% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 60% Reads - Concurrency: 256Linux w DODT20K40K60K80K100KSE +/- 1847.96, N = 15102448.9

CockroachDB

Workload: KV, 95% Reads - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 256Linux w DODT30K60K90K120K150KSE +/- 2483.59, N = 15119187.4

Crypto++

Test: Keyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.2Test: Keyed AlgorithmsLinux w DODTdoitm=off120240360480600SE +/- 0.07, N = 3SE +/- 0.20, N = 3565.09564.751. (CXX) g++ options: -g2 -O3 -fPIC -pthread -pipe

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigLinux w DODTdoitm=off60120180240300SE +/- 0.63, N = 3SE +/- 0.84, N = 3261.03261.45

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third RunLinux w DODTdoitm=off90180270360450SE +/- 3.25, N = 3SE +/- 0.79, N = 3427.42424.96MIN: 35.99 / MAX: 5454.55MIN: 36.19 / MAX: 5454.55

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second RunLinux w DODTdoitm=off90180270360450SE +/- 1.99, N = 3SE +/- 1.56, N = 3423.13421.39MIN: 35.89 / MAX: 5000MIN: 34.86 / MAX: 5454.55

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold CacheLinux w DODTdoitm=off90180270360450SE +/- 3.64, N = 3SE +/- 1.76, N = 3398.75392.39MIN: 34.82 / MAX: 4615.38MIN: 33.75 / MAX: 5000

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To Compiledoitm=offLinux w DODT4080120160200SE +/- 0.77, N = 3SE +/- 1.24, N = 3170.36170.93

Timed LLVM Compilation

Build System: Ninja

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 13.0Build System: NinjaLinux w DODTdoitm=off306090120150SE +/- 0.07, N = 3SE +/- 0.50, N = 3146.96147.34

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bird Strike on WindshieldLinux w DODTdoitm=off306090120150SE +/- 0.54, N = 3SE +/- 0.51, N = 3138.61139.19

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyLinux w DODTdoitm=off48121620SE +/- 0.02, N = 3SE +/- 0.06, N = 314.6414.701. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteLinux w DODTdoitm=off15K30K45K60K75KSE +/- 95.69, N = 3SE +/- 295.57, N = 368328680551. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average LatencyLinux w DODTdoitm=off3691215SE +/- 0.03, N = 3SE +/- 0.04, N = 310.6410.651. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read WriteLinux w DODTdoitm=off16K32K48K64K80KSE +/- 197.73, N = 3SE +/- 295.95, N = 375223751231. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

CockroachDB

Workload: MoVR - Concurrency: 256

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 256Linux w DODT2004006008001000SE +/- 3.64, N = 3974.8

nekRS

Input: TurboPipe Periodic

OpenBenchmarking.orgFLOP/s, More Is BetternekRS 22.0Input: TurboPipe Periodicdoitm=offLinux w DODT60000M120000M180000M240000M300000MSE +/- 1474277940.03, N = 3SE +/- 500223394.54, N = 32983103333332956216666671. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -lmpi_cxx -lmpi

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Futexdoitm=offLinux w DODT200K400K600K800K1000KSE +/- 56672.45, N = 15SE +/- 6957.32, N = 3958957.41699147.731. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Rubber O-Ring Seal Installationdoitm=offLinux w DODT20406080100SE +/- 0.08, N = 3SE +/- 0.01, N = 378.0078.06

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2022.10.13Model: Bumper Beamdoitm=offLinux w DODT20406080100SE +/- 0.06, N = 3SE +/- 0.28, N = 384.6385.13

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 0Linux w DODTdoitm=off20406080100SE +/- 0.33, N = 3SE +/- 0.31, N = 379.4879.681. (CXX) g++ options: -O3 -fPIC -lm

Crypto++

Test: Unkeyed Algorithms

OpenBenchmarking.orgMiB/second, More Is BetterCrypto++ 8.2Test: Unkeyed Algorithmsdoitm=offLinux w DODT80160240320400SE +/- 0.02, N = 3SE +/- 0.04, N = 3361.88361.671. (CXX) g++ options: -g2 -O3 -fPIC -pthread -pipe

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-Onlydoitm=offLinux w DODT1428425670SE +/- 0.06, N = 3SE +/- 0.10, N = 362.6862.71

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT110220330440550SE +/- 3.55, N = 3SE +/- 0.57, N = 3481.39487.36

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT20406080100SE +/- 0.60, N = 3SE +/- 0.12, N = 382.7181.88

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update RandomLinux w DODTdoitm=off130K260K390K520K650KSE +/- 1503.74, N = 3SE +/- 3603.95, N = 35925765887871. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Readdoitm=offLinux w DODT60M120M180M240M300MSE +/- 2757403.57, N = 3SE +/- 2251545.82, N = 32788865102788415351. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT2004006008001000SE +/- 0.15, N = 3SE +/- 0.30, N = 3821.52823.50

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamLinux w DODTdoitm=off1122334455SE +/- 0.01, N = 3SE +/- 0.02, N = 348.5148.45

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT2004006008001000SE +/- 2.36, N = 3SE +/- 0.79, N = 3818.30821.21

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT1122334455SE +/- 0.03, N = 3SE +/- 0.18, N = 348.4948.46

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT4080120160200SE +/- 0.20, N = 3SE +/- 0.19, N = 3178.28178.62

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT50100150200250SE +/- 0.28, N = 3SE +/- 0.20, N = 3224.05223.65

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux w DODTdoitm=off4080120160200SE +/- 0.39, N = 3SE +/- 2.12, N = 3182.20182.70

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamLinux w DODTdoitm=off50100150200250SE +/- 0.42, N = 3SE +/- 2.51, N = 3219.31218.78

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT1020304050SE +/- 0.16, N = 3SE +/- 0.12, N = 344.3144.86

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT2004006008001000SE +/- 3.12, N = 3SE +/- 2.39, N = 3902.06890.95

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigdoitm=offLinux w DODT816243240SE +/- 0.40, N = 4SE +/- 0.39, N = 434.3934.52

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To CompileLinux w DODTdoitm=off1020304050SE +/- 0.20, N = 3SE +/- 0.31, N = 344.6544.95

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 2doitm=offLinux w DODT1020304050SE +/- 0.23, N = 3SE +/- 0.03, N = 344.0044.041. (CXX) g++ options: -O3 -fPIC -lm

spaCy

Model: en_core_web_trf

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_trfdoitm=offLinux w DODT7001400210028003500SE +/- 48.89, N = 3SE +/- 30.17, N = 332253169

spaCy

Model: en_core_web_lg

OpenBenchmarking.orgtokens/sec, More Is BetterspaCy 3.4.1Model: en_core_web_lgLinux w DODTdoitm=off2K4K6K8K10KSE +/- 10.12, N = 3SE +/- 69.82, N = 31097110888

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fastdoitm=offLinux w DODT1020304050SE +/- 0.36, N = 8SE +/- 0.33, N = 1042.7242.68

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT20406080100SE +/- 0.10, N = 3SE +/- 0.05, N = 387.8287.84

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT100200300400500SE +/- 0.57, N = 3SE +/- 0.28, N = 3455.10454.95

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux w DODTdoitm=off306090120150SE +/- 0.09, N = 3SE +/- 0.38, N = 3125.91125.97

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamLinux w DODTdoitm=off70140210280350SE +/- 0.14, N = 3SE +/- 1.00, N = 3316.86316.82

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Monero - Hash Count: 1Mdoitm=offLinux w DODT6K12K18K24K30KSE +/- 48.01, N = 3SE +/- 76.73, N = 326578.026451.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT1122334455SE +/- 0.03, N = 3SE +/- 0.06, N = 348.0148.12

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamdoitm=offLinux w DODT2004006008001000SE +/- 0.57, N = 3SE +/- 0.98, N = 3832.39830.57

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastLinux w DODTdoitm=off1122334455SE +/- 0.46, N = 15SE +/- 0.63, N = 347.0646.471. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Cryptsetup

Serpent-XTS 512b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 512b Decryptiondoitm=offLinux w DODT110220330440550527.3527.2

Cryptsetup

Twofish-XTS 512b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 512b Decryptiondoitm=offLinux w DODT80160240320400SE +/- 0.23, N = 3SE +/- 0.25, N = 2358.1357.5

Cryptsetup

Twofish-XTS 512b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 512b Encryptiondoitm=offLinux w DODT80160240320400SE +/- 0.03, N = 3SE +/- 0.12, N = 3352.2352.2

Cryptsetup

Serpent-XTS 512b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 512b EncryptionLinux w DODTdoitm=off120240360480600SE +/- 0.45, N = 2SE +/- 0.06, N = 3561.0560.5

Cryptsetup

AES-XTS 512b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b DecryptionLinux w DODTdoitm=off7001400210028003500SE +/- 13.35, N = 3SE +/- 2.54, N = 33449.83446.3

Cryptsetup

AES-XTS 512b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 512b Encryptiondoitm=offLinux w DODT7001400210028003500SE +/- 3.15, N = 3SE +/- 13.51, N = 33458.63445.4

Cryptsetup

Twofish-XTS 256b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 256b Decryptiondoitm=offLinux w DODT80160240320400SE +/- 0.21, N = 3SE +/- 0.17, N = 3358.5357.7

Cryptsetup

Twofish-XTS 256b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupTwofish-XTS 256b Encryptiondoitm=offLinux w DODT80160240320400SE +/- 0.88, N = 3SE +/- 0.92, N = 3351.5351.4

Cryptsetup

Serpent-XTS 256b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 256b DecryptionLinux w DODTdoitm=off110220330440550SE +/- 0.27, N = 3SE +/- 0.09, N = 3527.6527.3

Cryptsetup

Serpent-XTS 256b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupSerpent-XTS 256b EncryptionLinux w DODTdoitm=off120240360480600SE +/- 1.27, N = 3SE +/- 1.35, N = 3559.5559.1

Cryptsetup

AES-XTS 256b Decryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 256b DecryptionLinux w DODTdoitm=off8001600240032004000SE +/- 17.78, N = 3SE +/- 3.34, N = 33891.53886.1

Cryptsetup

AES-XTS 256b Encryption

OpenBenchmarking.orgMiB/s, More Is BetterCryptsetupAES-XTS 256b Encryptiondoitm=offLinux w DODT8001600240032004000SE +/- 7.45, N = 3SE +/- 16.70, N = 33876.23864.3

Cryptsetup

PBKDF2-whirlpool

OpenBenchmarking.orgIterations Per Second, More Is BetterCryptsetupPBKDF2-whirlpoolLinux w DODTdoitm=off120K240K360K480K600KSE +/- 1294.67, N = 3SE +/- 1624.74, N = 3583195582551

Cryptsetup

PBKDF2-sha512

OpenBenchmarking.orgIterations Per Second, More Is BetterCryptsetupPBKDF2-sha512doitm=offLinux w DODT300K600K900K1200K1500KSE +/- 2233.59, N = 3SE +/- 3203.15, N = 313968661392546

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: x86_64 RdRandLinux w DODTdoitm=off140K280K420K560K700KSE +/- 68.80, N = 3SE +/- 67.49, N = 3669198.10669178.001. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Mallocdoitm=offLinux w DODT40M80M120M160M200MSE +/- 454146.57, N = 3SE +/- 655475.74, N = 3201328390.34195951844.811. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: CryptoLinux w DODTdoitm=off20K40K60K80K100KSE +/- 445.46, N = 3SE +/- 991.74, N = 385533.0284975.841. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: MEMFDdoitm=offLinux w DODT8001600240032004000SE +/- 1.55, N = 3SE +/- 2.24, N = 33624.423592.881. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: IO_uringdoitm=offLinux w DODT6K12K18K24K30KSE +/- 1.30, N = 3SE +/- 16.56, N = 326532.3026508.091. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: SENDFILEdoitm=offLinux w DODT200K400K600K800K1000KSE +/- 8323.86, N = 3SE +/- 8091.69, N = 31146358.161128077.911. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.14.06Test: Mutexdoitm=offLinux w DODT9M18M27M36M45MSE +/- 34997.86, N = 3SE +/- 162165.00, N = 341978074.4141364067.751. (CC) gcc options: -O2 -std=gnu99 -lm -fuse-ld=gold -lapparmor -latomic -lc -lcrypt -ldl -ljpeg -lrt -lz -pthread

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastLinux w DODTdoitm=off1122334455SE +/- 0.37, N = 10SE +/- 0.60, N = 347.9547.751. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.18.1Variant: Wownero - Hash Count: 1MLinux w DODTdoitm=off9K18K27K36K45KSE +/- 149.86, N = 3SE +/- 35.05, N = 341450.141317.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: BMW27 - Compute: CPU-Onlydoitm=offLinux w DODT612182430SE +/- 0.04, N = 3SE +/- 0.07, N = 323.3023.44

OpenSSL

OpenBenchmarking.orgverify/s, More Is BetterOpenSSLdoitm=offLinux w DODT300K600K900K1200K1500KSE +/- 1026.50, N = 3SE +/- 1656.25, N = 31188684.81188255.41. OpenSSL 3.0.5 5 Jul 2022 (Library: OpenSSL 3.0.5 5 Jul 2022)

OpenSSL

OpenBenchmarking.orgsign/s, More Is BetterOpenSSLdoitm=offLinux w DODT4K8K12K16K20KSE +/- 20.72, N = 3SE +/- 63.70, N = 317837.917781.61. OpenSSL 3.0.5 5 Jul 2022 (Library: OpenSSL 3.0.5 5 Jul 2022)

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fastdoitm=offLinux w DODT1020304050SE +/- 0.18, N = 3SE +/- 0.45, N = 342.6242.61

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 0.11Encoder Speed: 6doitm=offLinux w DODT0.79181.58362.37543.16723.959SE +/- 0.014, N = 3SE +/- 0.031, N = 153.4993.5191. (CXX) g++ options: -O3 -fPIC -lm

WebP Image Encode

Encode Settings: Quality 100, Highest Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100, Highest Compressiondoitm=offLinux w DODT0.63231.26461.89692.52923.1615SE +/- 0.00, N = 3SE +/- 0.00, N = 32.812.811. (CC) gcc options: -fvisibility=hidden -O2 -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1doitm=offLinux w DODT20406080100SE +/- 0.43, N = 3SE +/- 0.72, N = 394.9494.731. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1doitm=offLinux w DODT5001000150020002500SE +/- 10.72, N = 3SE +/- 17.94, N = 32373.492368.121. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

WebP Image Encode

Encode Settings: Quality 100

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Quality 100doitm=offLinux w DODT246810SE +/- 0.01, N = 3SE +/- 0.00, N = 38.438.421. (CC) gcc options: -fvisibility=hidden -O2 -lm

WebP Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP Image Encode 1.2.4Encode Settings: Defaultdoitm=offLinux w DODT3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 313.0913.091. (CC) gcc options: -fvisibility=hidden -O2 -lm

Phoronix Test Suite v10.8.5