2 x AMD EPYC 7773X 64-Core testing with a AMD DAYTONA_X (RYM1009B BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2305011-NE-ZN838339286 zn - Phoronix Test Suite zn 2 x AMD EPYC 7773X 64-Core testing with a AMD DAYTONA_X (RYM1009B BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2305011-NE-ZN838339286&grs&rdt&rro .
zn Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Desktop Display Server Vulkan Compiler File-System Screen Resolution a b c 2 x AMD EPYC 7773X 64-Core @ 2.20GHz (128 Cores / 256 Threads) AMD DAYTONA_X (RYM1009B BIOS) AMD Starship/Matisse 512GB 3841GB Micron_9300_MTFDHAL3T8TDP ASPEED VE228 2 x Mellanox MT27710 Ubuntu 22.04 5.15.0-47-generic (x86_64) GNOME Shell 42.4 X Server 1.21.1.3 1.2.204 GCC 11.2.0 ext4 1920x1080 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-gBFGDP/gcc-11-11.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001229 Python Details - Python 3.10.4 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling + srbds: Not affected + tsx_async_abort: Not affected
zn build-linux-kernel: allmodconfig clickhouse: 100M Rows Hits Dataset, Second Run clickhouse: 100M Rows Hits Dataset, Third Run clickhouse: 100M Rows Hits Dataset, First Run / Cold Cache rocksdb: Read While Writing petsc: Streams build-linux-kernel: defconfig cockroach: KV, 95% Reads - 512 svt-av1: Preset 12 - Bosphorus 4K cockroach: KV, 50% Reads - 512 cockroach: KV, 60% Reads - 512 cockroach: KV, 95% Reads - 256 embree: Pathtracer ISPC - Asian Dragon build-llvm: Ninja cockroach: KV, 50% Reads - 256 svt-av1: Preset 12 - Bosphorus 1080p embree: Pathtracer - Asian Dragon cockroach: KV, 50% Reads - 128 build-nodejs: Time To Compile cockroach: KV, 60% Reads - 256 build-ffmpeg: Time To Compile john-the-ripper: HMAC-SHA512 cockroach: KV, 10% Reads - 512 openvkl: vklBenchmark Scalar openvkl: vklBenchmark ISPC build-llvm: Unix Makefiles svt-av1: Preset 13 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 4K gromacs: MPI CPU - water_GMX50_bare specfem3d: Layered Halfspace cockroach: KV, 10% Reads - 256 uvg266: Bosphorus 1080p - Very Fast build2: Time To Compile john-the-ripper: Blowfish svt-av1: Preset 8 - Bosphorus 1080p rocksdb: Update Rand uvg266: Bosphorus 4K - Very Fast vvenc: Bosphorus 4K - Faster deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream build-godot: Time To Compile apache: 500 deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream vvenc: Bosphorus 1080p - Faster cockroach: KV, 60% Reads - 128 svt-av1: Preset 8 - Bosphorus 4K specfem3d: Homogeneous Halfspace uvg266: Bosphorus 1080p - Ultra Fast rocksdb: Read Rand Write Rand specfem3d: Water-layered Halfspace specfem3d: Mount St. Helens deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream uvg266: Bosphorus 4K - Ultra Fast uvg266: Bosphorus 4K - Super Fast embree: Pathtracer ISPC - Crown tensorflow: CPU - 256 - ResNet-50 deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream tensorflow: CPU - 32 - ResNet-50 tensorflow: CPU - 512 - ResNet-50 blender: BMW27 - CPU-Only tensorflow: CPU - 16 - ResNet-50 john-the-ripper: bcrypt cockroach: KV, 95% Reads - 128 cockroach: MoVR - 128 deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream cockroach: KV, 10% Reads - 128 vvenc: Bosphorus 1080p - Fast svt-av1: Preset 4 - Bosphorus 4K deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream blender: Pabellon Barcelona - CPU-Only brl-cad: VGR Performance Metric tensorflow: CPU - 64 - ResNet-50 vvenc: Bosphorus 4K - Fast nginx: 500 blender: Fishy Cat - CPU-Only embree: Pathtracer - Crown uvg266: Bosphorus 1080p - Slow john-the-ripper: WPA PSK cockroach: MoVR - 512 svt-av1: Preset 4 - Bosphorus 1080p specfem3d: Tomographic Model uvg266: Bosphorus 4K - Medium blender: Barbershop - CPU-Only deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream encode-opus: WAV To Opus Encode uvg266: Bosphorus 1080p - Super Fast deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream blender: Classroom - CPU-Only deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream john-the-ripper: MD5 cockroach: MoVR - 256 rocksdb: Rand Read deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream uvg266: Bosphorus 4K - Slow deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream draco: Church Facade deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream openssl: SHA512 quantlib: draco: Lion deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream openssl: RSA4096 openssl: ChaCha20-Poly1305 uvg266: Bosphorus 1080p - Medium deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream openssl: ChaCha20 openssl: AES-128-GCM deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream openssl: AES-256-GCM openssl: SHA256 deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream openssl: RSA4096 deeprec: BST - BF16 a b c 285.347 273.45 274.77 269.19 13440214 180447.2727 31.057 72445 146.385 68395.4 60903.7 88008.4 69.2993 132.966 58777.4 484.429 72.6012 65133.4 132.531 72158.1 15.7 91862000 50885.4 337 489 228.853 500.494 187.16 10.335 17.286012141 50683.8 158.96 67.557 158999 103.432 294796 46.42 8.875 110.5796 9.0399 102.825 132220.73 42.229 23.6606 23.518 70322.4 66.311 10.329585274 172.09 1926550 17.327457161 6.74456464 58.3893 17.1168 47.56 45.43 115.1609 15.04 20.5096 48.7459 13.24 16.59 14.88 12.54 165909 88685.5 754.5 20.8125 48.0358 49533.1 14.659 4.699 152.2579 6.5656 45.39 3089503 13.76 5.509 157063.78 18.53 128.024 60.62 391304 745.5 10.075 8.348192148 27.17 136.18 34.5599 28.9126 148.8634 6.7151 31.86 166.1 609.6225 111.844 37.2 8.9373 10348000 748.2 454636874 829.9415 76.9866 307.2889 207.5543 24.73 73.1711 5872 868.7766 155.8199 104.8392 48236952220 2765.5 4954 310.2272 27007.5 285698755410 67.11 108.3637 409.6817 586.7169 434799000510 464927934750 870.121 205.6428 424974892240 152584380080 68.6185 73.2014 931.458 1780535.1 160.583 413.04 404.69 401.11 11473082 251700.4996 22.631 90237.5 174.033 56432.6 62154.2 74468.4 82.5412 113.357 68400 521.271 83.2187 66115.6 115.742 63269 13.657 80447000 52529.5 381 539 210.169 541.906 173.18 11.098 16.071385364 47146.4 162.07 63.331 169154 109.923 277428 44.67 9.131 112.3699 8.8949 98.419 136743.33 42.2754 23.6345 24.049 72193.2 68.75 10.107559726 168.21 1867319 17.72543332 6.630654167 58.0406 17.2177 46.27 45.07 117.8975 15.12 20.8324 47.992 13.37 16.67 14.86 12.48 168729 88959.8 757.2 20.7576 48.1644 49454.9 14.74 4.765 152.0922 6.5727 46.05 13.74 5.57 158866.84 18.74 128.0153 60.72 394864 750.7 10.154 8.303506049 27.33 136.92 34.7463 28.7579 148.3552 6.738 31.899 165.32 609.857 111.9477 37.33 8.9292 10330000 750.5 452696371 828.026 77.1093 308.4776 206.8781 24.79 72.9076 5856 868.3274 155.8168 104.7265 48315690210 2758.8 4942 309.49 27049.8 285959794140 67.02 108.2336 409.3953 587.6973 435044716540 464448030860 869.7454 205.9021 425089252010 152693644050 68.5508 73.2313 931.5601 1779979.3 160.786 403.80 410.26 398.91 16535579 250852.5482 22.582 86788.8 180.025 68164.4 73656.2 73252.3 79.6439 112.52 57909.1 571.56 85.2372 57115.1 114.588 73004.2 13.71 83472000 46271.6 363 521 211.16 527.027 180.541 11.133 16.288745552 50241 170.1 63.672 169113 105.24 292628 43.75 9.358 107.3193 9.3134 98.299 138201.89 40.4664 24.6893 23.082 69343.2 68.693 9.966862195 173.89 1884492 17.860339123 6.834107424 56.6843 17.6312 46.24 44.29 117.6753 14.77 20.409 48.9857 13.1 16.34 14.62 12.33 167500 87476.4 745.2 20.4849 48.8033 48767.1 14.878 4.769 150.0467 6.6621 45.67 3047016 13.59 5.577 158520.97 18.72 129.4073 60.15 394449 744 10.16 8.278936477 27.26 136.8 34.5793 28.8952 148.1303 6.748 32.014 165.97 607.0094 111.4342 37.37 8.97 10376000 751.5 454644374 826.5131 77.3016 307.5814 207.6329 24.7 72.9975 5876 871.1536 155.3409 104.9844 48197587440 2760.6 4951 310.1225 26996.1 286255847010 67.15 108.4369 410.158 587.2248 434402920310 464259772140 868.9482 205.7726 424554074930 152508733130 68.5785 73.1792 931.1154 1780224.1 OpenBenchmarking.org
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: allmodconfig c b a 60 120 180 240 300 160.79 160.58 285.35
ClickHouse 100M Rows Hits Dataset, Second Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run c b a 90 180 270 360 450 403.80 413.04 273.45 MIN: 55.5 / MAX: 4285.71 MIN: 56.82 / MAX: 4000 MIN: 26.7 / MAX: 2727.27
ClickHouse 100M Rows Hits Dataset, Third Run OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run c b a 90 180 270 360 450 410.26 404.69 274.77 MIN: 58.42 / MAX: 3333.33 MIN: 58.2 / MAX: 3157.89 MIN: 24.89 / MAX: 2400
ClickHouse 100M Rows Hits Dataset, First Run / Cold Cache OpenBenchmarking.org Queries Per Minute, Geo Mean, More Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache c b a 90 180 270 360 450 398.91 401.11 269.19 MIN: 52.63 / MAX: 4000 MIN: 51.37 / MAX: 2857.14 MIN: 22.82 / MAX: 2500
RocksDB Test: Read While Writing OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Read While Writing c b a 4M 8M 12M 16M 20M 16535579 11473082 13440214 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
PETSc Test: Streams OpenBenchmarking.org MB/s, More Is Better PETSc 3.19 Test: Streams c b a 50K 100K 150K 200K 250K 250852.55 251700.50 180447.27 1. (CC) gcc options: -fPIC -O3 -O2 -lpthread -ludev -lpciaccess -lm
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig c b a 7 14 21 28 35 22.58 22.63 31.06
CockroachDB Workload: KV, 95% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 512 c b a 20K 40K 60K 80K 100K 86788.8 90237.5 72445.0
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.5 Encoder Mode: Preset 12 - Input: Bosphorus 4K c b a 40 80 120 160 200 180.03 174.03 146.39 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
CockroachDB Workload: KV, 50% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 512 c b a 15K 30K 45K 60K 75K 68164.4 56432.6 68395.4
CockroachDB Workload: KV, 60% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 512 c b a 16K 32K 48K 64K 80K 73656.2 62154.2 60903.7
CockroachDB Workload: KV, 95% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 256 c b a 20K 40K 60K 80K 100K 73252.3 74468.4 88008.4
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0.1 Binary: Pathtracer ISPC - Model: Asian Dragon c b a 20 40 60 80 100 79.64 82.54 69.30 MIN: 78.41 / MAX: 84.92 MIN: 81 / MAX: 88.8 MIN: 68.15 / MAX: 71.76
Timed LLVM Compilation Build System: Ninja OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Ninja c b a 30 60 90 120 150 112.52 113.36 132.97
CockroachDB Workload: KV, 50% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 256 c b a 15K 30K 45K 60K 75K 57909.1 68400.0 58777.4
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.5 Encoder Mode: Preset 12 - Input: Bosphorus 1080p c b a 120 240 360 480 600 571.56 521.27 484.43 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Embree Binary: Pathtracer - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0.1 Binary: Pathtracer - Model: Asian Dragon c b a 20 40 60 80 100 85.24 83.22 72.60 MIN: 83.77 / MAX: 89.05 MIN: 82 / MAX: 86.09 MIN: 71.79 / MAX: 74.52
CockroachDB Workload: KV, 50% Reads - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 50% Reads - Concurrency: 128 c b a 14K 28K 42K 56K 70K 57115.1 66115.6 65133.4
Timed Node.js Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Node.js Compilation 19.8.1 Time To Compile c b a 30 60 90 120 150 114.59 115.74 132.53
CockroachDB Workload: KV, 60% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 256 c b a 16K 32K 48K 64K 80K 73004.2 63269.0 72158.1
Timed FFmpeg Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed FFmpeg Compilation 6.0 Time To Compile c b a 4 8 12 16 20 13.71 13.66 15.70
John The Ripper Test: HMAC-SHA512 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: HMAC-SHA512 c b a 20M 40M 60M 80M 100M 83472000 80447000 91862000 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
CockroachDB Workload: KV, 10% Reads - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 512 c b a 11K 22K 33K 44K 55K 46271.6 52529.5 50885.4
OpenVKL Benchmark: vklBenchmark Scalar OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark Scalar c b a 80 160 240 320 400 363 381 337 MIN: 75 / MAX: 1547 MIN: 74 / MAX: 1709 MIN: 75 / MAX: 1114
OpenVKL Benchmark: vklBenchmark ISPC OpenBenchmarking.org Items / Sec, More Is Better OpenVKL 1.3.1 Benchmark: vklBenchmark ISPC c b a 120 240 360 480 600 521 539 489 MIN: 154 / MAX: 1465 MIN: 152 / MAX: 1486 MIN: 149 / MAX: 1380
Timed LLVM Compilation Build System: Unix Makefiles OpenBenchmarking.org Seconds, Fewer Is Better Timed LLVM Compilation 16.0 Build System: Unix Makefiles c b a 50 100 150 200 250 211.16 210.17 228.85
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.5 Encoder Mode: Preset 13 - Input: Bosphorus 1080p c b a 120 240 360 480 600 527.03 541.91 500.49 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.5 Encoder Mode: Preset 13 - Input: Bosphorus 4K c b a 40 80 120 160 200 180.54 173.18 187.16 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2023 Implementation: MPI CPU - Input: water_GMX50_bare c b a 3 6 9 12 15 11.13 11.10 10.34 1. (CXX) g++ options: -O3
SPECFEM3D Model: Layered Halfspace OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Layered Halfspace c b a 4 8 12 16 20 16.29 16.07 17.29 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
CockroachDB Workload: KV, 10% Reads - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 256 c b a 11K 22K 33K 44K 55K 50241.0 47146.4 50683.8
uvg266 Video Input: Bosphorus 1080p - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast c b a 40 80 120 160 200 170.10 162.07 158.96
Build2 Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Build2 0.15 Time To Compile c b a 15 30 45 60 75 63.67 63.33 67.56
John The Ripper Test: Blowfish OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: Blowfish c b a 40K 80K 120K 160K 200K 169113 169154 158999 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.5 Encoder Mode: Preset 8 - Input: Bosphorus 1080p c b a 20 40 60 80 100 105.24 109.92 103.43 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
RocksDB Test: Update Random OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Update Random c b a 60K 120K 180K 240K 300K 292628 277428 294796 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
uvg266 Video Input: Bosphorus 4K - Video Preset: Very Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Very Fast c b a 11 22 33 44 55 43.75 44.67 46.42
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.8 Video Input: Bosphorus 4K - Video Preset: Faster c b a 3 6 9 12 15 9.358 9.131 8.875 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream c b a 30 60 90 120 150 107.32 112.37 110.58
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream c b a 3 6 9 12 15 9.3134 8.8949 9.0399
Timed Godot Game Engine Compilation Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Timed Godot Game Engine Compilation 4.0 Time To Compile c b a 20 40 60 80 100 98.30 98.42 102.83
Apache HTTP Server Concurrent Requests: 500 OpenBenchmarking.org Requests Per Second, More Is Better Apache HTTP Server 2.4.56 Concurrent Requests: 500 c b a 30K 60K 90K 120K 150K 138201.89 136743.33 132220.73 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream c b a 10 20 30 40 50 40.47 42.28 42.23
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream c b a 6 12 18 24 30 24.69 23.63 23.66
VVenC Video Input: Bosphorus 1080p - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.8 Video Input: Bosphorus 1080p - Video Preset: Faster c b a 6 12 18 24 30 23.08 24.05 23.52 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
CockroachDB Workload: KV, 60% Reads - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 60% Reads - Concurrency: 128 c b a 15K 30K 45K 60K 75K 69343.2 72193.2 70322.4
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.5 Encoder Mode: Preset 8 - Input: Bosphorus 4K c b a 15 30 45 60 75 68.69 68.75 66.31 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SPECFEM3D Model: Homogeneous Halfspace OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Homogeneous Halfspace c b a 3 6 9 12 15 9.966862195 10.107559726 10.329585274 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
uvg266 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast c b a 40 80 120 160 200 173.89 168.21 172.09
RocksDB Test: Read Random Write Random OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Read Random Write Random c b a 400K 800K 1200K 1600K 2000K 1884492 1867319 1926550 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
SPECFEM3D Model: Water-layered Halfspace OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Water-layered Halfspace c b a 4 8 12 16 20 17.86 17.73 17.33 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
SPECFEM3D Model: Mount St. Helens OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Mount St. Helens c b a 2 4 6 8 10 6.834107424 6.630654167 6.744564640 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream c b a 13 26 39 52 65 56.68 58.04 58.39
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream c b a 4 8 12 16 20 17.63 17.22 17.12
uvg266 Video Input: Bosphorus 4K - Video Preset: Ultra Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast c b a 11 22 33 44 55 46.24 46.27 47.56
uvg266 Video Input: Bosphorus 4K - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Super Fast c b a 10 20 30 40 50 44.29 45.07 45.43
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0.1 Binary: Pathtracer ISPC - Model: Crown c b a 30 60 90 120 150 117.68 117.90 115.16 MIN: 115.46 / MAX: 126.84 MIN: 115.62 / MAX: 128.85 MIN: 112.93 / MAX: 121.91
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: ResNet-50 c b a 4 8 12 16 20 14.77 15.12 15.04
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream c b a 5 10 15 20 25 20.41 20.83 20.51
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream c b a 11 22 33 44 55 48.99 47.99 48.75
TensorFlow Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: ResNet-50 c b a 3 6 9 12 15 13.10 13.37 13.24
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 c b a 4 8 12 16 20 16.34 16.67 16.59
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.5 Blend File: BMW27 - Compute: CPU-Only c b a 4 8 12 16 20 14.62 14.86 14.88
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: ResNet-50 c b a 3 6 9 12 15 12.33 12.48 12.54
John The Ripper Test: bcrypt OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: bcrypt c b a 40K 80K 120K 160K 200K 167500 168729 165909 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
CockroachDB Workload: KV, 95% Reads - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 95% Reads - Concurrency: 128 c b a 20K 40K 60K 80K 100K 87476.4 88959.8 88685.5
CockroachDB Workload: MoVR - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 128 c b a 160 320 480 640 800 745.2 757.2 754.5
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream c b a 5 10 15 20 25 20.48 20.76 20.81
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream c b a 11 22 33 44 55 48.80 48.16 48.04
CockroachDB Workload: KV, 10% Reads - Concurrency: 128 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: KV, 10% Reads - Concurrency: 128 c b a 11K 22K 33K 44K 55K 48767.1 49454.9 49533.1
VVenC Video Input: Bosphorus 1080p - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.8 Video Input: Bosphorus 1080p - Video Preset: Fast c b a 4 8 12 16 20 14.88 14.74 14.66 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.5 Encoder Mode: Preset 4 - Input: Bosphorus 4K c b a 1.073 2.146 3.219 4.292 5.365 4.769 4.765 4.699 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream c b a 30 60 90 120 150 150.05 152.09 152.26
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream c b a 2 4 6 8 10 6.6621 6.5727 6.5656
Blender Blend File: Pabellon Barcelona - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.5 Blend File: Pabellon Barcelona - Compute: CPU-Only c b a 10 20 30 40 50 45.67 46.05 45.39
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.34 VGR Performance Metric c a 700K 1400K 2100K 2800K 3500K 3047016 3089503 1. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: ResNet-50 c b a 4 8 12 16 20 13.59 13.74 13.76
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.8 Video Input: Bosphorus 4K - Video Preset: Fast c b a 1.2548 2.5096 3.7644 5.0192 6.274 5.577 5.570 5.509 1. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects
nginx Connections: 500 OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 500 c b a 30K 60K 90K 120K 150K 158520.97 158866.84 157063.78 1. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2
Blender Blend File: Fishy Cat - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.5 Blend File: Fishy Cat - Compute: CPU-Only c b a 5 10 15 20 25 18.72 18.74 18.53
Embree Binary: Pathtracer - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.0.1 Binary: Pathtracer - Model: Crown c b a 30 60 90 120 150 129.41 128.02 128.02 MIN: 126.76 / MAX: 140.02 MIN: 125.53 / MAX: 138.71 MIN: 125.77 / MAX: 135.37
uvg266 Video Input: Bosphorus 1080p - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow c b a 14 28 42 56 70 60.15 60.72 60.62
John The Ripper Test: WPA PSK OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: WPA PSK c b a 80K 160K 240K 320K 400K 394449 394864 391304 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
CockroachDB Workload: MoVR - Concurrency: 512 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 512 c b a 160 320 480 640 800 744.0 750.7 745.5
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.5 Encoder Mode: Preset 4 - Input: Bosphorus 1080p c b a 3 6 9 12 15 10.16 10.15 10.08 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SPECFEM3D Model: Tomographic Model OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Tomographic Model c b a 2 4 6 8 10 8.278936477 8.303506049 8.348192148 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz
uvg266 Video Input: Bosphorus 4K - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Medium c b a 6 12 18 24 30 27.26 27.33 27.17
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.5 Blend File: Barbershop - Compute: CPU-Only c b a 30 60 90 120 150 136.80 136.92 136.18
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream c b a 8 16 24 32 40 34.58 34.75 34.56
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream c b a 7 14 21 28 35 28.90 28.76 28.91
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream c b a 30 60 90 120 150 148.13 148.36 148.86
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream c b a 2 4 6 8 10 6.7480 6.7380 6.7151
Opus Codec Encoding WAV To Opus Encode OpenBenchmarking.org Seconds, Fewer Is Better Opus Codec Encoding 1.4 WAV To Opus Encode c b a 7 14 21 28 35 32.01 31.90 31.86 1. (CXX) g++ options: -O3 -fvisibility=hidden -logg -lm
uvg266 Video Input: Bosphorus 1080p - Video Preset: Super Fast OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Super Fast c b a 40 80 120 160 200 165.97 165.32 166.10
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream c b a 130 260 390 520 650 607.01 609.86 609.62
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream c b a 30 60 90 120 150 111.43 111.95 111.84
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.5 Blend File: Classroom - Compute: CPU-Only c b a 9 18 27 36 45 37.37 37.33 37.20
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream c b a 3 6 9 12 15 8.9700 8.9292 8.9373
John The Ripper Test: MD5 OpenBenchmarking.org Real C/S, More Is Better John The Ripper 2023.03.14 Test: MD5 c b a 2M 4M 6M 8M 10M 10376000 10330000 10348000 1. (CC) gcc options: -m64 -lssl -lcrypto -fopenmp -lgmp -lm -lrt -lz -ldl -lcrypt -lbz2
CockroachDB Workload: MoVR - Concurrency: 256 OpenBenchmarking.org ops/s, More Is Better CockroachDB 22.2 Workload: MoVR - Concurrency: 256 c b a 160 320 480 640 800 751.5 750.5 748.2
RocksDB Test: Random Read OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Random Read c b a 100M 200M 300M 400M 500M 454644374 452696371 454636874 1. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream c b a 200 400 600 800 1000 826.51 828.03 829.94
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream c b a 20 40 60 80 100 77.30 77.11 76.99
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream c b a 70 140 210 280 350 307.58 308.48 307.29
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream c b a 50 100 150 200 250 207.63 206.88 207.55
uvg266 Video Input: Bosphorus 4K - Video Preset: Slow OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow c b a 6 12 18 24 30 24.70 24.79 24.73
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream c b a 16 32 48 64 80 73.00 72.91 73.17
Google Draco Model: Church Facade OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Church Facade c b a 1300 2600 3900 5200 6500 5876 5856 5872 1. (CXX) g++ options: -O3
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream c b a 200 400 600 800 1000 871.15 868.33 868.78
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream c b a 30 60 90 120 150 155.34 155.82 155.82
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream c b a 20 40 60 80 100 104.98 104.73 104.84
OpenSSL Algorithm: SHA512 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: SHA512 c b a 10000M 20000M 30000M 40000M 50000M 48197587440 48315690210 48236952220 1. (CC) gcc options: -pthread -m64 -O3 -ldl
QuantLib OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.30 c b a 600 1200 1800 2400 3000 2760.6 2758.8 2765.5 1. (CXX) g++ options: -O3 -march=native -fPIE -pie
Google Draco Model: Lion OpenBenchmarking.org ms, Fewer Is Better Google Draco 1.5.6 Model: Lion c b a 1100 2200 3300 4400 5500 4951 4942 4954 1. (CXX) g++ options: -O3
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream c b a 70 140 210 280 350 310.12 309.49 310.23
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.1 Algorithm: RSA4096 c b a 6K 12K 18K 24K 30K 26996.1 27049.8 27007.5 1. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenSSL Algorithm: ChaCha20-Poly1305 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: ChaCha20-Poly1305 c b a 60000M 120000M 180000M 240000M 300000M 286255847010 285959794140 285698755410 1. (CC) gcc options: -pthread -m64 -O3 -ldl
uvg266 Video Input: Bosphorus 1080p - Video Preset: Medium OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Medium c b a 15 30 45 60 75 67.15 67.02 67.11
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream c b a 20 40 60 80 100 108.44 108.23 108.36
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream c b a 90 180 270 360 450 410.16 409.40 409.68
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream c b a 130 260 390 520 650 587.22 587.70 586.72
OpenSSL Algorithm: ChaCha20 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: ChaCha20 c b a 90000M 180000M 270000M 360000M 450000M 434402920310 435044716540 434799000510 1. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenSSL Algorithm: AES-128-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: AES-128-GCM c b a 100000M 200000M 300000M 400000M 500000M 464259772140 464448030860 464927934750 1. (CC) gcc options: -pthread -m64 -O3 -ldl
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream c b a 200 400 600 800 1000 868.95 869.75 870.12
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream c b a 50 100 150 200 250 205.77 205.90 205.64
OpenSSL Algorithm: AES-256-GCM OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: AES-256-GCM c b a 90000M 180000M 270000M 360000M 450000M 424554074930 425089252010 424974892240 1. (CC) gcc options: -pthread -m64 -O3 -ldl
OpenSSL Algorithm: SHA256 OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: SHA256 c b a 30000M 60000M 90000M 120000M 150000M 152508733130 152693644050 152584380080 1. (CC) gcc options: -pthread -m64 -O3 -ldl
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream c b a 15 30 45 60 75 68.58 68.55 68.62
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream c b a 16 32 48 64 80 73.18 73.23 73.20
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream c b a 200 400 600 800 1000 931.12 931.56 931.46
OpenSSL Algorithm: RSA4096 OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.1 Algorithm: RSA4096 c b a 400K 800K 1200K 1600K 2000K 1780224.1 1779979.3 1780535.1 1. (CC) gcc options: -pthread -m64 -O3 -ldl
Phoronix Test Suite v10.8.4