benchmarks for a future article.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2310231-NE-EXTRATEST13 extra tests - Phoronix Test Suite extra tests benchmarks for a future article.
HTML result view exported from: https://openbenchmarking.org/result/2310231-NE-EXTRATEST13&export=txt&gru&sor .
extra tests Processor Motherboard Memory Disk Graphics Monitor OS Kernel Compiler File-System Screen Resolution RESET RESET2 RESET3 AMD EPYC 9124 16-Core @ 3.00GHz (16 Cores / 32 Threads) Supermicro H13SSW (1.1 BIOS) 12 x 64 GB DDR5-4800MT/s HMCG94MEBRA123N 2 x 1920GB SAMSUNG MZQL21T9HCJR-00A07 astdrmfb AlmaLinux 9.2 5.14.0-284.25.1.el9_2.x86_64 (x86_64) GCC 11.3.1 20221121 ext4 1024x768 AMD EPYC 9334 32-Core @ 2.70GHz (32 Cores / 64 Threads) DELL E207WFP 1680x1050 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: always Compiler Details - --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111 Java Details - OpenJDK Runtime Environment (Red_Hat-11.0.20.0.8-1) (build 11.0.20+8-LTS) Python Details - Python 3.9.16 Security Details - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected
extra tests stress-ng: Hash stress-ng: MMAP stress-ng: NUMA stress-ng: Pipe stress-ng: Poll stress-ng: Zlib stress-ng: Futex stress-ng: MEMFD stress-ng: Mutex stress-ng: Atomic stress-ng: Crypto stress-ng: Malloc stress-ng: Cloning stress-ng: Forking stress-ng: AVL Tree stress-ng: SENDFILE stress-ng: CPU Cache stress-ng: CPU Stress stress-ng: Semaphores stress-ng: Matrix Math stress-ng: Vector Math stress-ng: AVX-512 VNNI stress-ng: Function Call stress-ng: x86_64 RdRand stress-ng: Floating Point stress-ng: Matrix 3D Math stress-ng: Memory Copying stress-ng: Vector Shuffle stress-ng: Mixed Scheduler stress-ng: Socket Activity stress-ng: Wide Vector Math stress-ng: Context Switching stress-ng: Fused Multiply-Add stress-ng: Vector Floating Point stress-ng: Glibc C String Functions stress-ng: Glibc Qsort Data Sorting stress-ng: System V Message Passing stress-ng: Pthread nekrs: Kershaw nekrs: TurboPipe Periodic embree: Pathtracer - Crown embree: Pathtracer ISPC - Crown embree: Pathtracer - Asian Dragon embree: Pathtracer - Asian Dragon Obj embree: Pathtracer ISPC - Asian Dragon embree: Pathtracer ISPC - Asian Dragon Obj svt-av1: Preset 4 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 4 - Bosphorus 1080p svt-av1: Preset 8 - Bosphorus 1080p svt-av1: Preset 12 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 1080p vvenc: Bosphorus 4K - Fast vvenc: Bosphorus 4K - Faster vvenc: Bosphorus 1080p - Fast vvenc: Bosphorus 1080p - Faster svt-av1: Preset 13 - Bosphorus 1080p svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 12 - Bosphorus 1080p svt-av1: Preset 12 - Bosphorus 4K svt-av1: Preset 8 - Bosphorus 1080p svt-av1: Preset 8 - Bosphorus 4K svt-av1: Preset 4 - Bosphorus 1080p svt-av1: Preset 4 - Bosphorus 4K oidn: RT.hdr_alb_nrm.3840x2160 - CPU-Only oidn: RT.ldr_alb_nrm.3840x2160 - CPU-Only oidn: RTLightmap.hdr.4096x4096 - CPU-Only ospray: particle_volume/ao/real_time ospray: particle_volume/scivis/real_time ospray: particle_volume/pathtracer/real_time ospray: gravity_spheres_volume/dim_512/ao/real_time ospray: gravity_spheres_volume/dim_512/scivis/real_time ospray: gravity_spheres_volume/dim_512/pathtracer/real_time deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream cassandra: Writes hadoop: Create - 20 - 100000 hadoop: Create - 20 - 1000000 hadoop: Create - 50 - 100000 hadoop: Create - 50 - 1000000 hadoop: Create - 100 - 100000 hadoop: Create - 100 - 1000000 hadoop: Create - 500 - 100000 hadoop: Create - 500 - 1000000 hadoop: Open - 20 - 100000 hadoop: Open - 20 - 1000000 hadoop: Open - 50 - 100000 hadoop: Open - 50 - 1000000 hadoop: Open - 100 - 100000 hadoop: Open - 100 - 1000000 hadoop: Open - 500 - 100000 hadoop: Open - 500 - 1000000 hadoop: Delete - 20 - 100000 hadoop: Delete - 20 - 1000000 hadoop: Delete - 50 - 100000 hadoop: Delete - 50 - 1000000 hadoop: Delete - 100 - 100000 hadoop: Delete - 100 - 1000000 hadoop: Delete - 500 - 100000 hadoop: Delete - 500 - 1000000 hadoop: File Status - 20 - 100000 hadoop: File Status - 20 - 1000000 hadoop: File Status - 50 - 100000 hadoop: File Status - 50 - 1000000 hadoop: File Status - 100 - 100000 hadoop: File Status - 100 - 1000000 hadoop: File Status - 500 - 100000 hadoop: File Status - 500 - 1000000 hadoop: Rename - 20 - 100000 hadoop: Rename - 20 - 1000000 hadoop: Rename - 50 - 100000 hadoop: Rename - 50 - 1000000 hadoop: Rename - 100 - 100000 hadoop: Rename - 100 - 1000000 hadoop: Rename - 500 - 100000 hadoop: Rename - 500 - 1000000 dragonflydb: 10 - 1:10 dragonflydb: 20 - 1:10 dragonflydb: 50 - 1:10 dragonflydb: 10 - 1:100 dragonflydb: 20 - 1:100 dragonflydb: 50 - 1:100 dragonflydb: 60 - 1:10 dragonflydb: 60 - 1:100 tidb: oltp_read_write - 1 tidb: oltp_read_write - 16 tidb: oltp_read_write - 32 tidb: oltp_read_write - 64 tidb: oltp_read_write - 128 tidb: oltp_read_write - 256 tidb: oltp_point_select - 1 tidb: oltp_point_select - 16 tidb: oltp_point_select - 32 tidb: oltp_point_select - 64 tidb: oltp_point_select - 128 tidb: oltp_point_select - 256 tidb: oltp_update_non_index - 1 tidb: oltp_update_non_index - 16 tidb: oltp_update_non_index - 32 tidb: oltp_update_non_index - 64 tidb: oltp_update_non_index - 128 liquid-dsp: 1 - 256 - 32 liquid-dsp: 1 - 256 - 57 liquid-dsp: 2 - 256 - 32 liquid-dsp: 2 - 256 - 57 liquid-dsp: 4 - 256 - 32 liquid-dsp: 4 - 256 - 57 liquid-dsp: 8 - 256 - 32 liquid-dsp: 8 - 256 - 57 liquid-dsp: 1 - 256 - 512 liquid-dsp: 16 - 256 - 32 liquid-dsp: 16 - 256 - 57 liquid-dsp: 2 - 256 - 512 liquid-dsp: 32 - 256 - 32 liquid-dsp: 32 - 256 - 57 liquid-dsp: 4 - 256 - 512 liquid-dsp: 64 - 256 - 32 liquid-dsp: 64 - 256 - 57 liquid-dsp: 8 - 256 - 512 liquid-dsp: 16 - 256 - 512 liquid-dsp: 32 - 256 - 512 liquid-dsp: 64 - 256 - 512 kripke: brl-cad: VGR Performance Metric ncnn: CPU - mobilenet ncnn: CPU-v2-v2 - mobilenet-v2 ncnn: CPU-v3-v3 - mobilenet-v3 ncnn: CPU - shufflenet-v2 ncnn: CPU - mnasnet ncnn: CPU - efficientnet-b0 ncnn: CPU - blazeface ncnn: CPU - googlenet ncnn: CPU - vgg16 ncnn: CPU - resnet18 ncnn: CPU - alexnet ncnn: CPU - resnet50 ncnn: CPU - yolov4-tiny ncnn: CPU - squeezenet_ssd ncnn: CPU - regnety_400m ncnn: CPU - vision_transformer ncnn: CPU - FastestDet deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Stream deepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Stream deepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Stream deepsparse: ResNet-50, Baseline - Asynchronous Multi-Stream deepsparse: ResNet-50, Baseline - Synchronous Single-Stream deepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Stream deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream deepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream deepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream deepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream deepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream deepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Stream remhos: Sample Remap Example specfem3d: Mount St. Helens specfem3d: Layered Halfspace specfem3d: Tomographic Model specfem3d: Homogeneous Halfspace specfem3d: Water-layered Halfspace build-linux-kernel: defconfig blender: BMW27 - CPU-Only blender: Classroom - CPU-Only blender: Fishy Cat - CPU-Only blender: Barbershop - CPU-Only blender: Pabellon Barcelona - CPU-Only RESET RESET2 RESET3 3622490.53 297.29 664.87 13860878.09 2214330.78 1466.4 4273978.26 431.59 789472.5 246.62 39959.41 31210490.91 3317.1 32071.19 205.07 419265.75 1163806.08 41635.43 42481788.68 87537.46 117532.19 1851108.77 13421.19 6022050.43 5845.74 5817.58 7269.2 12554.84 39604.33 10472.15 772551.49 10072239.66 16158855.4 53844.48 19957308.6 463.11 7982733.22 119839.68 10295200000 7950340000 21.5762 22.68 24.8143 22.2481 28.2868 23.8331 4.502 59.64 165.65 165.948 14.211 128.583 466.982 600.202 6.126 12.13 18.012 34.698 590.49 161.603 528.292 162.288 119.222 67.596 10.727 4.152 0.72 0.72 0.34 5.5677 5.56275 151.866 5.61038 5.46527 6.60071 13.137 14.6975 505.2797 202.745 257.567 141.086 70.9221 48.7468 163.1825 143.2619 1591.1704 916.5817 71.844 69.2739 16.1569 17.7631 163.0849 143.6947 72.7336 69.6312 109.0813 101.9101 24.4932 25.9193 240.3763 93.1249 55.5354 54.808 13.1024 14.6865 194642 59630 72317 60314 71403 59242 69638 52383 66037 636943 1191895 537634 264831 305810 1256281 205761 1164144 107875 116333 108696 110963 99701 112587 93721 109673 869565 1879699 476190 593120 531915 1828154 215517 1779359 87032 89095 83333 87912 85616 85800 78555 76722 8302009.42 10162330.86 12469755.6 8637294.18 9932666.12 11746361.87 12065388.34 11419293.83 3204 36124 46972 59739 62965 5956 97200 118850 131165 143244 1687 18663 26459 34234 41635 35186000 52897000 68854000 105200000 138520000 190540000 277560000 337660000 12685000 545570000 695920000 25206000 1047500000 1031700000 48886000 1056400000 1100900000 97011000 196300000 273720000 282490000 237641100 295626 16.73 7.36 7.55 8.67 7.47 9.35 3.35 17.98 22.59 9.13 6.01 16.83 25.42 15.52 17.13 55.73 11.3 607.0287 68.0326 15.8073 4.9273 31.0244 7.0815 112.6037 20.5061 48.9952 6.973 5.0159 1.0875 111.1048 14.4253 493.6079 56.29 48.9994 6.952 109.8869 14.355 73.2047 9.8064 325.022 38.5655 33.2488 10.7278 143.8424 18.2395 608.1609 68.0846 31.017 27.1059135 69.741995513 27.094676107 35.678749142 64.317983137 55.159 71.89 183.11 90.46 670.71 223.6 10068200000 7961240000 21.427 22.6729 24.8241 22.1946 28.4159 23.9249 4.528 59.058 164.103 164.679 14.065 128.472 469.491 595.138 6.147 12.231 18.089 34.694 0.72 0.72 0.34 5.57113 5.55955 151.794 5.60814 5.44882 6.58666 13.0346 14.6225 505.4126 203.219 257.395 143.5607 71.1423 48.8206 162.9543 143.3333 1588.2049 922.3569 72.1606 8584414.13 9527420.8 11249348.91 8951592.94 9367141.2 12138788.95 10983543.66 13659195.83 35179000 48803000 68905000 104020000 136520000 188640000 277780000 343950000 12264000 544800000 686540000 25050000 1046500000 1013800000 49614000 1056700000 1098600000 99404000 196070000 274570000 282060000 607.4694 68.3818 15.8033 4.9157 31.0532 6.9594 112.2518 20.4749 49.0574 6.9693 5.0233 1.0807 110.7358 30.936 26.340764968 69.182422904 27.373652887 35.320025891 63.198053782 55.21 7756366.8 577.78 1272.74 25368697.9 4603498.17 2988.69 4747454.51 495.03 828974.29 265.54 79692.92 137709065.86 3751.82 54137.34 407.92 665723.58 1221906.48 87949.71 92985304.75 160597.83 219207.68 3384972.44 27709.8 12951786.69 12241.13 9028.11 14537.11 26692.66 53630.31 20183.09 1424072.34 20135718.92 29786647.25 102433.04 39779508.19 858.22 10016615.7 124853.18 9111820000 6776830000 43.3981 45.6761 48.1476 43.5147 54.5018 46.4622 5.719 81.062 231.172 229.116 16.396 160.665 599.14 721.7 7.293 13.941 20.675 38.358 558.191 161.431 577.734 216.625 150.628 97.764 12.3 5.089 1.37 1.38 0.65 10.7935 10.7542 192.555 10.9153 10.5908 12.5075 25.7 25.336 999.0564 291.4682 508.3448 210.2053 136.892 86.4112 327.9694 229.6935 3312.5115 1241.8448 143.7693 123.1967 32.0656 30.4561 327.7891 229.1517 145.0143 124.3655 215.9185 143.8696 47.1505 41.6733 486.7274 139.8342 109.2794 75.9168 25.7218 25.4366 318052 63492 78223 62189 74722 60790 73692 55525 67087 595238 981354 653595 1256281 518135 805802 217865 1257862 112233 124054 103950 115022 107181 114732 103306 104362 869565 428816 769231 1890359 740741 2252252 598802 816327 90253 95293 88183 89985 83752 84474 82305 82529 16927170.48 19505101.23 22835296.84 17116522.17 21025616.3 23607335.01 47703 74741 94643 111354 6080 87667 197386 210553 1843 23758 36066 51897 65674 37083000 55677000 72570000 108010000 145900000 197890000 292720000 380280000 13359000 582930000 716650000 26065000 1169700000 1397500000 52587000 2053800000 1911400000 105480000 208610000 393800000 510160000 351062800 569090 16.29 7.72 8.08 9.38 7.11 10.56 3.86 19.29 20.62 8.72 5.23 17.19 25.96 16.2 22.32 44.06 11.81 613.0328 39.4641 15.9951 3.4287 31.4441 4.7514 116.5553 11.565 48.7397 4.3494 4.8202 0.8023 111.0762 8.1111 494.298 32.8274 48.7687 4.3595 110.1322 8.0375 73.9772 6.9453 336.7636 23.9807 32.8336 7.1439 145.9974 13.1662 614.0225 39.3077 20.688 14.862106087 39.276372578 15.275376628 20.006271694 37.54996531 33.904 38.91 99.35 48.68 351.79 119.19 OpenBenchmarking.org
Stress-NG Test: Hash OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Hash RESET3 RESET 1.7M 3.4M 5.1M 6.8M 8.5M 7756366.80 3622490.53 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: MMAP OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: MMAP RESET3 RESET 120 240 360 480 600 577.78 297.29 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: NUMA OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: NUMA RESET3 RESET 300 600 900 1200 1500 1272.74 664.87 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Pipe OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Pipe RESET3 RESET 5M 10M 15M 20M 25M 25368697.90 13860878.09 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Poll OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Poll RESET3 RESET 1000K 2000K 3000K 4000K 5000K 4603498.17 2214330.78 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Zlib OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Zlib RESET3 RESET 600 1200 1800 2400 3000 2988.69 1466.40 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Futex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Futex RESET3 RESET 1000K 2000K 3000K 4000K 5000K 4747454.51 4273978.26 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: MEMFD OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: MEMFD RESET3 RESET 110 220 330 440 550 495.03 431.59 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Mutex OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Mutex RESET3 RESET 200K 400K 600K 800K 1000K 828974.29 789472.50 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Atomic OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Atomic RESET3 RESET 60 120 180 240 300 265.54 246.62 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Crypto OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Crypto RESET3 RESET 20K 40K 60K 80K 100K 79692.92 39959.41 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Malloc OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Malloc RESET3 RESET 30M 60M 90M 120M 150M 137709065.86 31210490.91 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Cloning OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Cloning RESET3 RESET 800 1600 2400 3200 4000 3751.82 3317.10 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Forking OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Forking RESET3 RESET 12K 24K 36K 48K 60K 54137.34 32071.19 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: AVL Tree OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: AVL Tree RESET3 RESET 90 180 270 360 450 407.92 205.07 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: SENDFILE OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: SENDFILE RESET3 RESET 140K 280K 420K 560K 700K 665723.58 419265.75 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: CPU Cache OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: CPU Cache RESET3 RESET 300K 600K 900K 1200K 1500K 1221906.48 1163806.08 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: CPU Stress OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: CPU Stress RESET3 RESET 20K 40K 60K 80K 100K 87949.71 41635.43 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Semaphores OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Semaphores RESET3 RESET 20M 40M 60M 80M 100M 92985304.75 42481788.68 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Matrix Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Matrix Math RESET3 RESET 30K 60K 90K 120K 150K 160597.83 87537.46 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Vector Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Vector Math RESET3 RESET 50K 100K 150K 200K 250K 219207.68 117532.19 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: AVX-512 VNNI OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: AVX-512 VNNI RESET3 RESET 700K 1400K 2100K 2800K 3500K 3384972.44 1851108.77 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Function Call OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Function Call RESET3 RESET 6K 12K 18K 24K 30K 27709.80 13421.19 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: x86_64 RdRand OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: x86_64 RdRand RESET3 RESET 3M 6M 9M 12M 15M 12951786.69 6022050.43 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Floating Point OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Floating Point RESET3 RESET 3K 6K 9K 12K 15K 12241.13 5845.74 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Matrix 3D Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Matrix 3D Math RESET3 RESET 2K 4K 6K 8K 10K 9028.11 5817.58 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Memory Copying OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Memory Copying RESET3 RESET 3K 6K 9K 12K 15K 14537.11 7269.20 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Vector Shuffle OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Vector Shuffle RESET3 RESET 6K 12K 18K 24K 30K 26692.66 12554.84 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Mixed Scheduler OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Mixed Scheduler RESET3 RESET 11K 22K 33K 44K 55K 53630.31 39604.33 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Socket Activity OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Socket Activity RESET3 RESET 4K 8K 12K 16K 20K 20183.09 10472.15 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Wide Vector Math OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Wide Vector Math RESET3 RESET 300K 600K 900K 1200K 1500K 1424072.34 772551.49 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Context Switching OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Context Switching RESET3 RESET 4M 8M 12M 16M 20M 20135718.92 10072239.66 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Fused Multiply-Add OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Fused Multiply-Add RESET3 RESET 6M 12M 18M 24M 30M 29786647.25 16158855.40 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Vector Floating Point OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Vector Floating Point RESET3 RESET 20K 40K 60K 80K 100K 102433.04 53844.48 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Glibc C String Functions OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Glibc C String Functions RESET3 RESET 9M 18M 27M 36M 45M 39779508.19 19957308.60 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Glibc Qsort Data Sorting OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Glibc Qsort Data Sorting RESET3 RESET 200 400 600 800 1000 858.22 463.11 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: System V Message Passing OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: System V Message Passing RESET3 RESET 2M 4M 6M 8M 10M 10016615.70 7982733.22 1. (CXX) g++ options: -O2 -std=gnu99 -lc
Stress-NG Test: Pthread OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.16.04 Test: Pthread RESET3 RESET 30K 60K 90K 120K 150K 124853.18 119839.68 1. (CXX) g++ options: -O2 -std=gnu99 -lc
nekRS Input: Kershaw OpenBenchmarking.org flops/rank, More Is Better nekRS 23.0 Input: Kershaw RESET RESET2 RESET3 2000M 4000M 6000M 8000M 10000M 10295200000 10068200000 9111820000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi
nekRS Input: TurboPipe Periodic OpenBenchmarking.org flops/rank, More Is Better nekRS 23.0 Input: TurboPipe Periodic RESET2 RESET RESET3 2000M 4000M 6000M 8000M 10000M 7961240000 7950340000 6776830000 1. (CXX) g++ options: -fopenmp -O2 -march=native -mtune=native -ftree-vectorize -rdynamic -lmpi_cxx -lmpi
Embree Binary: Pathtracer - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer - Model: Crown RESET3 RESET RESET2 10 20 30 40 50 43.40 21.58 21.43 MIN: 42.87 / MAX: 44.59 MIN: 21.45 / MAX: 21.93 MIN: 21.27 / MAX: 21.76
Embree Binary: Pathtracer ISPC - Model: Crown OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer ISPC - Model: Crown RESET3 RESET RESET2 10 20 30 40 50 45.68 22.68 22.67 MIN: 45.1 / MAX: 46.91 MIN: 22.49 / MAX: 22.98 MIN: 22.51 / MAX: 23.04
Embree Binary: Pathtracer - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer - Model: Asian Dragon RESET3 RESET2 RESET 11 22 33 44 55 48.15 24.82 24.81 MIN: 47.9 / MAX: 48.87 MIN: 24.74 / MAX: 24.99 MIN: 24.73 / MAX: 25.07
Embree Binary: Pathtracer - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer - Model: Asian Dragon Obj RESET3 RESET RESET2 10 20 30 40 50 43.51 22.25 22.19 MIN: 43.25 / MAX: 44.05 MIN: 22.17 / MAX: 22.47 MIN: 22.12 / MAX: 22.35
Embree Binary: Pathtracer ISPC - Model: Asian Dragon OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer ISPC - Model: Asian Dragon RESET3 RESET2 RESET 12 24 36 48 60 54.50 28.42 28.29 MIN: 54.24 / MAX: 54.99 MIN: 28.3 / MAX: 28.73 MIN: 28.19 / MAX: 28.56
Embree Binary: Pathtracer ISPC - Model: Asian Dragon Obj OpenBenchmarking.org Frames Per Second, More Is Better Embree 4.1 Binary: Pathtracer ISPC - Model: Asian Dragon Obj RESET3 RESET2 RESET 11 22 33 44 55 46.46 23.92 23.83 MIN: 46.18 / MAX: 47.04 MIN: 23.83 / MAX: 24.22 MIN: 23.74 / MAX: 24.04
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.6 Encoder Mode: Preset 4 - Input: Bosphorus 4K RESET3 RESET2 RESET 1.2868 2.5736 3.8604 5.1472 6.434 5.719 4.528 4.502 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.6 Encoder Mode: Preset 8 - Input: Bosphorus 4K RESET3 RESET RESET2 20 40 60 80 100 81.06 59.64 59.06 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.6 Encoder Mode: Preset 12 - Input: Bosphorus 4K RESET3 RESET RESET2 50 100 150 200 250 231.17 165.65 164.10 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.6 Encoder Mode: Preset 13 - Input: Bosphorus 4K RESET3 RESET RESET2 50 100 150 200 250 229.12 165.95 164.68 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.6 Encoder Mode: Preset 4 - Input: Bosphorus 1080p RESET3 RESET RESET2 4 8 12 16 20 16.40 14.21 14.07 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.6 Encoder Mode: Preset 8 - Input: Bosphorus 1080p RESET3 RESET RESET2 40 80 120 160 200 160.67 128.58 128.47 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.6 Encoder Mode: Preset 12 - Input: Bosphorus 1080p RESET3 RESET2 RESET 130 260 390 520 650 599.14 469.49 466.98 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.6 Encoder Mode: Preset 13 - Input: Bosphorus 1080p RESET3 RESET RESET2 160 320 480 640 800 721.70 600.20 595.14 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
VVenC Video Input: Bosphorus 4K - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.9 Video Input: Bosphorus 4K - Video Preset: Fast RESET3 RESET2 RESET 2 4 6 8 10 7.293 6.147 6.126 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
VVenC Video Input: Bosphorus 4K - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.9 Video Input: Bosphorus 4K - Video Preset: Faster RESET3 RESET2 RESET 4 8 12 16 20 13.94 12.23 12.13 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
VVenC Video Input: Bosphorus 1080p - Video Preset: Fast OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.9 Video Input: Bosphorus 1080p - Video Preset: Fast RESET3 RESET2 RESET 5 10 15 20 25 20.68 18.09 18.01 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
VVenC Video Input: Bosphorus 1080p - Video Preset: Faster OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.9 Video Input: Bosphorus 1080p - Video Preset: Faster RESET3 RESET RESET2 9 18 27 36 45 38.36 34.70 34.69 1. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 13 - Input: Bosphorus 1080p RESET RESET3 130 260 390 520 650 590.49 558.19 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 13 - Input: Bosphorus 4K RESET RESET3 40 80 120 160 200 161.60 161.43 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 12 - Input: Bosphorus 1080p RESET3 RESET 120 240 360 480 600 577.73 528.29 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 12 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 12 - Input: Bosphorus 4K RESET3 RESET 50 100 150 200 250 216.63 162.29 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 8 - Input: Bosphorus 1080p RESET3 RESET 30 60 90 120 150 150.63 119.22 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 8 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 8 - Input: Bosphorus 4K RESET3 RESET 20 40 60 80 100 97.76 67.60 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 1080p OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 4 - Input: Bosphorus 1080p RESET3 RESET 3 6 9 12 15 12.30 10.73 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Encoder Mode: Preset 4 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.7 Encoder Mode: Preset 4 - Input: Bosphorus 4K RESET3 RESET 1.145 2.29 3.435 4.58 5.725 5.089 4.152 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
Intel Open Image Denoise Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.0 Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only RESET3 RESET2 RESET 0.3083 0.6166 0.9249 1.2332 1.5415 1.37 0.72 0.72
Intel Open Image Denoise Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.0 Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only RESET3 RESET2 RESET 0.3105 0.621 0.9315 1.242 1.5525 1.38 0.72 0.72
Intel Open Image Denoise Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only OpenBenchmarking.org Images / Sec, More Is Better Intel Open Image Denoise 2.0 Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only RESET3 RESET2 RESET 0.1463 0.2926 0.4389 0.5852 0.7315 0.65 0.34 0.34
OSPRay Benchmark: particle_volume/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: particle_volume/ao/real_time RESET3 RESET2 RESET 3 6 9 12 15 10.79350 5.57113 5.56770
OSPRay Benchmark: particle_volume/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: particle_volume/scivis/real_time RESET3 RESET RESET2 3 6 9 12 15 10.75420 5.56275 5.55955
OSPRay Benchmark: particle_volume/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: particle_volume/pathtracer/real_time RESET3 RESET RESET2 40 80 120 160 200 192.56 151.87 151.79
OSPRay Benchmark: gravity_spheres_volume/dim_512/ao/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/ao/real_time RESET3 RESET RESET2 3 6 9 12 15 10.91530 5.61038 5.60814
OSPRay Benchmark: gravity_spheres_volume/dim_512/scivis/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/scivis/real_time RESET3 RESET RESET2 3 6 9 12 15 10.59080 5.46527 5.44882
OSPRay Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.12 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time RESET3 RESET RESET2 3 6 9 12 15 12.50750 6.60071 6.58666
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream RESET3 RESET RESET2 6 12 18 24 30 25.70 13.14 13.03
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream RESET3 RESET RESET2 6 12 18 24 30 25.34 14.70 14.62
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream RESET3 RESET2 RESET 200 400 600 800 1000 999.06 505.41 505.28
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 60 120 180 240 300 291.47 203.22 202.75
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream RESET3 RESET RESET2 110 220 330 440 550 508.34 257.57 257.40
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 50 100 150 200 250 210.21 143.56 141.09
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream RESET3 RESET2 RESET 30 60 90 120 150 136.89 71.14 70.92
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 20 40 60 80 100 86.41 48.82 48.75
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream RESET3 RESET RESET2 70 140 210 280 350 327.97 163.18 162.95
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 50 100 150 200 250 229.69 143.33 143.26
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream RESET3 RESET RESET2 700 1400 2100 2800 3500 3312.51 1591.17 1588.20
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 300 600 900 1200 1500 1241.84 922.36 916.58
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream RESET3 RESET2 RESET 30 60 90 120 150 143.77 72.16 71.84
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream RESET3 RESET 30 60 90 120 150 123.20 69.27
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream RESET3 RESET 7 14 21 28 35 32.07 16.16
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream RESET3 RESET 7 14 21 28 35 30.46 17.76
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream RESET3 RESET 70 140 210 280 350 327.79 163.08
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream RESET3 RESET 50 100 150 200 250 229.15 143.69
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream RESET3 RESET 30 60 90 120 150 145.01 72.73
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream RESET3 RESET 30 60 90 120 150 124.37 69.63
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream RESET3 RESET 50 100 150 200 250 215.92 109.08
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream RESET3 RESET 30 60 90 120 150 143.87 101.91
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream RESET3 RESET 11 22 33 44 55 47.15 24.49
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream RESET3 RESET 10 20 30 40 50 41.67 25.92
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream RESET3 RESET 110 220 330 440 550 486.73 240.38
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream RESET3 RESET 30 60 90 120 150 139.83 93.12
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream RESET3 RESET 20 40 60 80 100 109.28 55.54
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream RESET3 RESET 20 40 60 80 100 75.92 54.81
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream RESET3 RESET 6 12 18 24 30 25.72 13.10
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream RESET3 RESET 6 12 18 24 30 25.44 14.69
Apache Cassandra Test: Writes OpenBenchmarking.org Op/s, More Is Better Apache Cassandra 4.1.3 Test: Writes RESET3 RESET 70K 140K 210K 280K 350K 318052 194642
Apache Hadoop Operation: Create - Threads: 20 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Create - Threads: 20 - Files: 100000 RESET3 RESET 14K 28K 42K 56K 70K 63492 59630
Apache Hadoop Operation: Create - Threads: 20 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Create - Threads: 20 - Files: 1000000 RESET3 RESET 20K 40K 60K 80K 100K 78223 72317
Apache Hadoop Operation: Create - Threads: 50 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Create - Threads: 50 - Files: 100000 RESET3 RESET 13K 26K 39K 52K 65K 62189 60314
Apache Hadoop Operation: Create - Threads: 50 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Create - Threads: 50 - Files: 1000000 RESET3 RESET 16K 32K 48K 64K 80K 74722 71403
Apache Hadoop Operation: Create - Threads: 100 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Create - Threads: 100 - Files: 100000 RESET3 RESET 13K 26K 39K 52K 65K 60790 59242
Apache Hadoop Operation: Create - Threads: 100 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Create - Threads: 100 - Files: 1000000 RESET3 RESET 16K 32K 48K 64K 80K 73692 69638
Apache Hadoop Operation: Create - Threads: 500 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Create - Threads: 500 - Files: 100000 RESET3 RESET 12K 24K 36K 48K 60K 55525 52383
Apache Hadoop Operation: Create - Threads: 500 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Create - Threads: 500 - Files: 1000000 RESET3 RESET 14K 28K 42K 56K 70K 67087 66037
Apache Hadoop Operation: Open - Threads: 20 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 20 - Files: 100000 RESET RESET3 140K 280K 420K 560K 700K 636943 595238
Apache Hadoop Operation: Open - Threads: 20 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 20 - Files: 1000000 RESET RESET3 300K 600K 900K 1200K 1500K 1191895 981354
Apache Hadoop Operation: Open - Threads: 50 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 50 - Files: 100000 RESET3 RESET 140K 280K 420K 560K 700K 653595 537634
Apache Hadoop Operation: Open - Threads: 50 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 50 - Files: 1000000 RESET3 RESET 300K 600K 900K 1200K 1500K 1256281 264831
Apache Hadoop Operation: Open - Threads: 100 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 100 - Files: 100000 RESET3 RESET 110K 220K 330K 440K 550K 518135 305810
Apache Hadoop Operation: Open - Threads: 100 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 100 - Files: 1000000 RESET RESET3 300K 600K 900K 1200K 1500K 1256281 805802
Apache Hadoop Operation: Open - Threads: 500 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 500 - Files: 100000 RESET3 RESET 50K 100K 150K 200K 250K 217865 205761
Apache Hadoop Operation: Open - Threads: 500 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Open - Threads: 500 - Files: 1000000 RESET3 RESET 300K 600K 900K 1200K 1500K 1257862 1164144
Apache Hadoop Operation: Delete - Threads: 20 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 20 - Files: 100000 RESET3 RESET 20K 40K 60K 80K 100K 112233 107875
Apache Hadoop Operation: Delete - Threads: 20 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 20 - Files: 1000000 RESET3 RESET 30K 60K 90K 120K 150K 124054 116333
Apache Hadoop Operation: Delete - Threads: 50 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 50 - Files: 100000 RESET RESET3 20K 40K 60K 80K 100K 108696 103950
Apache Hadoop Operation: Delete - Threads: 50 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 50 - Files: 1000000 RESET3 RESET 20K 40K 60K 80K 100K 115022 110963
Apache Hadoop Operation: Delete - Threads: 100 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 100 - Files: 100000 RESET3 RESET 20K 40K 60K 80K 100K 107181 99701
Apache Hadoop Operation: Delete - Threads: 100 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 100 - Files: 1000000 RESET3 RESET 20K 40K 60K 80K 100K 114732 112587
Apache Hadoop Operation: Delete - Threads: 500 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 500 - Files: 100000 RESET3 RESET 20K 40K 60K 80K 100K 103306 93721
Apache Hadoop Operation: Delete - Threads: 500 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Delete - Threads: 500 - Files: 1000000 RESET RESET3 20K 40K 60K 80K 100K 109673 104362
Apache Hadoop Operation: File Status - Threads: 20 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 20 - Files: 100000 RESET3 RESET 200K 400K 600K 800K 1000K 869565 869565
Apache Hadoop Operation: File Status - Threads: 20 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 20 - Files: 1000000 RESET RESET3 400K 800K 1200K 1600K 2000K 1879699 428816
Apache Hadoop Operation: File Status - Threads: 50 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 50 - Files: 100000 RESET3 RESET 160K 320K 480K 640K 800K 769231 476190
Apache Hadoop Operation: File Status - Threads: 50 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 50 - Files: 1000000 RESET3 RESET 400K 800K 1200K 1600K 2000K 1890359 593120
Apache Hadoop Operation: File Status - Threads: 100 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 100 - Files: 100000 RESET3 RESET 160K 320K 480K 640K 800K 740741 531915
Apache Hadoop Operation: File Status - Threads: 100 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 100 - Files: 1000000 RESET3 RESET 500K 1000K 1500K 2000K 2500K 2252252 1828154
Apache Hadoop Operation: File Status - Threads: 500 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 500 - Files: 100000 RESET3 RESET 130K 260K 390K 520K 650K 598802 215517
Apache Hadoop Operation: File Status - Threads: 500 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: File Status - Threads: 500 - Files: 1000000 RESET RESET3 400K 800K 1200K 1600K 2000K 1779359 816327
Apache Hadoop Operation: Rename - Threads: 20 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Rename - Threads: 20 - Files: 100000 RESET3 RESET 20K 40K 60K 80K 100K 90253 87032
Apache Hadoop Operation: Rename - Threads: 20 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Rename - Threads: 20 - Files: 1000000 RESET3 RESET 20K 40K 60K 80K 100K 95293 89095
Apache Hadoop Operation: Rename - Threads: 50 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Rename - Threads: 50 - Files: 100000 RESET3 RESET 20K 40K 60K 80K 100K 88183 83333
Apache Hadoop Operation: Rename - Threads: 50 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Rename - Threads: 50 - Files: 1000000 RESET3 RESET 20K 40K 60K 80K 100K 89985 87912
Apache Hadoop Operation: Rename - Threads: 100 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Rename - Threads: 100 - Files: 100000 RESET RESET3 20K 40K 60K 80K 100K 85616 83752
Apache Hadoop Operation: Rename - Threads: 100 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Rename - Threads: 100 - Files: 1000000 RESET RESET3 20K 40K 60K 80K 100K 85800 84474
Apache Hadoop Operation: Rename - Threads: 500 - Files: 100000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Rename - Threads: 500 - Files: 100000 RESET3 RESET 20K 40K 60K 80K 100K 82305 78555
Apache Hadoop Operation: Rename - Threads: 500 - Files: 1000000 OpenBenchmarking.org Ops per sec, More Is Better Apache Hadoop 3.3.6 Operation: Rename - Threads: 500 - Files: 1000000 RESET3 RESET 20K 40K 60K 80K 100K 82529 76722
Dragonflydb Clients Per Thread: 10 - Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 1.6.2 Clients Per Thread: 10 - Set To Get Ratio: 1:10 RESET3 RESET2 RESET 4M 8M 12M 16M 20M 16927170.48 8584414.13 8302009.42 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Dragonflydb Clients Per Thread: 20 - Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 1.6.2 Clients Per Thread: 20 - Set To Get Ratio: 1:10 RESET3 RESET RESET2 4M 8M 12M 16M 20M 19505101.23 10162330.86 9527420.80 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Dragonflydb Clients Per Thread: 50 - Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 1.6.2 Clients Per Thread: 50 - Set To Get Ratio: 1:10 RESET3 RESET RESET2 5M 10M 15M 20M 25M 22835296.84 12469755.60 11249348.91 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Dragonflydb Clients Per Thread: 10 - Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 1.6.2 Clients Per Thread: 10 - Set To Get Ratio: 1:100 RESET3 RESET2 RESET 4M 8M 12M 16M 20M 17116522.17 8951592.94 8637294.18 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Dragonflydb Clients Per Thread: 20 - Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 1.6.2 Clients Per Thread: 20 - Set To Get Ratio: 1:100 RESET3 RESET RESET2 5M 10M 15M 20M 25M 21025616.30 9932666.12 9367141.20 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Dragonflydb Clients Per Thread: 50 - Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 1.6.2 Clients Per Thread: 50 - Set To Get Ratio: 1:100 RESET3 RESET2 RESET 5M 10M 15M 20M 25M 23607335.01 12138788.95 11746361.87 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Dragonflydb Clients Per Thread: 60 - Set To Get Ratio: 1:10 OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 1.6.2 Clients Per Thread: 60 - Set To Get Ratio: 1:10 RESET RESET2 3M 6M 9M 12M 15M 12065388.34 10983543.66 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
Dragonflydb Clients Per Thread: 60 - Set To Get Ratio: 1:100 OpenBenchmarking.org Ops/sec, More Is Better Dragonflydb 1.6.2 Clients Per Thread: 60 - Set To Get Ratio: 1:100 RESET2 RESET 3M 6M 9M 12M 15M 13659195.83 11419293.83 1. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre
TiDB Community Server Test: oltp_read_write - Threads: 1 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_read_write - Threads: 1 RESET 700 1400 2100 2800 3500 3204
TiDB Community Server Test: oltp_read_write - Threads: 16 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_read_write - Threads: 16 RESET3 RESET 10K 20K 30K 40K 50K 47703 36124
TiDB Community Server Test: oltp_read_write - Threads: 32 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_read_write - Threads: 32 RESET3 RESET 16K 32K 48K 64K 80K 74741 46972
TiDB Community Server Test: oltp_read_write - Threads: 64 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_read_write - Threads: 64 RESET3 20K 40K 60K 80K 100K 94643
TiDB Community Server Test: oltp_read_write - Threads: 128 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_read_write - Threads: 128 RESET 13K 26K 39K 52K 65K 59739
TiDB Community Server Test: oltp_read_write - Threads: 256 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_read_write - Threads: 256 RESET3 RESET 20K 40K 60K 80K 100K 111354 62965
TiDB Community Server Test: oltp_point_select - Threads: 1 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 1 RESET3 RESET 1300 2600 3900 5200 6500 6080 5956
TiDB Community Server Test: oltp_point_select - Threads: 16 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 16 RESET3 20K 40K 60K 80K 100K 87667
TiDB Community Server Test: oltp_point_select - Threads: 32 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 32 RESET 20K 40K 60K 80K 100K 97200
TiDB Community Server Test: oltp_point_select - Threads: 64 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 64 RESET 30K 60K 90K 120K 150K 118850
TiDB Community Server Test: oltp_point_select - Threads: 128 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 128 RESET3 RESET 40K 80K 120K 160K 200K 197386 131165
TiDB Community Server Test: oltp_point_select - Threads: 256 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_point_select - Threads: 256 RESET3 RESET 50K 100K 150K 200K 250K 210553 143244
TiDB Community Server Test: oltp_update_non_index - Threads: 1 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_non_index - Threads: 1 RESET3 RESET 400 800 1200 1600 2000 1843 1687
TiDB Community Server Test: oltp_update_non_index - Threads: 16 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_non_index - Threads: 16 RESET3 RESET 5K 10K 15K 20K 25K 23758 18663
TiDB Community Server Test: oltp_update_non_index - Threads: 32 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_non_index - Threads: 32 RESET3 RESET 8K 16K 24K 32K 40K 36066 26459
TiDB Community Server Test: oltp_update_non_index - Threads: 64 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_non_index - Threads: 64 RESET3 RESET 11K 22K 33K 44K 55K 51897 34234
TiDB Community Server Test: oltp_update_non_index - Threads: 128 OpenBenchmarking.org Queries Per Second, More Is Better TiDB Community Server 7.3 Test: oltp_update_non_index - Threads: 128 RESET3 RESET 14K 28K 42K 56K 70K 65674 41635
Liquid-DSP Threads: 1 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 32 RESET3 RESET RESET2 8M 16M 24M 32M 40M 37083000 35186000 35179000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 1 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 57 RESET3 RESET RESET2 12M 24M 36M 48M 60M 55677000 52897000 48803000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 2 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 2 - Buffer Length: 256 - Filter Length: 32 RESET3 RESET2 RESET 16M 32M 48M 64M 80M 72570000 68905000 68854000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 2 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 2 - Buffer Length: 256 - Filter Length: 57 RESET3 RESET RESET2 20M 40M 60M 80M 100M 108010000 105200000 104020000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 4 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 4 - Buffer Length: 256 - Filter Length: 32 RESET3 RESET RESET2 30M 60M 90M 120M 150M 145900000 138520000 136520000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 4 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 4 - Buffer Length: 256 - Filter Length: 57 RESET3 RESET RESET2 40M 80M 120M 160M 200M 197890000 190540000 188640000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 8 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 8 - Buffer Length: 256 - Filter Length: 32 RESET3 RESET2 RESET 60M 120M 180M 240M 300M 292720000 277780000 277560000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 8 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 8 - Buffer Length: 256 - Filter Length: 57 RESET3 RESET2 RESET 80M 160M 240M 320M 400M 380280000 343950000 337660000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 1 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 1 - Buffer Length: 256 - Filter Length: 512 RESET3 RESET RESET2 3M 6M 9M 12M 15M 13359000 12685000 12264000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 16 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 16 - Buffer Length: 256 - Filter Length: 32 RESET3 RESET RESET2 120M 240M 360M 480M 600M 582930000 545570000 544800000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 16 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 16 - Buffer Length: 256 - Filter Length: 57 RESET3 RESET RESET2 150M 300M 450M 600M 750M 716650000 695920000 686540000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 2 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 2 - Buffer Length: 256 - Filter Length: 512 RESET3 RESET RESET2 6M 12M 18M 24M 30M 26065000 25206000 25050000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 32 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 32 - Buffer Length: 256 - Filter Length: 32 RESET3 RESET RESET2 300M 600M 900M 1200M 1500M 1169700000 1047500000 1046500000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 32 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 32 - Buffer Length: 256 - Filter Length: 57 RESET3 RESET RESET2 300M 600M 900M 1200M 1500M 1397500000 1031700000 1013800000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 4 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 4 - Buffer Length: 256 - Filter Length: 512 RESET3 RESET2 RESET 11M 22M 33M 44M 55M 52587000 49614000 48886000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 64 - Buffer Length: 256 - Filter Length: 32 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 32 RESET3 RESET2 RESET 400M 800M 1200M 1600M 2000M 2053800000 1056700000 1056400000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 64 - Buffer Length: 256 - Filter Length: 57 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 57 RESET3 RESET RESET2 400M 800M 1200M 1600M 2000M 1911400000 1100900000 1098600000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 8 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 8 - Buffer Length: 256 - Filter Length: 512 RESET3 RESET2 RESET 20M 40M 60M 80M 100M 105480000 99404000 97011000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 16 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 16 - Buffer Length: 256 - Filter Length: 512 RESET3 RESET RESET2 40M 80M 120M 160M 200M 208610000 196300000 196070000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 32 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 32 - Buffer Length: 256 - Filter Length: 512 RESET3 RESET2 RESET 80M 160M 240M 320M 400M 393800000 274570000 273720000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Liquid-DSP Threads: 64 - Buffer Length: 256 - Filter Length: 512 OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 1.6 Threads: 64 - Buffer Length: 256 - Filter Length: 512 RESET3 RESET RESET2 110M 220M 330M 440M 550M 510160000 282490000 282060000 1. (CC) gcc options: -O3 -pthread -lm -lc -lliquid
Kripke OpenBenchmarking.org Throughput FoM, More Is Better Kripke 1.2.6 RESET3 RESET 80M 160M 240M 320M 400M 351062800 237641100 1. (CXX) g++ options: -O3 -fopenmp -ldl
BRL-CAD VGR Performance Metric OpenBenchmarking.org VGR Performance Metric, More Is Better BRL-CAD 7.36 VGR Performance Metric RESET3 RESET 120K 240K 360K 480K 600K 569090 295626 1. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6
NCNN Target: CPU - Model: mobilenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: mobilenet RESET3 RESET 4 8 12 16 20 16.29 16.73 MIN: 16.05 / MAX: 16.77 MIN: 16.57 / MAX: 18.96 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v2-v2 - Model: mobilenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v2-v2 - Model: mobilenet-v2 RESET RESET3 2 4 6 8 10 7.36 7.72 MIN: 6.92 / MAX: 8.19 MIN: 7.29 / MAX: 8.21 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU-v3-v3 - Model: mobilenet-v3 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU-v3-v3 - Model: mobilenet-v3 RESET RESET3 2 4 6 8 10 7.55 8.08 MIN: 7.41 / MAX: 11.7 MIN: 7.94 / MAX: 8.54 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: shufflenet-v2 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: shufflenet-v2 RESET RESET3 3 6 9 12 15 8.67 9.38 MIN: 8.53 / MAX: 10.83 MIN: 9.25 / MAX: 12.88 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: mnasnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: mnasnet RESET3 RESET 2 4 6 8 10 7.11 7.47 MIN: 7.04 / MAX: 7.35 MIN: 6.42 / MAX: 190.35 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: efficientnet-b0 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: efficientnet-b0 RESET RESET3 3 6 9 12 15 9.35 10.56 MIN: 9.25 / MAX: 10.78 MIN: 9.78 / MAX: 160.53 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: blazeface OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: blazeface RESET RESET3 0.8685 1.737 2.6055 3.474 4.3425 3.35 3.86 MIN: 3.27 / MAX: 3.52 MIN: 3.79 / MAX: 4.34 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: googlenet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: googlenet RESET RESET3 5 10 15 20 25 17.98 19.29 MIN: 17.82 / MAX: 18.6 MIN: 18.99 / MAX: 22.75 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vgg16 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: vgg16 RESET3 RESET 5 10 15 20 25 20.62 22.59 MIN: 20.22 / MAX: 23.98 MIN: 20.48 / MAX: 23.4 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet18 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: resnet18 RESET3 RESET 3 6 9 12 15 8.72 9.13 MIN: 8.48 / MAX: 9.08 MIN: 9 / MAX: 11.27 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: alexnet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: alexnet RESET3 RESET 2 4 6 8 10 5.23 6.01 MIN: 5.01 / MAX: 5.51 MIN: 5.86 / MAX: 7.74 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: resnet50 OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: resnet50 RESET RESET3 4 8 12 16 20 16.83 17.19 MIN: 16.57 / MAX: 24.47 MIN: 16.86 / MAX: 35.55 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: yolov4-tiny OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: yolov4-tiny RESET RESET3 6 12 18 24 30 25.42 25.96 MIN: 24.66 / MAX: 60.7 MIN: 25.03 / MAX: 29.61 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: squeezenet_ssd OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: squeezenet_ssd RESET RESET3 4 8 12 16 20 15.52 16.20 MIN: 15.22 / MAX: 20.06 MIN: 15.81 / MAX: 54.08 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: regnety_400m OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: regnety_400m RESET RESET3 5 10 15 20 25 17.13 22.32 MIN: 16.89 / MAX: 19.07 MIN: 22.1 / MAX: 22.95 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: vision_transformer OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: vision_transformer RESET3 RESET 13 26 39 52 65 44.06 55.73 MIN: 43.6 / MAX: 47.6 MIN: 54.17 / MAX: 116.29 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
NCNN Target: CPU - Model: FastestDet OpenBenchmarking.org ms, Fewer Is Better NCNN 20230517 Target: CPU - Model: FastestDet RESET RESET3 3 6 9 12 15 11.30 11.81 MIN: 11.03 / MAX: 14.81 MIN: 11.65 / MAX: 12.07 1. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream RESET RESET2 RESET3 130 260 390 520 650 607.03 607.47 613.03
Neural Magic DeepSparse Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream RESET3 RESET RESET2 15 30 45 60 75 39.46 68.03 68.38
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream RESET2 RESET RESET3 4 8 12 16 20 15.80 15.81 16.00
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 1.1086 2.2172 3.3258 4.4344 5.543 3.4287 4.9157 4.9273
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream RESET RESET2 RESET3 7 14 21 28 35 31.02 31.05 31.44
Neural Magic DeepSparse Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 2 4 6 8 10 4.7514 6.9594 7.0815
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream RESET2 RESET RESET3 30 60 90 120 150 112.25 112.60 116.56
Neural Magic DeepSparse Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 5 10 15 20 25 11.57 20.47 20.51
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream RESET3 RESET RESET2 11 22 33 44 55 48.74 49.00 49.06
Neural Magic DeepSparse Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 2 4 6 8 10 4.3494 6.9693 6.9730
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream RESET3 RESET RESET2 1.1302 2.2604 3.3906 4.5208 5.651 4.8202 5.0159 5.0233
Neural Magic DeepSparse Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream RESET3 RESET2 RESET 0.2447 0.4894 0.7341 0.9788 1.2235 0.8023 1.0807 1.0875
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream RESET2 RESET3 RESET 20 40 60 80 100 110.74 111.08 111.10
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream RESET3 RESET 4 8 12 16 20 8.1111 14.4253
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream RESET RESET3 110 220 330 440 550 493.61 494.30
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream RESET3 RESET 13 26 39 52 65 32.83 56.29
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream RESET3 RESET 11 22 33 44 55 48.77 49.00
Neural Magic DeepSparse Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream RESET3 RESET 2 4 6 8 10 4.3595 6.9520
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream RESET RESET3 20 40 60 80 100 109.89 110.13
Neural Magic DeepSparse Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream RESET3 RESET 4 8 12 16 20 8.0375 14.3550
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream RESET RESET3 16 32 48 64 80 73.20 73.98
Neural Magic DeepSparse Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream RESET3 RESET 3 6 9 12 15 6.9453 9.8064
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream RESET RESET3 70 140 210 280 350 325.02 336.76
Neural Magic DeepSparse Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream RESET3 RESET 9 18 27 36 45 23.98 38.57
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream RESET3 RESET 8 16 24 32 40 32.83 33.25
Neural Magic DeepSparse Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream RESET3 RESET 3 6 9 12 15 7.1439 10.7278
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream RESET RESET3 30 60 90 120 150 143.84 146.00
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream RESET3 RESET 4 8 12 16 20 13.17 18.24
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream RESET RESET3 130 260 390 520 650 608.16 614.02
Neural Magic DeepSparse Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.5 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream RESET3 RESET 15 30 45 60 75 39.31 68.08
Remhos Test: Sample Remap Example OpenBenchmarking.org Seconds, Fewer Is Better Remhos 1.0 Test: Sample Remap Example RESET3 RESET2 RESET 7 14 21 28 35 20.69 30.94 31.02 1. (CXX) g++ options: -O3 -std=c++11 -lmfem -lHYPRE -lmetis -lrt -lmpi_cxx -lmpi
SPECFEM3D Model: Mount St. Helens OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Mount St. Helens RESET3 RESET2 RESET 6 12 18 24 30 14.86 26.34 27.11 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
SPECFEM3D Model: Layered Halfspace OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Layered Halfspace RESET3 RESET2 RESET 16 32 48 64 80 39.28 69.18 69.74 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
SPECFEM3D Model: Tomographic Model OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Tomographic Model RESET3 RESET RESET2 6 12 18 24 30 15.28 27.09 27.37 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
SPECFEM3D Model: Homogeneous Halfspace OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Homogeneous Halfspace RESET3 RESET2 RESET 8 16 24 32 40 20.01 35.32 35.68 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
SPECFEM3D Model: Water-layered Halfspace OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Water-layered Halfspace RESET3 RESET2 RESET 14 28 42 56 70 37.55 63.20 64.32 1. (F9X) gfortran options: -O2 -fopenmp -std=f2003 -fimplicit-none -fmax-errors=10 -pedantic -pedantic-errors -O3 -finline-functions -lmpi_usempif08 -lmpi_mpifh -lmpi
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.1 Build: defconfig RESET3 RESET RESET2 12 24 36 48 60 33.90 55.16 55.21
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: BMW27 - Compute: CPU-Only RESET3 RESET 16 32 48 64 80 38.91 71.89
Blender Blend File: Classroom - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: Classroom - Compute: CPU-Only RESET3 RESET 40 80 120 160 200 99.35 183.11
Blender Blend File: Fishy Cat - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: Fishy Cat - Compute: CPU-Only RESET3 RESET 20 40 60 80 100 48.68 90.46
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: Barbershop - Compute: CPU-Only RESET3 RESET 140 280 420 560 700 351.79 670.71
Blender Blend File: Pabellon Barcelona - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.6 Blend File: Pabellon Barcelona - Compute: CPU-Only RESET3 RESET 50 100 150 200 250 119.19 223.60
Phoronix Test Suite v10.8.4