9654 new

2 x AMD EPYC 9654 96-Core testing with a AMD Titanite_4G (RTI1004D BIOS) and llvmpipe on Red Hat Enterprise Linux 9.1 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2303114-NE-9654NEW5019&grw&sor.

9654 newProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionOpenGLabcno smt ano smt bsmt asmt bsmt csmt dAMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads)AMD Titanite_4G (RTI1004D BIOS)AMD Device 14a4768GB2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007ASPEEDVGA HDMIBroadcom NetXtreme BCM5720 PCIeRed Hat Enterprise Linux 9.15.14.0-162.6.1.el9_1.x86_64 (x86_64)GNOME Shell 40.10X Server 1.20.11GCC 11.3.1 20220421xfs1600x12002 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores)1520GBllvmpipe4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits)1024x7682 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Details- Python 3.9.14Security Details- a: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - b: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - c: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - no smt a: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - no smt b: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt a: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt b: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt c: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt d: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

9654 newstress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pollstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Forkingstress-ng: Pthreadstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: Function Callstress-ng: Memory Copyingstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamgromacs: MPI CPU - water_GMX50_bareonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUbuild-ffmpeg: Time To Compilecompress-zstd: 3 - Compression Speedcompress-zstd: 3 - Decompression Speedcompress-zstd: 8 - Compression Speedcompress-zstd: 8 - Decompression Speedcompress-zstd: 12 - Compression Speedcompress-zstd: 12 - Decompression Speedcompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 3, Long Mode - Compression Speedcompress-zstd: 3, Long Mode - Decompression Speedcompress-zstd: 8, Long Mode - Compression Speedcompress-zstd: 8, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedcompress-zstd: 19, Long Mode - Decompression Speedbuild-linux-kernel: defconfigkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 1080p - Super Fastkvazaar: Bosphorus 1080p - Ultra Fastvpxenc: Speed 0 - Bosphorus 4Kvpxenc: Speed 5 - Bosphorus 4Kvpxenc: Speed 0 - Bosphorus 1080pvpxenc: Speed 5 - Bosphorus 1080puvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Ultra Fastvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastvvenc: Bosphorus 1080p - Fasteropenvkl: vklBenchmark ISPCopenvkl: vklBenchmark Scalarclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runmemcached: 1:5memcached: 1:10memcached: 1:100rocksdb: Rand Fillrocksdb: Rand Readrocksdb: Update Randrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While Writingrocksdb: Read Rand Write Randabcno smt ano smt bsmt asmt bsmt csmt d189549361663.08483.912653709.642794694.37518.4659479783.64174.72203073.15312709034.0558156.36109397.781950323.9677.51205134.8718128283.29382305.69556875.59621015.3420106.518873.5818941003.9716257100.251122.3910473084.0942.98931115.760234.826228.70771566.56430.5924197.10185.0715401.7766119.206799.149310.0811440.8533108.6775104.11789.59621009.848647.464188.53785.3018619.753177.3363192.88065.1812149.7446319.981560.252216.5828314.8361152.137787.963111.36242.95811116.42634.928928.623310.5692.015811.564613.114970.534458.745761.877770.6933677.357461.170040.3114050.5552770.304972907.489674.088911.2450.4154461.831470.711588671.690.357017909.691675.9150.2639970.290249.72962.128.471671.4627.971701.72941.4716.395.76499.325908.898.114914.179.76540.4188.719494.2210.15750.748.34112346.360.6574495.171.0912.5693033.91514.81233.81669.3330.81704.819.11472.6892.71536.6938.51677.99.221383.725.76840.6341.4139.92143.3180.981.983.45296.93307.49310.737.6817.3614.6929.3729.3733.0381.1691.3768.8269.3370.56234.95238.68240.985.8212.33612.4430.0391089556600.70625.91625.164143044.216861088.8948788605339274682314345443845422563766019296185292645818955118.11664.75498.6712661687.462805836.52507.7460031543.97223.29203147.15314418461.0258664.97109356.781913590.7767.21217072.2718100474.36382304.04556797.27621003.9220340.48851.6516313126.8616168655.171132.3510471889.9742.8971118.438335.096228.48661573.749630.4608196.54145.0859401.2053119.379998.617510.136439.0373109.1129104.29089.57931012.349447.3532181.81235.498619.944277.305193.53055.1633149.8207319.964859.922216.6745316.2907151.600389.335511.187242.83481116.289934.818928.713710.6091.92341.562574.278580.5130689.19571.729750.6890647.282431.166960.3127210.5519660.305731903.272671.654912.1140.5784661.841720.712495670.2020.356875917.077668.9520.2633730.29138749.72962.6328.421675.9628.231685.263085.5315.5495.48500.835894.278.134915.429.75541.0388.619496.9510.15720.98.38111378.390.6674353.411.0912.43430951516.61239.316513321716.719.11467.8909.41537.5910.81673.79.291378.225.74940.8641.39139.07144.2181.6180.6884.77290.59303.99305.527.7117.3714.6729.529.2933.1381.4191.4768.796970.68234.68239.92240.915.80912.39112.39929.8451075557610.79627.20628.374162812.476792746.344876951.365346814668888885455565453963730028620352289196218961773.181668.92478.0512676101.412794473.75507.9759929401.4183.33203095.44313768771.2664299.62109609.151891202.3797.04217304.1918088584.67382328.5556833.5621041.9320297.918876.116862185.5416537965.141125.8610475486.3942.74331122.058435.118828.46871571.828130.4911197.66015.0573400.0427119.702698.592210.1384438.4372109.2467113.50578.80041013.735747.2942181.72435.5007625.551276.6181193.31195.1696149.6905320.050460.488416.5185316.6282151.389989.54711.160542.91521117.732334.993728.569810.5871.886861.567424.39720.5469913.830171.63860.6926677.381161.169190.3122890.5568510.305599906.139669.146915.0840.4171881.822640.708563671.2330.353175911.762667.950.262920.28543249.77962.1528.331679.0327.891704.023174.0415.195.59500.35898.798.134910.139.76535.7889.469485.6510.115724.818.37112186.250.6674486.081.0912.4653049.41517.41241.11661.9330.11715.619.11470.5916.91540.9926.91675.49.3138425.6840.7641.47140.1143.8180.3184.5582.7291.03301.4309.647.717.4614.7629.4629.4133.181.191.2969.0469.9271.13237.44237.96238.775.80812.39912.44130.0811066549614.24621.88636.184155273.466839975.874852421.675365514680697925435725445653569228316379291002327408413.14520.4820.5110458275.243746361.52303.5663581395.67400.03435615.35456657338.8443094.9668076.033284433.240.94328297.0413141129.68932248.18920216.27829106.6311342.698968.2847222624.4926755146.691978.87402514.7497.4442955.163131.914631.3273107.295730.4213191.26055.2262813.9832116.153272.129813.8559941.2443100.2418101.00959.88992204.753342.805166.27256.01181291.973373.1993131.75867.5856308.4294304.207548.184920.7385649.302145.354869.106314.463897.3996956.008831.318731.922919.1752.040032.196454.878830.5560696.192572.022860.403599.252920.6642950.2548450.6643590.1603611148.26930.2571151.250.2916871.650410.462386913.2010.3428361147.34973.3180.3166650.316779109.08438.2957.58828.6757.18833.997979.056.01208.82229.4612119.663.9510556.934.541045.8145.8620836.19.189784.094.9160545.410.57127833.521.0110.5972804.21500.41227.51669.7279.9172819.81483.1955.61542.5859.91684.89.391395.817.60647.1347.97155.56159.6370.0275.576.05269.62288.41278.627.0414.4814.2829.6234.5938.3887.1598.2157.1359.8357.78196.25181.67186.245.8912.47712.35728.6891098647635.48666.43665.002444886.824244908.833192061.6847862912096110554620184657003506737643831207980427422305.533591.7119.7810393402.013802292.6308.6765500297.73395.95437065.75456651508.0445685.2867451.33282827.555.84326819.7213192391.85925984.24920642.34829445.3810949.98924.144683906.6828009942.561963.757372780.7297.3838955.238629.754433.60123086.359130.6403175.31995.7015817.6313115.636971.887813.9039938.9084100.4198100.5099.93952203.157342.8393164.81266.0651292.803873.2087155.73576.4174308.3033303.737748.925720.4223647.7596145.362769.326614.417897.3441955.343831.0732.177818.8371.931262.123794.793020.6290267.988612.028330.4003259.317510.6513010.2557960.6705740.1648451124.75901.0441119.170.2912291.700570.461174903.3580.3472311139.63939.5470.2935640.340498109.04438.9957.49830.0457.19834.177979.826.01210.14228.0112128.383.9510549.244.541048.7445.7320849.759.189758.744.91162294.470.58127770.391.0110.6622865.91511.51234.21667.6278.21727.819.81483.81032.31538.88921682.89.761397.617.58647.4347.93159.79161.469.9474.0374.37268.77280.18271.457.1614.513.7229.7134.6838.6588.1396.6758.0958.3357.23183.75216.15209.855.89512.3112.37428.521108652622.73649.52662.012460416.334220522.493216133.9146821012135402994522284640443440407913568206383141966139.678360.7624.8215359471.732333781.39464.7136339636.91184.34466292.12634718750.4136266.0274978.514329963.2647.58487359.3920047519.05946032.881291689.331414423.6515914.18748.9912895047.7335687958.372564.4810103952.1397.0249972.516331.759231.48053114.684830.7462188.58265.3004817.7536117.123377.882712.8322929.0246103.0888121.92328.19142230.309942.9515139.09737.18651306.667773.306132.86557.5225314.6186303.327247.50621.0323658.2111145.396673.292413.63797.2916970.220230.957232.295618.8187.605663.3915111.43260.97535715.4213.388330.53853920.26950.978590.407431.200490.2796381912.1631871830.410.4514722.708070.6725853269.050.6744551888.13133.650.5917380.621776108.93439.4157.72827.0757.29833.157953.216.02208.13230.2112117.163.9510544.034.541049.1645.7120610.239.289746.084.92173926.920.53148316.880.9710.3812795.11515.61023.91664.3254.11723.718.81495.21051.41539.5853.81682.59.781393.517.37664.6365.56132.67140.7875.9176.6477.96250.71296.72302.557.2413.914.0829.5445.5647.5680.1789.459.359.0657.96183.99178.49216.151318764500.13524.04534.8225202534530948.624383314.65423027122566285241319941416838805215317250178768241989522.689017.1224.7715341564.162396325.93564.05135855921.28186.64466609.22634995429.6636020.16180407.594329824.3844.38487987.3219927313.52946660.881291704.571413555.4415430.188750.6112221058.3435996976.132520.388586858.5196.906975.50431.780631.45933114.429330.7508188.41475.3053822.1552116.481377.409612.9106927.679103.1902119.59648.35062245.803642.6536136.83247.30541306.583973.3496145.17366.8844314.2452304.078245.964221.7398658.341145.274568.292414.635697.3528969.212231.009332.241519.0157.42273.494537.301470.97170419.5493.596430.55178320.5720.9735550.4080741.181350.2910871890.283034.621937.650.4502612.76140.6727683249.280.6756641894.073222.930.6001990.620907108.89439.557.67827.0357.31832.77949.056.03208.19230.0612109.643.9610549.154.541050.3745.6620610.629.289680.444.95175754.350.53147582.870.9710.2592513.41519.11122.41671259.11726.319.51483.51038.91540.4852.71676.59.871392.417.01766.2265.69136.33138.3374.1176.777274.63267.04295.186.9714.2713.5729.646.2546.6279.9589.757.8659.257.51209.55220.79179.561243810516.09527.88538.632507331.294392934.754357453.76417882123116809341151341370840129513830689176141641972765.937633.1624.7915228320.072067499.58413.34138939958.5184.24468159.21639757070.5234917.3977834.394351871.1242.55490300.4819866440.86952461.481295970.281422505.5115077.698747.8312328933.6534602827.772517.268609357.6896.9975971.898831.927731.31463132.383830.5784189.40545.2773818.6037116.968970.141814.2486937.992102.099996.173710.38522253.141142.5521163.71116.10571305.713773.3407135.89077.355315.3318303.254948.77220.4884662.2585144.466170.382814.201196.9077971.667729.416333.987919.0459.349813.6019412.0130.9957118.65943.365350.54511821.03010.9728630.3943771.201460.2759171888.213011.211926.150.447822.702350.6767983153.220.6761241925.683185.640.5932990.634992109.36437.5158.05821.9357.71826.677993.185.99210.19227.9312168.053.9310603.844.521058.5745.3120684.299.259773.264.9173620.310.53148047.130.9610.4072604.61516.21005.81664249.81732.319.21475.21046.61540.9860.81683.79.82138917.05365.4965.59135.8140.8973.5778.7276.14243.36288.09303.436.9215.3813.9729.5446.3446.5779.6389.1657.4458.3457.33192.25178.78218.281235793495.85524.75530.472517750.474549313.424394194.49416006123457051241998541428239485213948914161391341965286.067273.1924.7115403597.242077119.76394.49137579874.56182.8468006640853365.5434685.8591735.754351920.4240.56489998.7519842969.28951700.171300693.931425621.4413370.338864.7812728401.4536111781.822516.0912418451.7196.7169974.98530.249433.05143116.090930.7247183.9495.4341816.7562117.221975.52413.2331931.8223102.7646106.65189.36562255.42242.4798139.82417.1491301.181173.6196141.47057.064316.0328301.919246.781521.3593660.2132144.914466.08315.12697.8908966.760631.072732.175819.0778.260783.5056312.15710.97509111.75732.974270.6306320.97260.9739840.3892231.23340.2478251957.773349.361883.760.4575542.673030.6803953171.150.6721151912.743172.190.6028310.627133109.23437.6858822.557.62828.017990.476209.24228.9412172.923.9310587.34.521057.7445.3420679.689.269767.994.91172228.340.53149647.680.9710.3732528.71513.51024.81664.2256.21731.219.61479.110591543.6879.61677.69.811391.717.07966.0865.49135.56136.4273.2475.578.85270.76256.45303.637.1515.1113.6829.6646.2546.218088.9157.5258.6658.76181.83218.91224.311238781500.118340751515.11527.802527084.874569476.864403267.424154281231916197420514414047404463130980971752904OpenBenchmarking.org

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Hashsmt bsmt csmt asmt dno smt bno smt acba9M18M27M36M45M41989522.6841972765.9341966139.6741965286.0627422305.5327408413.1018961773.1818955118.1018954936.001. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: MMAPsmt bsmt asmt csmt dno smt ano smt bcba2K4K6K8K10K9017.128360.767633.167273.194520.483591.711668.921664.751663.081. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: NUMAbacsmt asmt csmt bsmt dno smt ano smt b110220330440550498.67483.90478.0524.8224.7924.7724.7120.5119.781. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Pollsmt dsmt asmt bsmt ccbano smt ano smt b3M6M9M12M15M15403597.2415359471.7315341564.1615228320.0712676101.4112661687.4612653709.6410458275.2410393402.011. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Futexno smt bno smt abacsmt bsmt asmt dsmt c800K1600K2400K3200K4000K3802292.603746361.522805836.522794694.372794473.752396325.932333781.392077119.762067499.581. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: MEMFDsmt bacbsmt asmt csmt dno smt bno smt a120240360480600564.05518.46507.97507.74464.70413.34394.49308.67303.561. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Mutexsmt csmt dsmt asmt bno smt bno smt abca30M60M90M120M150M138939958.50137579874.56136339636.91135855921.2865500297.7363581395.6760031543.9759929401.4059479783.641. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Atomicno smt ano smt bbsmt bsmt asmt ccsmt da90180270360450400.03395.95223.29186.64184.34184.24183.33182.80174.721. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Cryptosmt csmt dsmt bsmt ano smt bno smt abca100K200K300K400K500K468159.21468006.00466609.22466292.12437065.75435615.35203147.15203095.44203073.151. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Mallocsmt dsmt csmt bsmt ano smt ano smt bbca140M280M420M560M700M640853365.54639757070.52634995429.66634718750.41456657338.84456651508.04314418461.02313768771.26312709034.051. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Forkingcbano smt bno smt asmt asmt bsmt csmt d14K28K42K56K70K64299.6258664.9758156.3645685.2843094.9636266.0236020.1634917.3934685.851. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Pthreadsmt bcabsmt dsmt csmt ano smt ano smt b40K80K120K160K200K180407.59109609.15109397.78109356.7891735.7577834.3974978.5168076.0367451.301. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: SENDFILEsmt dsmt csmt asmt bno smt ano smt babc900K1800K2700K3600K4500K4351920.424351871.124329963.264329824.383284433.203282827.501950323.961913590.771891202.371. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: CPU Cachecabno smt bsmt asmt bsmt cno smt asmt d2040608010097.0477.5167.2155.8447.5844.3842.5540.9440.561. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: CPU Stresssmt csmt dsmt bsmt ano smt ano smt bcba110K220K330K440K550K490300.48489998.75487987.32487359.39328297.04326819.72217304.19217072.27205134.871. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Semaphoressmt asmt bsmt csmt dabcno smt bno smt a4M8M12M16M20M20047519.0519927313.5219866440.8619842969.2818128283.2918100474.3618088584.6713192391.8513141129.681. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Matrix Mathsmt csmt dsmt bsmt ano smt ano smt bcab200K400K600K800K1000K952461.48951700.17946660.88946032.88932248.18925984.24382328.50382305.69382304.041. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Vector Mathsmt dsmt csmt bsmt ano smt bno smt aacb300K600K900K1200K1500K1300693.931295970.281291704.571291689.33920642.34920216.27556875.59556833.50556797.271. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Function Callsmt dsmt csmt asmt bno smt bno smt acab300K600K900K1200K1500K1425621.441422505.511414423.651413555.44829445.38829106.63621041.93621015.34621003.921. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Memory Copyingbcasmt asmt bsmt csmt dno smt ano smt b4K8K12K16K20K20340.4020297.9120106.5115914.1015430.1815077.6913370.3311342.6910949.901. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Socket Activityno smt ano smt bcasmt dbsmt bsmt asmt c2K4K6K8K10K8968.288924.108876.108873.588864.788851.658750.618748.998747.831. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Context Switchingno smt ano smt bacbsmt asmt dsmt csmt b10M20M30M40M50M47222624.4944683906.6818941003.9716862185.5416313126.8612895047.7312728401.4512328933.6512221058.341. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Glibc C String Functionssmt dsmt bsmt asmt cno smt bno smt acab8M16M24M32M40M36111781.8235996976.1335687958.3734602827.7728009942.5626755146.6916537965.1416257100.2516168655.171. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Glibc Qsort Data Sortingsmt asmt bsmt csmt dno smt ano smt bbca60012001800240030002564.482520.382517.262516.091978.801963.751132.351125.861122.391. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: System V Message Passingsmt dcabsmt asmt csmt bno smt ano smt b3M6M9M12M15M12418451.7110475486.3910473084.0910471889.9710103952.138609357.688586858.517402514.747372780.721. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamno smt ano smt bsmt asmt csmt bsmt dabc2040608010097.4497.3897.0297.0096.9196.7242.9942.9042.74

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamno smt ano smt bsmt csmt asmt dsmt babc2004006008001000955.16955.24971.90972.52974.99975.501115.761118.441122.06

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamcbasmt cno smt asmt bsmt asmt dno smt b81624324035.1235.1034.8331.9331.9131.7831.7630.2529.75

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamcbasmt cno smt asmt bsmt asmt dno smt b81624324028.4728.4928.7131.3131.3331.4631.4833.0533.60

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamsmt csmt dsmt asmt bno smt ano smt bbca70014002100280035003132.383116.093114.683114.433107.303086.361573.751571.831566.56

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamno smt abcsmt cano smt bsmt dsmt asmt b71421283530.4230.4630.4930.5830.5930.6430.7230.7530.75

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Streamcabno smt asmt csmt asmt bsmt dno smt b4080120160200197.66197.10196.54191.26189.41188.58188.41183.95175.32

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Streamcabno smt asmt csmt asmt bsmt dno smt b1.28282.56563.84845.13126.4145.05735.07155.08595.22625.27735.30045.30535.43415.7015

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamsmt bsmt csmt ano smt bsmt dno smt aabc2004006008001000822.16818.60817.75817.63816.76813.98401.78401.21400.04

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamno smt bno smt asmt bsmt csmt asmt dabc306090120150115.64116.15116.48116.97117.12117.22119.21119.38119.70

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Streamabcsmt asmt bsmt dno smt ano smt bsmt c2040608010099.1598.6298.5977.8877.4175.5272.1371.8970.14

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Streamabcsmt asmt bsmt dno smt ano smt bsmt c4812162010.0810.1410.1412.8312.9113.2313.8613.9014.25

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamno smt ano smt bsmt csmt dsmt asmt babc2004006008001000941.24938.91937.99931.82929.02927.68440.85439.04438.44

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamno smt ano smt bsmt csmt dsmt asmt babc20406080100100.24100.42102.10102.76103.09103.19108.68109.11109.25

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamsmt asmt bcsmt dbano smt ano smt bsmt c306090120150121.92119.60113.51106.65104.29104.12101.01100.5196.17

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamsmt asmt bcsmt dbano smt ano smt bsmt c36912158.19148.35068.80049.36569.57939.59629.88999.939510.3852

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt ano smt bcba50010001500200025002255.422253.142245.802230.312204.752203.161013.741012.351009.85

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bno smt ano smt bsmt acba112233445542.4842.5542.6542.8142.8442.9547.2947.3547.46

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamabcno smt ano smt bsmt csmt dsmt asmt b4080120160200188.54181.81181.72166.27164.81163.71139.82139.10136.83

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamabcno smt ano smt bsmt csmt dsmt asmt b2468105.30185.49805.50076.01186.06506.10577.14907.18657.3054

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamsmt asmt bsmt csmt dno smt bno smt acba300600900120015001306.671306.581305.711301.181292.801291.97625.55619.94619.75

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamno smt ano smt bsmt asmt csmt bsmt dcba2040608010073.2073.2173.3173.3473.3573.6276.6277.3177.34

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streambcano smt bsmt bsmt dsmt csmt ano smt a4080120160200193.53193.31192.88155.74145.17141.47135.89132.87131.76

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streambcano smt bsmt bsmt dsmt csmt ano smt a2468105.16335.16965.18126.41746.88447.06407.35507.52257.5856

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamsmt dsmt csmt asmt bno smt ano smt bbac70140210280350316.03315.33314.62314.25308.43308.30149.82149.74149.69

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamsmt dsmt csmt ano smt bsmt bno smt abac70140210280350301.92303.25303.33303.74304.08304.21319.96319.98320.05

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streamcabno smt bsmt cno smt asmt asmt dsmt b142842567060.4960.2559.9248.9348.7748.1847.5146.7845.96

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streamcabno smt bsmt cno smt asmt asmt dsmt b51015202516.5216.5816.6720.4220.4920.7421.0321.3621.74

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamsmt csmt dsmt bsmt ano smt ano smt bcba140280420560700662.26660.21658.34658.21649.30647.76316.63316.29314.84

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamsmt csmt dsmt bno smt ano smt bsmt acba306090120150144.47144.91145.27145.35145.36145.40151.39151.60152.14

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Streamcbasmt asmt cno smt bno smt asmt bsmt d2040608010089.5589.3487.9673.2970.3869.3369.1168.2966.08

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Streamcbasmt asmt cno smt bno smt asmt bsmt d4812162011.1611.1911.3613.6414.2014.4214.4614.6415.13

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamsmt dno smt asmt bno smt bsmt asmt cacb2040608010097.8997.4097.3597.3497.2996.9142.9642.9242.83

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamno smt bno smt asmt dsmt bsmt asmt cbac2004006008001000955.34956.01966.76969.21970.22971.671116.291116.431117.73

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamcabno smt asmt dno smt bsmt bsmt asmt c81624324034.9934.9334.8231.3231.0731.0731.0130.9629.42

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamcabno smt asmt dno smt bsmt bsmt asmt c81624324028.5728.6228.7131.9232.1832.1832.2432.3033.99

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_bareno smt asmt dsmt csmt bno smt bsmt abca51015202519.1819.0819.0519.0218.8418.8210.6110.5910.571. (CXX) g++ options: -O3

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUcbno smt bano smt asmt bsmt asmt dsmt c36912151.886861.923401.931262.015812.040037.422707.605668.260789.34981MIN: 1.68MIN: 1.72MIN: 1.77MIN: 1.81MIN: 1.78MIN: 6.44MIN: 6.54MIN: 7.09MIN: 7.731. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUbacno smt bno smt asmt asmt bsmt dsmt c0.81041.62082.43123.24164.0521.562571.564611.567422.123792.196453.391513.494533.505633.60194MIN: 1.41MIN: 1.41MIN: 1.39MIN: 1.9MIN: 2MIN: 2.93MIN: 3.11MIN: 3.19MIN: 3.081. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUabcno smt bno smt asmt bsmt asmt csmt d36912153.114974.278584.397204.793024.878837.3014711.4326012.0130012.15710MIN: 2.47MIN: 3.37MIN: 3.21MIN: 3.4MIN: 3.53MIN: 5.77MIN: 7.59MIN: 8.02MIN: 8.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUbacno smt ano smt bsmt bsmt dsmt asmt c0.2240.4480.6720.8961.120.5130680.5344500.5469910.5560690.6290260.9717040.9750910.9753570.995710MIN: 0.47MIN: 0.49MIN: 0.5MIN: 0.46MIN: 0.51MIN: 0.82MIN: 0.91MIN: 0.92MIN: 0.871. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUcno smt ano smt babsmt dsmt asmt csmt b5101520253.830176.192577.988618.745769.1957011.7573015.4210018.6594019.54900MIN: 2.72MIN: 3.65MIN: 3.88MIN: 3.65MIN: 4.13MIN: 8.17MIN: 10.4MIN: 11.23MIN: 10.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUcbano smt ano smt bsmt dsmt csmt asmt b0.80921.61842.42763.23684.0461.638601.729751.877772.022862.028332.974273.365353.388333.59643MIN: 1.2MIN: 1.27MIN: 1.23MIN: 1.56MIN: 1.43MIN: 2.3MIN: 2.7MIN: 2.76MIN: 2.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUno smt bno smt asmt asmt csmt bsmt dbca0.1560.3120.4680.6240.780.4003250.4035900.5385390.5451180.5517830.6306300.6890640.6926670.693367MIN: 0.38MIN: 0.38MIN: 0.48MIN: 0.45MIN: 0.49MIN: 0.48MIN: 0.64MIN: 0.65MIN: 0.641. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUbacno smt ano smt bsmt asmt bsmt dsmt c5101520257.282437.357467.381169.252929.3175120.2695020.5720020.9726021.03010MIN: 6.58MIN: 4.85MIN: 6.77MIN: 7.79MIN: 8.07MIN: 17.68MIN: 18.25MIN: 18.21MIN: 17.961. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUno smt bno smt asmt csmt bsmt dsmt abca0.26330.52660.78991.05321.31650.6513010.6642950.9728630.9735550.9739840.9785901.1669601.1691901.170040MIN: 0.62MIN: 0.63MIN: 0.92MIN: 0.92MIN: 0.92MIN: 0.93MIN: 1.07MIN: 1.07MIN: 1.071. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUno smt ano smt bacbsmt dsmt csmt asmt b0.09180.18360.27540.36720.4590.2548450.2557960.3114050.3122890.3127210.3892230.3943770.4074300.408074MIN: 0.18MIN: 0.18MIN: 0.3MIN: 0.28MIN: 0.28MIN: 0.29MIN: 0.29MIN: 0.27MIN: 0.271. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUbacno smt ano smt bsmt bsmt asmt csmt d0.27750.5550.83251.111.38750.5519660.5552770.5568510.6643590.6705741.1813501.2004901.2014601.233400MIN: 0.49MIN: 0.53MIN: 0.53MIN: 0.56MIN: 0.55MIN: 1.08MIN: 1.04MIN: 1.08MIN: 1.081. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUno smt ano smt bsmt dsmt csmt asmt bacb0.06880.13760.20640.27520.3440.1603610.1648450.2478250.2759170.2796380.2910870.3049720.3055990.305731MIN: 0.15MIN: 0.15MIN: 0.23MIN: 0.23MIN: 0.23MIN: 0.23MIN: 0.28MIN: 0.28MIN: 0.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUbcano smt bno smt asmt csmt bsmt asmt d400800120016002000903.27906.14907.491124.751148.261888.211890.281912.161957.77MIN: 894.76MIN: 898.41MIN: 897.95MIN: 1091.36MIN: 1108.42MIN: 1860.29MIN: 1864.29MIN: 1891.03MIN: 1929.471. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUcbano smt bno smt asmt csmt bsmt asmt d7001400210028003500669.15671.65674.09901.04930.263011.213034.623187.003349.36MIN: 661.71MIN: 664.19MIN: 667.01MIN: 864.28MIN: 898.89MIN: 2853.26MIN: 2821.2MIN: 3034.82MIN: 3325.751. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUabcno smt bno smt asmt asmt dsmt csmt b400800120016002000911.25912.11915.081119.171151.251830.411883.761926.151937.65MIN: 903.01MIN: 902.43MIN: 906.26MIN: 1086.08MIN: 1070.35MIN: 1807.97MIN: 1850.75MIN: 1901.09MIN: 1908.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUno smt bno smt aacsmt csmt bsmt asmt db0.13020.26040.39060.52080.6510.2912290.2916870.4154460.4171880.4478200.4502610.4514720.4575540.578466MIN: 0.27MIN: 0.27MIN: 0.4MIN: 0.4MIN: 0.37MIN: 0.37MIN: 0.4MIN: 0.34MIN: 0.41. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUno smt ano smt bcabsmt dsmt csmt asmt b0.62131.24261.86392.48523.10651.650411.700571.822641.831471.841722.673032.702352.708072.76140MIN: 1.41MIN: 1.5MIN: 1.71MIN: 1.73MIN: 1.76MIN: 2.09MIN: 2.27MIN: 2.09MIN: 2.461. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUno smt bno smt asmt asmt bsmt csmt dcab0.16030.32060.48090.64120.80150.4611740.4623860.6725850.6727680.6767980.6803950.7085630.7115880.712495MIN: 0.43MIN: 0.42MIN: 0.52MIN: 0.53MIN: 0.53MIN: 0.53MIN: 0.67MIN: 0.68MIN: 0.681. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUbcano smt bno smt asmt csmt dsmt bsmt a7001400210028003500670.20671.23671.69903.36913.203153.223171.153249.283269.05MIN: 663.54MIN: 662.9MIN: 664.46MIN: 874.93MIN: 884.92MIN: 3059.88MIN: 3148.29MIN: 3226.78MIN: 3243.111. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUno smt ano smt bcbasmt dsmt asmt bsmt c0.15210.30420.45630.60840.76050.3428360.3472310.3531750.3568750.3570170.6721150.6744550.6756640.676124MIN: 0.28MIN: 0.3MIN: 0.31MIN: 0.31MIN: 0.31MIN: 0.49MIN: 0.49MIN: 0.55MIN: 0.491. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUacbno smt bno smt asmt asmt bsmt dsmt c400800120016002000909.69911.76917.081139.631147.341888.101894.071912.741925.68MIN: 901.1MIN: 901.88MIN: 909.14MIN: 1100.83MIN: 1109.85MIN: 1865.76MIN: 1870.66MIN: 1890.93MIN: 1901.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUcbano smt bno smt asmt asmt dsmt csmt b7001400210028003500667.95668.95675.92939.55973.323133.653172.193185.643222.93MIN: 660.93MIN: 662.29MIN: 668.99MIN: 904.78MIN: 937.3MIN: 3037.06MIN: 3155.85MIN: 2949.58MIN: 2927.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUcbano smt bno smt asmt asmt csmt bsmt d0.13560.27120.40680.54240.6780.2629200.2633730.2639970.2935640.3166650.5917380.5932990.6001990.602831MIN: 0.2MIN: 0.2MIN: 0.18MIN: 0.22MIN: 0.24MIN: 0.43MIN: 0.39MIN: 0.38MIN: 0.481. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUcabno smt ano smt bsmt bsmt asmt dsmt c0.14290.28580.42870.57160.71450.2854320.2902000.2913870.3167790.3404980.6209070.6217760.6271330.634992MIN: 0.24MIN: 0.25MIN: 0.23MIN: 0.25MIN: 0.28MIN: 0.41MIN: 0.45MIN: 0.4MIN: 0.551. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUsmt csmt dno smt ano smt bsmt asmt bcba20406080100109.36109.23109.08109.04108.93108.8949.7749.7249.721. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUsmt csmt dno smt ano smt bsmt asmt bacb2004006008001000437.51437.68438.29438.99439.41439.50962.10962.15962.63MIN: 400.05 / MAX: 473.91MIN: 394.89 / MAX: 478.58MIN: 416.93 / MAX: 496.86MIN: 427.57 / MAX: 484.31MIN: 410.81 / MAX: 465.4MIN: 424.22 / MAX: 477.66MIN: 879.24 / MAX: 1018.81MIN: 888.7 / MAX: 1017.92MIN: 893.43 / MAX: 1015.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUsmt csmt dsmt asmt bno smt ano smt babc132639526558.0558.0057.7257.6757.5857.4928.4728.4228.331. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUsmt csmt dsmt bsmt ano smt ano smt babc400800120016002000821.93822.50827.03827.07828.67830.041671.461675.961679.03MIN: 725.25 / MAX: 1010.56MIN: 717.65 / MAX: 997.43MIN: 723.77 / MAX: 1003.25MIN: 724.84 / MAX: 1037.91MIN: 730.29 / MAX: 1036.1MIN: 722.6 / MAX: 1015.67MIN: 924.15 / MAX: 1977.46MIN: 1231.52 / MAX: 1967.75MIN: 865.58 / MAX: 1995.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUsmt csmt dsmt bsmt ano smt bno smt abac132639526557.7157.6257.3157.2957.1957.1828.2327.9727.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUsmt csmt dsmt bsmt ano smt ano smt bbac400800120016002000826.67828.01832.70833.15833.99834.171685.261701.701704.02MIN: 724.1 / MAX: 1006.75MIN: 716.19 / MAX: 1018.34MIN: 723.65 / MAX: 1031.69MIN: 725.84 / MAX: 1017.38MIN: 723.91 / MAX: 1011.94MIN: 732.01 / MAX: 1006.46MIN: 891.16 / MAX: 1979.37MIN: 1395.71 / MAX: 2063.97MIN: 828.99 / MAX: 1969.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUsmt csmt dno smt bno smt asmt asmt bcba2K4K6K8K10K7993.187990.477979.827979.057953.217949.053174.043085.532941.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUsmt csmt dno smt ano smt bsmt asmt bcba481216205.996.006.016.016.026.0315.1015.5416.30MIN: 5.13 / MAX: 31.29MIN: 5.21 / MAX: 25.51MIN: 5.2 / MAX: 37.8MIN: 5.02 / MAX: 36.88MIN: 5.27 / MAX: 25.12MIN: 5.17 / MAX: 38.35MIN: 6.94 / MAX: 60.59MIN: 8.28 / MAX: 57.72MIN: 7.91 / MAX: 51.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUsmt cno smt bsmt dno smt asmt bsmt aacb50100150200250210.19210.14209.24208.82208.19208.1395.7695.5995.481. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUsmt cno smt bsmt dno smt asmt bsmt aacb110220330440550227.93228.01228.94229.46230.06230.21499.32500.30500.83MIN: 210.46 / MAX: 252.96MIN: 212.99 / MAX: 267.17MIN: 214.92 / MAX: 248.29MIN: 217.93 / MAX: 265.81MIN: 210.58 / MAX: 251.42MIN: 211.56 / MAX: 253.58MIN: 264.54 / MAX: 537.26MIN: 410.04 / MAX: 531.93MIN: 418.76 / MAX: 546.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUsmt dsmt cno smt bno smt asmt asmt bacb3K6K9K12K15K12172.9212168.0512128.3812119.6612117.1612109.645908.895898.795894.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUsmt csmt dno smt ano smt bsmt asmt babc2468103.933.933.953.953.953.968.118.138.13MIN: 3.61 / MAX: 42.82MIN: 3.61 / MAX: 23.62MIN: 3.61 / MAX: 38MIN: 3.68 / MAX: 42.53MIN: 3.61 / MAX: 34.38MIN: 3.66 / MAX: 32.83MIN: 5.39 / MAX: 69.87MIN: 5.35 / MAX: 55.84MIN: 3.83 / MAX: 59.871. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUsmt csmt dno smt ano smt bsmt bsmt abac2K4K6K8K10K10603.8410587.3010556.9310549.2410549.1510544.034915.424914.174910.131. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUsmt csmt dno smt ano smt bsmt asmt bbac36912154.524.524.544.544.544.549.759.769.76MIN: 4.12 / MAX: 33.17MIN: 4.03 / MAX: 45.52MIN: 4.12 / MAX: 27.91MIN: 4.09 / MAX: 55.78MIN: 4.07 / MAX: 35.16MIN: 4.11 / MAX: 42.14MIN: 5.25 / MAX: 35.53MIN: 5.03 / MAX: 28.1MIN: 4.98 / MAX: 36.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUsmt csmt dsmt bsmt ano smt bno smt abac20040060080010001058.571057.741050.371049.161048.741045.81541.03540.41535.781. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUsmt csmt dsmt bsmt ano smt bno smt abac2040608010045.3145.3445.6645.7145.7345.8688.6188.7189.46MIN: 39.35 / MAX: 73.19MIN: 39.4 / MAX: 73.83MIN: 38.82 / MAX: 75.65MIN: 39.78 / MAX: 73.33MIN: 39.68 / MAX: 86.83MIN: 39.29 / MAX: 91.13MIN: 47.57 / MAX: 124.67MIN: 44.2 / MAX: 132.86MIN: 42.16 / MAX: 123.41. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUno smt bno smt asmt csmt dsmt bsmt abac4K8K12K16K20K20849.7520836.1020684.2920679.6820610.6220610.239496.959494.229485.651. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUno smt ano smt bsmt csmt dsmt asmt babc36912159.189.189.259.269.289.2810.1010.1010.11MIN: 8.17 / MAX: 31.1MIN: 8.21 / MAX: 24.31MIN: 8.12 / MAX: 19.04MIN: 8.12 / MAX: 30.29MIN: 8.1 / MAX: 22.87MIN: 8.13 / MAX: 24.28MIN: 5.46 / MAX: 35.41MIN: 5.47 / MAX: 28.16MIN: 5.43 / MAX: 36.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUno smt asmt csmt dno smt bsmt asmt bacb2K4K6K8K10K9784.099773.269767.999758.749746.089680.445750.745724.815720.901. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUno smt asmt cno smt bsmt dsmt asmt bacb2468104.904.904.914.914.924.958.348.378.38MIN: 4.46 / MAX: 56.52MIN: 4.5 / MAX: 29.95MIN: 4.49 / MAX: 34.72MIN: 4.51 / MAX: 27.27MIN: 4.52 / MAX: 34.8MIN: 4.54 / MAX: 24.23MIN: 6.61 / MAX: 55.54MIN: 6.83 / MAX: 50.24MIN: 6.4 / MAX: 32.331. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUsmt bsmt asmt csmt dno smt bno smt aacb40K80K120K160K200K175754.35173926.92173620.31172228.34162294.47160545.41112346.36112186.25111378.391. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUsmt asmt bsmt csmt dno smt ano smt babc0.14850.2970.44550.5940.74250.530.530.530.530.570.580.650.660.66MIN: 0.5 / MAX: 24.2MIN: 0.5 / MAX: 9.61MIN: 0.5 / MAX: 9.15MIN: 0.5 / MAX: 8.86MIN: 0.5 / MAX: 13.02MIN: 0.5 / MAX: 12.8MIN: 0.32 / MAX: 20.68MIN: 0.32 / MAX: 19.99MIN: 0.31 / MAX: 22.671. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUsmt dsmt asmt csmt bno smt ano smt bacb30K60K90K120K150K149647.68148316.88148047.13147582.87127833.52127770.3974495.1774486.0874353.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUsmt csmt asmt bsmt dno smt ano smt babc0.24530.49060.73590.98121.22650.960.970.970.971.011.011.091.091.09MIN: 0.87 / MAX: 9.72MIN: 0.87 / MAX: 9.78MIN: 0.87 / MAX: 10.96MIN: 0.86 / MAX: 13.31MIN: 0.86 / MAX: 8.97MIN: 0.86 / MAX: 8.72MIN: 0.49 / MAX: 19.01MIN: 0.48 / MAX: 25.82MIN: 0.49 / MAX: 22.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.0Time To Compilesmt bsmt dsmt asmt cno smt ano smt bbca369121510.2610.3710.3810.4110.6010.6612.4312.4712.57

Zstd Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Compression Speedbcano smt bno smt asmt asmt csmt dsmt b70014002100280035003095.03049.43033.92865.92804.22795.12604.62528.72513.41. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Decompression Speedsmt bcbsmt csmt aasmt dno smt bno smt a300600900120015001519.11517.41516.61516.21515.61514.81513.51511.51500.41. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Compression Speedcbno smt bano smt asmt bsmt dsmt asmt c300600900120015001241.11239.31234.21233.81227.51122.41024.81023.91005.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Decompression Speedsmt bno smt aano smt bsmt asmt dsmt ccb4008001200160020001671.01669.71669.31667.61664.31664.21664.01661.91651.01. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 12 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Compression Speedbacno smt ano smt bsmt bsmt dsmt asmt c70140210280350332.0330.8330.1279.9278.2259.1256.2254.1249.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 12 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Decompression Speedsmt csmt dno smt ano smt bsmt bsmt abca4008001200160020001732.31731.21728.01727.81726.31723.71716.71715.61704.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression Speedno smt bno smt asmt dsmt bsmt ccbasmt a51015202519.819.819.619.519.219.119.119.118.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression Speedsmt ano smt bsmt bno smt asmt dsmt cacb300600900120015001495.21483.81483.51483.11479.11475.21472.61470.51467.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 3, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Compression Speedsmt dsmt asmt csmt bno smt bno smt acba20040060080010001059.01051.41046.61038.91032.3955.6916.9909.4892.71. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 3, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Decompression Speedsmt dno smt asmt ccsmt bsmt ano smt bba300600900120015001543.61542.51540.91540.91540.41539.51538.81537.51536.61. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Compression Speedacbno smt bsmt dsmt cno smt asmt asmt b2004006008001000938.5926.9910.8892.0879.6860.8859.9853.8852.71. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Decompression Speedno smt asmt cno smt bsmt aasmt dsmt bcb4008001200160020001684.81683.71682.81682.51677.91677.61676.51675.41673.71. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression Speedsmt bsmt csmt dsmt ano smt bno smt acba36912159.879.829.819.789.769.399.309.299.221. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression Speedno smt bno smt asmt asmt bsmt dsmt ccab300600900120015001397.61395.81393.51392.41391.71389.01384.01383.71378.21. (CC) gcc options: -O3 -pthread -lz

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigsmt bsmt csmt dsmt ano smt bno smt acba61218243017.0217.0517.0817.3817.5917.6125.6825.7525.77

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Slowsmt bsmt dsmt csmt ano smt bno smt abca153045607566.2266.0865.4964.6347.4347.1340.8640.7640.631. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Mediumsmt bsmt csmt asmt dno smt ano smt bcab153045607565.6965.5965.5665.4947.9747.9341.4741.4041.391. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Slowno smt bno smt acabsmt bsmt csmt dsmt a4080120160200159.79155.56140.10139.92139.07136.33135.80135.56132.671. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Mediumno smt bno smt abcasmt csmt asmt bsmt d4080120160200161.40159.63144.21143.81143.31140.89140.78138.33136.421. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very Fastbacsmt asmt bsmt csmt dno smt ano smt b2040608010081.6180.9080.3175.9174.1173.5773.2470.0269.941. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fastcabsmt csmt bsmt asmt dno smt ano smt b2040608010084.5581.9080.6878.7276.7076.6475.5075.5074.031. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fastbacsmt dsmt asmt bsmt cno smt ano smt b2040608010084.7783.4582.7078.8577.9677.0076.1476.0574.371. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very Fastacbsmt bsmt dno smt ano smt bsmt asmt c60120180240300296.93291.03290.59274.63270.76269.62268.77250.71243.361. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super Fastabcsmt ano smt asmt cno smt bsmt bsmt d70140210280350307.49303.99301.40296.72288.41288.09280.18267.04256.451. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra Fastacbsmt dsmt csmt asmt bno smt ano smt b70140210280350310.73309.64305.52303.63303.43302.55295.18278.62271.451. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

VP9 libvpx Encoding

Speed: Speed 0 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 0 - Input: Bosphorus 4Kbcasmt ano smt bsmt dno smt asmt bsmt c2468107.717.707.687.247.167.157.046.976.921. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 4Kcbasmt csmt dno smt bno smt asmt bsmt a4812162017.4617.3717.3615.3815.1114.5014.4814.2713.901. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VP9 libvpx Encoding

Speed: Speed 0 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 0 - Input: Bosphorus 1080pcabno smt asmt asmt cno smt bsmt dsmt b4812162014.7614.6914.6714.2814.0813.9713.7213.6813.571. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 1080pno smt bsmt dno smt asmt bsmt csmt abca71421283529.7129.6629.6229.6029.5429.5429.5029.4629.371. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

uvg266

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Slowsmt csmt dsmt bsmt ano smt bno smt acab112233445546.3446.2546.2545.5634.6834.5929.4129.3729.29

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Mediumsmt asmt bsmt csmt dno smt bno smt abca112233445547.5646.6246.5746.2138.6538.3833.1333.1033.03

uvg266

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Slowno smt bno smt abacsmt asmt dsmt bsmt c2040608010088.1387.1581.4181.1681.1080.1780.0079.9579.63

uvg266

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Mediumno smt ano smt bbacsmt bsmt asmt csmt d2040608010098.2196.6791.4791.3791.2989.7089.4089.1688.91

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very Fastcabsmt ano smt bsmt bsmt dsmt cno smt a153045607569.0468.8268.7959.3058.0957.8657.5257.4457.13

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fastcabno smt asmt bsmt asmt dsmt cno smt b163248648069.9269.3369.0059.8359.2059.0658.6658.3458.33

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fastcbasmt dsmt ano smt asmt bsmt cno smt b163248648071.1370.6870.5658.7657.9657.7857.5157.3357.23

uvg266

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very Fastcabsmt bno smt asmt csmt ano smt bsmt d50100150200250237.44234.95234.68209.55196.25192.25183.99183.75181.83

uvg266

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super Fastbacsmt bsmt dno smt bno smt asmt csmt a50100150200250239.92238.68237.96220.79218.91216.15181.67178.78178.49

uvg266

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra Fastabcsmt dsmt csmt ano smt bno smt asmt b50100150200250240.98240.91238.77224.31218.28216.15209.85186.24179.56

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fastno smt bno smt aabc1.32642.65283.97925.30566.6325.8955.8905.8205.8095.8081. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fasterno smt acbano smt b369121512.4812.4012.3912.3412.311. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 1080p - Video Preset: Fastcabno smt bno smt a369121512.4412.4412.4012.3712.361. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 1080p - Video Preset: Fastercabno smt ano smt b71421283530.0830.0429.8528.6928.521. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCsmt asmt bsmt dsmt cno smt bno smt aabc30060090012001500131812431238123511081098108910751066MIN: 391 / MAX: 3855MIN: 390 / MAX: 3501MIN: 392 / MAX: 3738MIN: 392 / MAX: 4332MIN: 297 / MAX: 4208MIN: 297 / MAX: 4284MIN: 179 / MAX: 7194MIN: 179 / MAX: 6442MIN: 180 / MAX: 6427

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark Scalarsmt bsmt csmt dsmt ano smt bno smt abac2004006008001000810793781764652647557556549MIN: 138 / MAX: 3650MIN: 139 / MAX: 3583MIN: 139 / MAX: 3776MIN: 139 / MAX: 3808MIN: 102 / MAX: 3990MIN: 101 / MAX: 4024MIN: 61 / MAX: 6019MIN: 61 / MAX: 5994MIN: 60 / MAX: 5475

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cacheno smt ano smt bcbasmt bsmt asmt dsmt c140280420560700635.48622.73614.24610.79600.70516.09500.13500.12495.85MIN: 85.35 / MAX: 6000MIN: 83.22 / MAX: 5454.55MIN: 57.14 / MAX: 6666.67MIN: 58.14 / MAX: 6666.67MIN: 57.75 / MAX: 6000MIN: 89.55 / MAX: 6000MIN: 65.15 / MAX: 6000MIN: 69.61 / MAX: 6000MIN: 51.06 / MAX: 6000

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Runno smt ano smt bbacsmt bsmt csmt asmt d140280420560700666.43649.52627.20625.91621.88527.88524.75524.04515.11MIN: 85.11 / MAX: 6666.67MIN: 86.46 / MAX: 6000MIN: 58.54 / MAX: 6000MIN: 56.13 / MAX: 7500MIN: 58.54 / MAX: 6666.67MIN: 90.63 / MAX: 6666.67MIN: 90.23 / MAX: 6000MIN: 90.5 / MAX: 6666.67MIN: 88.5 / MAX: 6000

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Runno smt ano smt bcbasmt bsmt asmt csmt d140280420560700665.00662.01636.18628.37625.16538.63534.82530.47527.80MIN: 85.84 / MAX: 6000MIN: 86.33 / MAX: 6000MIN: 58.03 / MAX: 6666.67MIN: 58.37 / MAX: 6666.67MIN: 57.69 / MAX: 6000MIN: 89.82 / MAX: 6000MIN: 91.32 / MAX: 6000MIN: 92.02 / MAX: 5454.55MIN: 81.52 / MAX: 6000

Memcached

Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:5bcasmt dsmt asmt csmt bno smt bno smt a900K1800K2700K3600K4500K4162812.474155273.464143044.212527084.872520253.002517750.472507331.292460416.332444886.821. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Memcached

Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:10acbsmt dsmt csmt asmt bno smt ano smt b1.5M3M4.5M6M7.5M6861088.896839975.876792746.344569476.864549313.424530948.624392934.754244908.834220522.491. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Memcached

Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:100abcsmt dsmt csmt asmt bno smt bno smt a1000K2000K3000K4000K5000K4878860.004876951.364852421.674403267.424394194.494383314.654357453.763216133.913192061.681. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fillcbano smt ano smt bsmt asmt bsmt csmt d110K220K330K440K550K5365515346815339274786294682104230274178824160064154281. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Readsmt csmt dsmt bsmt ano smt bno smt aacb300M600M900M1200M1500M1234570512123191619712311680931225662852121354029912096110554682314344680697924668888881. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update Randombacno smt ano smt bsmt dsmt csmt asmt b120K240K360K480K600K5455565443845435724620184522284205144199854131994115131. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Sequential Fillbcano smt ano smt bsmt csmt asmt dsmt b120K240K360K480K600K5453965445655422564657004640444142824141684140474137081. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fill Syncsmt dsmt bsmt csmt aabcno smt ano smt b90K180K270K360K450K4044634012953948523880523766013730023569223506733440401. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read While Writingsmt asmt csmt bsmt dabcno smt bno smt a3M6M9M12M15M15317250139489141383068913098097929618586203528316379791356876438311. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read Random Write Randomacbno smt ano smt bsmt asmt bsmt dsmt c600K1200K1800K2400K3000K2926458291002328919622079804206383117876821761416175290416139131. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Phoronix Test Suite v10.8.4