9654 new

2 x AMD EPYC 9654 96-Core testing with a AMD Titanite_4G (RTI1004D BIOS) and llvmpipe on Red Hat Enterprise Linux 9.1 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2303114-NE-9654NEW5019&gru&rdt&rro.

9654 newProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionOpenGLabcno smt ano smt bsmt asmt bsmt csmt dAMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads)AMD Titanite_4G (RTI1004D BIOS)AMD Device 14a4768GB2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007ASPEEDVGA HDMIBroadcom NetXtreme BCM5720 PCIeRed Hat Enterprise Linux 9.15.14.0-162.6.1.el9_1.x86_64 (x86_64)GNOME Shell 40.10X Server 1.20.11GCC 11.3.1 20220421xfs1600x12002 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores)1520GBllvmpipe4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits)1024x7682 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Details- Python 3.9.14Security Details- a: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - b: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - c: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - no smt a: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - no smt b: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt a: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt b: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt c: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt d: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

9654 newstress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pollstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Forkingstress-ng: Pthreadstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: Function Callstress-ng: Memory Copyingstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 1080p - Super Fastkvazaar: Bosphorus 1080p - Ultra Fastuvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Ultra Fastvpxenc: Speed 0 - Bosphorus 4Kvpxenc: Speed 5 - Bosphorus 4Kvpxenc: Speed 0 - Bosphorus 1080pvpxenc: Speed 5 - Bosphorus 1080pvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastvvenc: Bosphorus 1080p - Fasteropenvkl: vklBenchmark ISPCopenvkl: vklBenchmark Scalardeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamcompress-zstd: 3 - Compression Speedcompress-zstd: 3 - Decompression Speedcompress-zstd: 8 - Compression Speedcompress-zstd: 8 - Decompression Speedcompress-zstd: 12 - Compression Speedcompress-zstd: 12 - Decompression Speedcompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 3, Long Mode - Compression Speedcompress-zstd: 3, Long Mode - Decompression Speedcompress-zstd: 8, Long Mode - Compression Speedcompress-zstd: 8, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedcompress-zstd: 19, Long Mode - Decompression Speedgromacs: MPI CPU - water_GMX50_barerocksdb: Rand Fillrocksdb: Rand Readrocksdb: Update Randrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While Writingrocksdb: Read Rand Write Randmemcached: 1:5memcached: 1:10memcached: 1:100clickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streambuild-ffmpeg: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigabcno smt ano smt bsmt asmt bsmt csmt d189549361663.08483.912653709.642794694.37518.4659479783.64174.72203073.15312709034.0558156.36109397.781950323.9677.51205134.8718128283.29382305.69556875.59621015.3420106.518873.5818941003.9716257100.251122.3910473084.0949.7228.4727.972941.4795.765908.894914.17540.419494.225750.74112346.3674495.1740.6341.4139.92143.3180.981.983.45296.93307.49310.7329.3733.0381.1691.3768.8269.3370.56234.95238.68240.987.6817.3614.6929.375.8212.33612.4430.039108955642.989334.82621566.564197.1018401.776699.1493440.8533104.11781009.8486188.5378619.7531192.8806149.744660.2522314.836187.963142.958134.92893033.91514.81233.81669.3330.81704.819.11472.6892.71536.6938.51677.99.221383.710.569533927468231434544384542256376601929618529264584143044.216861088.894878860600.70625.91625.162.015811.564613.114970.534458.745761.877770.6933677.357461.170040.3114050.5552770.304972907.489674.088911.2450.4154461.831470.711588671.690.357017909.691675.9150.2639970.2902962.11671.461701.716.3499.328.119.7688.7110.18.340.651.091115.760228.707730.59245.0715119.206710.0811108.67759.596247.4645.301877.33635.1812319.981516.5828152.137711.3621116.42628.623312.56925.76818955118.11664.75498.6712661687.462805836.52507.7460031543.97223.29203147.15314418461.0258664.97109356.781913590.7767.21217072.2718100474.36382304.04556797.27621003.9220340.48851.6516313126.8616168655.171132.3510471889.9749.7228.4228.233085.5395.485894.274915.42541.039496.955720.9111378.3974353.4140.8641.39139.07144.2181.6180.6884.77290.59303.99305.5229.2933.1381.4191.4768.796970.68234.68239.92240.917.7117.3714.6729.55.80912.39112.39929.845107555742.89735.09621573.7496196.5414401.205398.6175439.0373104.29081012.3494181.8123619.9442193.5305149.820759.9222316.290789.335542.834834.818930951516.61239.316513321716.719.11467.8909.41537.5910.81673.79.291378.210.609534681466888888545556545396373002862035228919624162812.476792746.344876951.36610.79627.20628.371.92341.562574.278580.5130689.19571.729750.6890647.282431.166960.3127210.5519660.305731903.272671.654912.1140.5784661.841720.712495670.2020.356875917.077668.9520.2633730.291387962.631675.961685.2615.54500.838.139.7588.6110.18.380.661.091118.438328.486630.46085.0859119.379910.136109.11299.579347.35325.49877.3055.1633319.964816.6745151.600311.18721116.289928.713712.43425.74918961773.181668.92478.0512676101.412794473.75507.9759929401.4183.33203095.44313768771.2664299.62109609.151891202.3797.04217304.1918088584.67382328.5556833.5621041.9320297.918876.116862185.5416537965.141125.8610475486.3949.7728.3327.893174.0495.595898.794910.13535.789485.655724.81112186.2574486.0840.7641.47140.1143.8180.3184.5582.7291.03301.4309.6429.4133.181.191.2969.0469.9271.13237.44237.96238.777.717.4614.7629.465.80812.39912.44130.081106654942.743335.11881571.8281197.6601400.042798.5922438.4372113.50571013.7357181.7243625.5512193.3119149.690560.4884316.628289.54742.915234.99373049.41517.41241.11661.9330.11715.619.11470.5916.91540.9926.91675.49.3138410.587536551468069792543572544565356922831637929100234155273.466839975.874852421.67614.24621.88636.181.886861.567424.39720.5469913.830171.63860.6926677.381161.169190.3122890.5568510.305599906.139669.146915.0840.4171881.822640.708563671.2330.353175911.762667.950.262920.285432962.151679.031704.0215.1500.38.139.7689.4610.118.370.661.091122.058428.468730.49115.0573119.702610.1384109.24678.800447.29425.500776.61815.1696320.050416.5185151.389911.16051117.732328.569812.46525.6827408413.14520.4820.5110458275.243746361.52303.5663581395.67400.03435615.35456657338.8443094.9668076.033284433.240.94328297.0413141129.68932248.18920216.27829106.6311342.698968.2847222624.4926755146.691978.87402514.74109.0857.5857.187979.05208.8212119.6610556.931045.8120836.19784.09160545.41127833.5247.1347.97155.56159.6370.0275.576.05269.62288.41278.6234.5938.3887.1598.2157.1359.8357.78196.25181.67186.247.0414.4814.2829.625.8912.47712.35728.689109864797.444231.91463107.2957191.2605813.983272.1298941.2443101.00952204.7533166.27251291.9733131.7586308.429448.1849649.30269.106397.399631.31872804.21500.41227.51669.7279.9172819.81483.1955.61542.5859.91684.89.391395.819.1754786291209611055462018465700350673764383120798042444886.824244908.833192061.68635.48666.43665.002.040032.196454.878830.5560696.192572.022860.403599.252920.6642950.2548450.6643590.1603611148.26930.2571151.250.2916871.650410.462386913.2010.3428361147.34973.3180.3166650.316779438.29828.67833.996.01229.463.954.5445.869.184.90.571.01955.163131.32730.42135.2262116.153213.8559100.24189.889942.8056.011873.19937.5856304.207520.7385145.354814.4638956.008831.922910.59717.60627422305.533591.7119.7810393402.013802292.6308.6765500297.73395.95437065.75456651508.0445685.2867451.33282827.555.84326819.7213192391.85925984.24920642.34829445.3810949.98924.144683906.6828009942.561963.757372780.72109.0457.4957.197979.82210.1412128.3810549.241048.7420849.759758.74162294.47127770.3947.4347.93159.79161.469.9474.0374.37268.77280.18271.4534.6838.6588.1396.6758.0958.3357.23183.75216.15209.857.1614.513.7229.715.89512.3112.37428.52110865297.383829.75443086.3591175.3199817.631371.8878938.9084100.5092203.1573164.81261292.8038155.7357308.303348.9257647.759669.326697.344131.072865.91511.51234.21667.6278.21727.819.81483.81032.31538.88921682.89.761397.618.8374682101213540299452228464044344040791356820638312460416.334220522.493216133.91622.73649.52662.011.931262.123794.793020.6290267.988612.028330.4003259.317510.6513010.2557960.6705740.1648451124.75901.0441119.170.2912291.700570.461174903.3580.3472311139.63939.5470.2935640.340498438.99830.04834.176.01228.013.954.5445.739.184.910.581.01955.238633.601230.64035.7015115.636913.9039100.41989.939542.83936.06573.20876.4174303.737720.4223145.362714.4178955.343832.177810.66217.58641966139.678360.7624.8215359471.732333781.39464.7136339636.91184.34466292.12634718750.4136266.0274978.514329963.2647.58487359.3920047519.05946032.881291689.331414423.6515914.18748.9912895047.7335687958.372564.4810103952.13108.9357.7257.297953.21208.1312117.1610544.031049.1620610.239746.08173926.92148316.8864.6365.56132.67140.7875.9176.6477.96250.71296.72302.5545.5647.5680.1789.459.359.0657.96183.99178.49216.157.2413.914.0829.54131876497.024931.75923114.6848188.5826817.753677.8827929.0246121.92322230.3099139.09731306.6677132.8655314.618647.506658.211173.292497.291630.95722795.11515.61023.91664.3254.11723.718.81495.21051.41539.5853.81682.59.781393.518.818423027122566285241319941416838805215317250178768225202534530948.624383314.65500.13524.04534.827.605663.3915111.43260.97535715.4213.388330.53853920.26950.978590.407431.200490.2796381912.1631871830.410.4514722.708070.6725853269.050.6744551888.13133.650.5917380.621776439.41827.07833.156.02230.213.954.5445.719.284.920.530.97972.516331.480530.74625.3004117.123312.8322103.08888.191442.95157.186573.3067.5225303.327221.0323145.396613.637970.220232.295610.38117.37641989522.689017.1224.7715341564.162396325.93564.05135855921.28186.64466609.22634995429.6636020.16180407.594329824.3844.38487987.3219927313.52946660.881291704.571413555.4415430.188750.6112221058.3435996976.132520.388586858.51108.8957.6757.317949.05208.1912109.6410549.151050.3720610.629680.44175754.35147582.8766.2265.69136.33138.3374.1176.777274.63267.04295.1846.2546.6279.9589.757.8659.257.51209.55220.79179.566.9714.2713.5729.6124381096.90631.78063114.4293188.4147822.155277.4096927.679119.59642245.8036136.83241306.5839145.1736314.245245.9642658.34168.292497.352831.00932513.41519.11122.41671259.11726.319.51483.51038.91540.4852.71676.59.871392.419.01541788212311680934115134137084012951383068917614162507331.294392934.754357453.76516.09527.88538.637.42273.494537.301470.97170419.5493.596430.55178320.5720.9735550.4080741.181350.2910871890.283034.621937.650.4502612.76140.6727683249.280.6756641894.073222.930.6001990.620907439.5827.03832.76.03230.063.964.5445.669.284.950.530.97975.50431.459330.75085.3053116.481312.9106103.19028.350642.65367.305473.34966.8844304.078221.7398145.274514.6356969.212232.241510.25917.01741972765.937633.1624.7915228320.072067499.58413.34138939958.5184.24468159.21639757070.5234917.3977834.394351871.1242.55490300.4819866440.86952461.481295970.281422505.5115077.698747.8312328933.6534602827.772517.268609357.68109.3658.0557.717993.18210.1912168.0510603.841058.5720684.299773.26173620.31148047.1365.4965.59135.8140.8973.5778.7276.14243.36288.09303.4346.3446.5779.6389.1657.4458.3457.33192.25178.78218.286.9215.3813.9729.54123579396.997531.92773132.3838189.4054818.603770.1418937.99296.17372253.1411163.71111305.7137135.8907315.331848.772662.258570.382896.907729.41632604.61516.21005.81664249.81732.319.21475.21046.61540.9860.81683.79.82138919.04541600612345705124199854142823948521394891416139132517750.474549313.424394194.49495.85524.75530.479.349813.6019412.0130.9957118.65943.365350.54511821.03010.9728630.3943771.201460.2759171888.213011.211926.150.447822.702350.6767983153.220.6761241925.683185.640.5932990.634992437.51821.93826.675.99227.933.934.5245.319.254.90.530.96971.898831.314630.57845.2773116.968914.2486102.099910.385242.55216.105773.34077.355303.254920.4884144.466114.2011971.667733.987910.40717.05341965286.067273.1924.7115403597.242077119.76394.49137579874.56182.8468006640853365.5434685.8591735.754351920.4240.56489998.7519842969.28951700.171300693.931425621.4413370.338864.7812728401.4536111781.822516.0912418451.71109.235857.627990.47209.2412172.9210587.31057.7420679.689767.99172228.34149647.6866.0865.49135.56136.4273.2475.578.85270.76256.45303.6346.2546.218088.9157.5258.6658.76181.83218.91224.317.1515.1113.6829.66123878196.716930.24943116.0909183.949816.756275.524931.8223106.65182255.422139.82411301.1811141.4705316.032846.7815660.213266.08397.890831.07272528.71513.51024.81664.2256.21731.219.61479.110591543.6879.61677.69.811391.719.07741542812319161974205144140474044631309809717529042527084.874569476.864403267.42500.118340751515.11527.808.260783.5056312.15710.97509111.75732.974270.6306320.97260.9739840.3892231.23340.2478251957.773349.361883.760.4575542.673030.6803953171.150.6721151912.743172.190.6028310.627133437.68822.5828.016228.943.934.5245.349.264.910.530.97974.98533.051430.72475.4341117.221913.2331102.76469.365642.47987.14973.61967.064301.919221.3593144.914415.126966.760632.175810.37317.079OpenBenchmarking.org

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Hashsmt dsmt csmt bsmt ano smt bno smt acba9M18M27M36M45M41965286.0641972765.9341989522.6841966139.6727422305.5327408413.1018961773.1818955118.1018954936.001. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: MMAPsmt dsmt csmt bsmt ano smt bno smt acba2K4K6K8K10K7273.197633.169017.128360.763591.714520.481668.921664.751663.081. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: NUMAsmt dsmt csmt bsmt ano smt bno smt acba11022033044055024.7124.7924.7724.8219.7820.51478.05498.67483.901. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Pollsmt dsmt csmt bsmt ano smt bno smt acba3M6M9M12M15M15403597.2415228320.0715341564.1615359471.7310393402.0110458275.2412676101.4112661687.4612653709.641. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Futexsmt dsmt csmt bsmt ano smt bno smt acba800K1600K2400K3200K4000K2077119.762067499.582396325.932333781.393802292.603746361.522794473.752805836.522794694.371. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: MEMFDsmt dsmt csmt bsmt ano smt bno smt acba120240360480600394.49413.34564.05464.70308.67303.56507.97507.74518.461. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Mutexsmt dsmt csmt bsmt ano smt bno smt acba30M60M90M120M150M137579874.56138939958.50135855921.28136339636.9165500297.7363581395.6759929401.4060031543.9759479783.641. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Atomicsmt dsmt csmt bsmt ano smt bno smt acba90180270360450182.80184.24186.64184.34395.95400.03183.33223.29174.721. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Cryptosmt dsmt csmt bsmt ano smt bno smt acba100K200K300K400K500K468006.00468159.21466609.22466292.12437065.75435615.35203095.44203147.15203073.151. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Mallocsmt dsmt csmt bsmt ano smt bno smt acba140M280M420M560M700M640853365.54639757070.52634995429.66634718750.41456651508.04456657338.84313768771.26314418461.02312709034.051. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Forkingsmt dsmt csmt bsmt ano smt bno smt acba14K28K42K56K70K34685.8534917.3936020.1636266.0245685.2843094.9664299.6258664.9758156.361. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Pthreadsmt dsmt csmt bsmt ano smt bno smt acba40K80K120K160K200K91735.7577834.39180407.5974978.5167451.3068076.03109609.15109356.78109397.781. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: SENDFILEsmt dsmt csmt bsmt ano smt bno smt acba900K1800K2700K3600K4500K4351920.424351871.124329824.384329963.263282827.503284433.201891202.371913590.771950323.961. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: CPU Cachesmt dsmt csmt bsmt ano smt bno smt acba2040608010040.5642.5544.3847.5855.8440.9497.0467.2177.511. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: CPU Stresssmt dsmt csmt bsmt ano smt bno smt acba110K220K330K440K550K489998.75490300.48487987.32487359.39326819.72328297.04217304.19217072.27205134.871. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Semaphoressmt dsmt csmt bsmt ano smt bno smt acba4M8M12M16M20M19842969.2819866440.8619927313.5220047519.0513192391.8513141129.6818088584.6718100474.3618128283.291. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Matrix Mathsmt dsmt csmt bsmt ano smt bno smt acba200K400K600K800K1000K951700.17952461.48946660.88946032.88925984.24932248.18382328.50382304.04382305.691. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Vector Mathsmt dsmt csmt bsmt ano smt bno smt acba300K600K900K1200K1500K1300693.931295970.281291704.571291689.33920642.34920216.27556833.50556797.27556875.591. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Function Callsmt dsmt csmt bsmt ano smt bno smt acba300K600K900K1200K1500K1425621.441422505.511413555.441414423.65829445.38829106.63621041.93621003.92621015.341. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Memory Copyingsmt dsmt csmt bsmt ano smt bno smt acba4K8K12K16K20K13370.3315077.6915430.1815914.1010949.9011342.6920297.9120340.4020106.511. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Socket Activitysmt dsmt csmt bsmt ano smt bno smt acba2K4K6K8K10K8864.788747.838750.618748.998924.108968.288876.108851.658873.581. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Context Switchingsmt dsmt csmt bsmt ano smt bno smt acba10M20M30M40M50M12728401.4512328933.6512221058.3412895047.7344683906.6847222624.4916862185.5416313126.8618941003.971. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Glibc C String Functionssmt dsmt csmt bsmt ano smt bno smt acba8M16M24M32M40M36111781.8234602827.7735996976.1335687958.3728009942.5626755146.6916537965.1416168655.1716257100.251. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Glibc Qsort Data Sortingsmt dsmt csmt bsmt ano smt bno smt acba60012001800240030002516.092517.262520.382564.481963.751978.801125.861132.351122.391. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: System V Message Passingsmt dsmt csmt bsmt ano smt bno smt acba3M6M9M12M15M12418451.718609357.688586858.5110103952.137372780.727402514.7410475486.3910471889.9710473084.091. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba20406080100109.23109.36108.89108.93109.04109.0849.7749.7249.721. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba132639526558.0058.0557.6757.7257.4957.5828.3328.4228.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba132639526557.6257.7157.3157.2957.1957.1827.8928.2327.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba2K4K6K8K10K7990.477993.187949.057953.217979.827979.053174.043085.532941.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba50100150200250209.24210.19208.19208.13210.14208.8295.5995.4895.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba3K6K9K12K15K12172.9212168.0512109.6412117.1612128.3812119.665898.795894.275908.891. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba2K4K6K8K10K10587.3010603.8410549.1510544.0310549.2410556.934910.134915.424914.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba20040060080010001057.741058.571050.371049.161048.741045.81535.78541.03540.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba4K8K12K16K20K20679.6820684.2920610.6220610.2320849.7520836.109485.659496.959494.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba2K4K6K8K10K9767.999773.269680.449746.089758.749784.095724.815720.905750.741. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba40K80K120K160K200K172228.34173620.31175754.35173926.92162294.47160545.41112186.25111378.39112346.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba30K60K90K120K150K149647.68148047.13147582.87148316.88127770.39127833.5274486.0874353.4174495.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Slowsmt dsmt csmt bsmt ano smt bno smt acba153045607566.0865.4966.2264.6347.4347.1340.7640.8640.631. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Mediumsmt dsmt csmt bsmt ano smt bno smt acba153045607565.4965.5965.6965.5647.9347.9741.4741.3941.401. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Slowsmt dsmt csmt bsmt ano smt bno smt acba4080120160200135.56135.80136.33132.67159.79155.56140.10139.07139.921. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Mediumsmt dsmt csmt bsmt ano smt bno smt acba4080120160200136.42140.89138.33140.78161.40159.63143.81144.21143.311. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very Fastsmt dsmt csmt bsmt ano smt bno smt acba2040608010073.2473.5774.1175.9169.9470.0280.3181.6180.901. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fastsmt dsmt csmt bsmt ano smt bno smt acba2040608010075.5078.7276.7076.6474.0375.5084.5580.6881.901. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fastsmt dsmt csmt bsmt ano smt bno smt acba2040608010078.8576.1477.0077.9674.3776.0582.7084.7783.451. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very Fastsmt dsmt csmt bsmt ano smt bno smt acba60120180240300270.76243.36274.63250.71268.77269.62291.03290.59296.931. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super Fastsmt dsmt csmt bsmt ano smt bno smt acba70140210280350256.45288.09267.04296.72280.18288.41301.40303.99307.491. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra Fastsmt dsmt csmt bsmt ano smt bno smt acba70140210280350303.63303.43295.18302.55271.45278.62309.64305.52310.731. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Slowsmt dsmt csmt bsmt ano smt bno smt acba112233445546.2546.3446.2545.5634.6834.5929.4129.2929.37

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Mediumsmt dsmt csmt bsmt ano smt bno smt acba112233445546.2146.5746.6247.5638.6538.3833.1033.1333.03

uvg266

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Slowsmt dsmt csmt bsmt ano smt bno smt acba2040608010080.0079.6379.9580.1788.1387.1581.1081.4181.16

uvg266

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Mediumsmt dsmt csmt bsmt ano smt bno smt acba2040608010088.9189.1689.7089.4096.6798.2191.2991.4791.37

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very Fastsmt dsmt csmt bsmt ano smt bno smt acba153045607557.5257.4457.8659.3058.0957.1369.0468.7968.82

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fastsmt dsmt csmt bsmt ano smt bno smt acba163248648058.6658.3459.2059.0658.3359.8369.9269.0069.33

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fastsmt dsmt csmt bsmt ano smt bno smt acba163248648058.7657.3357.5157.9657.2357.7871.1370.6870.56

uvg266

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very Fastsmt dsmt csmt bsmt ano smt bno smt acba50100150200250181.83192.25209.55183.99183.75196.25237.44234.68234.95

uvg266

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super Fastsmt dsmt csmt bsmt ano smt bno smt acba50100150200250218.91178.78220.79178.49216.15181.67237.96239.92238.68

uvg266

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra Fastsmt dsmt csmt bsmt ano smt bno smt acba50100150200250224.31218.28179.56216.15209.85186.24238.77240.91240.98

VP9 libvpx Encoding

Speed: Speed 0 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 0 - Input: Bosphorus 4Ksmt dsmt csmt bsmt ano smt bno smt acba2468107.156.926.977.247.167.047.707.717.681. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 4Ksmt dsmt csmt bsmt ano smt bno smt acba4812162015.1115.3814.2713.9014.5014.4817.4617.3717.361. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VP9 libvpx Encoding

Speed: Speed 0 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 0 - Input: Bosphorus 1080psmt dsmt csmt bsmt ano smt bno smt acba4812162013.6813.9713.5714.0813.7214.2814.7614.6714.691. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 1080psmt dsmt csmt bsmt ano smt bno smt acba71421283529.6629.5429.6029.5429.7129.6229.4629.5029.371. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fastno smt bno smt acba1.32642.65283.97925.30566.6325.8955.8905.8085.8095.8201. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fasterno smt bno smt acba369121512.3112.4812.4012.3912.341. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 1080p - Video Preset: Fastno smt bno smt acba369121512.3712.3612.4412.4012.441. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 1080p - Video Preset: Fasterno smt bno smt acba71421283528.5228.6930.0829.8530.041. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCsmt dsmt csmt bsmt ano smt bno smt acba30060090012001500123812351243131811081098106610751089MIN: 392 / MAX: 3738MIN: 392 / MAX: 4332MIN: 390 / MAX: 3501MIN: 391 / MAX: 3855MIN: 297 / MAX: 4208MIN: 297 / MAX: 4284MIN: 180 / MAX: 6427MIN: 179 / MAX: 6442MIN: 179 / MAX: 7194

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark Scalarsmt dsmt csmt bsmt ano smt bno smt acba2004006008001000781793810764652647549557556MIN: 139 / MAX: 3776MIN: 139 / MAX: 3583MIN: 138 / MAX: 3650MIN: 139 / MAX: 3808MIN: 102 / MAX: 3990MIN: 101 / MAX: 4024MIN: 60 / MAX: 5475MIN: 61 / MAX: 6019MIN: 61 / MAX: 5994

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba2040608010096.7297.0096.9197.0297.3897.4442.7442.9042.99

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba81624324030.2531.9331.7831.7629.7531.9135.1235.1034.83

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba70014002100280035003116.093132.383114.433114.683086.363107.301571.831573.751566.56

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba4080120160200183.95189.41188.41188.58175.32191.26197.66196.54197.10

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba2004006008001000816.76818.60822.16817.75817.63813.98400.04401.21401.78

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba2040608010075.5270.1477.4177.8871.8972.1398.5998.6299.15

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba2004006008001000931.82937.99927.68929.02938.91941.24438.44439.04440.85

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba306090120150106.6596.17119.60121.92100.51101.01113.51104.29104.12

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba50010001500200025002255.422253.142245.802230.312203.162204.751013.741012.351009.85

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba4080120160200139.82163.71136.83139.10164.81166.27181.72181.81188.54

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba300600900120015001301.181305.711306.581306.671292.801291.97625.55619.94619.75

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba4080120160200141.47135.89145.17132.87155.74131.76193.31193.53192.88

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba70140210280350316.03315.33314.25314.62308.30308.43149.69149.82149.74

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba142842567046.7848.7745.9647.5148.9348.1860.4959.9260.25

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba140280420560700660.21662.26658.34658.21647.76649.30316.63316.29314.84

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba2040608010066.0870.3868.2973.2969.3369.1189.5589.3487.96

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba2040608010097.8996.9197.3597.2997.3497.4042.9242.8342.96

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba81624324031.0729.4231.0130.9631.0731.3234.9934.8234.93

Zstd Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Compression Speedsmt dsmt csmt bsmt ano smt bno smt acba70014002100280035002528.72604.62513.42795.12865.92804.23049.43095.03033.91. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Decompression Speedsmt dsmt csmt bsmt ano smt bno smt acba300600900120015001513.51516.21519.11515.61511.51500.41517.41516.61514.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Compression Speedsmt dsmt csmt bsmt ano smt bno smt acba300600900120015001024.81005.81122.41023.91234.21227.51241.11239.31233.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Decompression Speedsmt dsmt csmt bsmt ano smt bno smt acba4008001200160020001664.21664.01671.01664.31667.61669.71661.91651.01669.31. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 12 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Compression Speedsmt dsmt csmt bsmt ano smt bno smt acba70140210280350256.2249.8259.1254.1278.2279.9330.1332.0330.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 12 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Decompression Speedsmt dsmt csmt bsmt ano smt bno smt acba4008001200160020001731.21732.31726.31723.71727.81728.01715.61716.71704.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression Speedsmt dsmt csmt bsmt ano smt bno smt acba51015202519.619.219.518.819.819.819.119.119.11. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression Speedsmt dsmt csmt bsmt ano smt bno smt acba300600900120015001479.11475.21483.51495.21483.81483.11470.51467.81472.61. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 3, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Compression Speedsmt dsmt csmt bsmt ano smt bno smt acba20040060080010001059.01046.61038.91051.41032.3955.6916.9909.4892.71. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 3, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Decompression Speedsmt dsmt csmt bsmt ano smt bno smt acba300600900120015001543.61540.91540.41539.51538.81542.51540.91537.51536.61. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Compression Speedsmt dsmt csmt bsmt ano smt bno smt acba2004006008001000879.6860.8852.7853.8892.0859.9926.9910.8938.51. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Decompression Speedsmt dsmt csmt bsmt ano smt bno smt acba4008001200160020001677.61683.71676.51682.51682.81684.81675.41673.71677.91. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression Speedsmt dsmt csmt bsmt ano smt bno smt acba36912159.819.829.879.789.769.399.309.299.221. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression Speedsmt dsmt csmt bsmt ano smt bno smt acba300600900120015001391.71389.01392.41393.51397.61395.81384.01378.21383.71. (CC) gcc options: -O3 -pthread -lz

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_baresmt dsmt csmt bsmt ano smt bno smt acba51015202519.0819.0519.0218.8218.8419.1810.5910.6110.571. (CXX) g++ options: -O3

RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fillsmt dsmt csmt bsmt ano smt bno smt acba110K220K330K440K550K4154284160064178824230274682104786295365515346815339271. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Readsmt dsmt csmt bsmt ano smt bno smt acba300M600M900M1200M1500M1231916197123457051212311680931225662852121354029912096110554680697924668888884682314341. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update Randomsmt dsmt csmt bsmt ano smt bno smt acba120K240K360K480K600K4205144199854115134131994522284620185435725455565443841. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Sequential Fillsmt dsmt csmt bsmt ano smt bno smt acba120K240K360K480K600K4140474142824137084141684640444657005445655453965422561. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fill Syncsmt dsmt csmt bsmt ano smt bno smt acba90K180K270K360K450K4044633948524012953880523440403506733569223730023766011. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read While Writingsmt dsmt csmt bsmt ano smt bno smt acba3M6M9M12M15M13098097139489141383068915317250791356876438318316379862035292961851. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read Random Write Randomsmt dsmt csmt bsmt ano smt bno smt acba600K1200K1800K2400K3000K1752904161391317614161787682206383120798042910023289196229264581. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Memcached

Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:5smt dsmt csmt bsmt ano smt bno smt acba900K1800K2700K3600K4500K2527084.872517750.472507331.292520253.002460416.332444886.824155273.464162812.474143044.211. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Memcached

Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:10smt dsmt csmt bsmt ano smt bno smt acba1.5M3M4.5M6M7.5M4569476.864549313.424392934.754530948.624220522.494244908.836839975.876792746.346861088.891. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Memcached

Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:100smt dsmt csmt bsmt ano smt bno smt acba1000K2000K3000K4000K5000K4403267.424394194.494357453.764383314.653216133.913192061.684852421.674876951.364878860.001. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cachesmt dsmt csmt bsmt ano smt bno smt acba140280420560700500.12495.85516.09500.13622.73635.48614.24610.79600.70MIN: 69.61 / MAX: 6000MIN: 51.06 / MAX: 6000MIN: 89.55 / MAX: 6000MIN: 65.15 / MAX: 6000MIN: 83.22 / MAX: 5454.55MIN: 85.35 / MAX: 6000MIN: 57.14 / MAX: 6666.67MIN: 58.14 / MAX: 6666.67MIN: 57.75 / MAX: 6000

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Runsmt dsmt csmt bsmt ano smt bno smt acba140280420560700515.11524.75527.88524.04649.52666.43621.88627.20625.91MIN: 88.5 / MAX: 6000MIN: 90.23 / MAX: 6000MIN: 90.63 / MAX: 6666.67MIN: 90.5 / MAX: 6666.67MIN: 86.46 / MAX: 6000MIN: 85.11 / MAX: 6666.67MIN: 58.54 / MAX: 6666.67MIN: 58.54 / MAX: 6000MIN: 56.13 / MAX: 7500

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Runsmt dsmt csmt bsmt ano smt bno smt acba140280420560700527.80530.47538.63534.82662.01665.00636.18628.37625.16MIN: 81.52 / MAX: 6000MIN: 92.02 / MAX: 5454.55MIN: 89.82 / MAX: 6000MIN: 91.32 / MAX: 6000MIN: 86.33 / MAX: 6000MIN: 85.84 / MAX: 6000MIN: 58.03 / MAX: 6666.67MIN: 58.37 / MAX: 6666.67MIN: 57.69 / MAX: 6000

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba36912158.260789.349817.422707.605661.931262.040031.886861.923402.01581MIN: 7.09MIN: 7.73MIN: 6.44MIN: 6.54MIN: 1.77MIN: 1.78MIN: 1.68MIN: 1.72MIN: 1.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.81041.62082.43123.24164.0523.505633.601943.494533.391512.123792.196451.567421.562571.56461MIN: 3.19MIN: 3.08MIN: 3.11MIN: 2.93MIN: 1.9MIN: 2MIN: 1.39MIN: 1.41MIN: 1.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba369121512.1571012.013007.3014711.432604.793024.878834.397204.278583.11497MIN: 8.52MIN: 8.02MIN: 5.77MIN: 7.59MIN: 3.4MIN: 3.53MIN: 3.21MIN: 3.37MIN: 2.471. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.2240.4480.6720.8961.120.9750910.9957100.9717040.9753570.6290260.5560690.5469910.5130680.534450MIN: 0.91MIN: 0.87MIN: 0.82MIN: 0.92MIN: 0.51MIN: 0.46MIN: 0.5MIN: 0.47MIN: 0.491. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba51015202511.7573018.6594019.5490015.421007.988616.192573.830179.195708.74576MIN: 8.17MIN: 11.23MIN: 10.67MIN: 10.4MIN: 3.88MIN: 3.65MIN: 2.72MIN: 4.13MIN: 3.651. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.80921.61842.42763.23684.0462.974273.365353.596433.388332.028332.022861.638601.729751.87777MIN: 2.3MIN: 2.7MIN: 2.7MIN: 2.76MIN: 1.43MIN: 1.56MIN: 1.2MIN: 1.27MIN: 1.231. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.1560.3120.4680.6240.780.6306300.5451180.5517830.5385390.4003250.4035900.6926670.6890640.693367MIN: 0.48MIN: 0.45MIN: 0.49MIN: 0.48MIN: 0.38MIN: 0.38MIN: 0.65MIN: 0.64MIN: 0.641. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba51015202520.9726021.0301020.5720020.269509.317519.252927.381167.282437.35746MIN: 18.21MIN: 17.96MIN: 18.25MIN: 17.68MIN: 8.07MIN: 7.79MIN: 6.77MIN: 6.58MIN: 4.851. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.26330.52660.78991.05321.31650.9739840.9728630.9735550.9785900.6513010.6642951.1691901.1669601.170040MIN: 0.92MIN: 0.92MIN: 0.92MIN: 0.93MIN: 0.62MIN: 0.63MIN: 1.07MIN: 1.07MIN: 1.071. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.09180.18360.27540.36720.4590.3892230.3943770.4080740.4074300.2557960.2548450.3122890.3127210.311405MIN: 0.29MIN: 0.29MIN: 0.27MIN: 0.27MIN: 0.18MIN: 0.18MIN: 0.28MIN: 0.28MIN: 0.31. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.27750.5550.83251.111.38751.2334001.2014601.1813501.2004900.6705740.6643590.5568510.5519660.555277MIN: 1.08MIN: 1.08MIN: 1.08MIN: 1.04MIN: 0.55MIN: 0.56MIN: 0.53MIN: 0.49MIN: 0.531. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.06880.13760.20640.27520.3440.2478250.2759170.2910870.2796380.1648450.1603610.3055990.3057310.304972MIN: 0.23MIN: 0.23MIN: 0.23MIN: 0.23MIN: 0.15MIN: 0.15MIN: 0.28MIN: 0.28MIN: 0.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba4008001200160020001957.771888.211890.281912.161124.751148.26906.14903.27907.49MIN: 1929.47MIN: 1860.29MIN: 1864.29MIN: 1891.03MIN: 1091.36MIN: 1108.42MIN: 898.41MIN: 894.76MIN: 897.951. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba70014002100280035003349.363011.213034.623187.00901.04930.26669.15671.65674.09MIN: 3325.75MIN: 2853.26MIN: 2821.2MIN: 3034.82MIN: 864.28MIN: 898.89MIN: 661.71MIN: 664.19MIN: 667.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba4008001200160020001883.761926.151937.651830.411119.171151.25915.08912.11911.25MIN: 1850.75MIN: 1901.09MIN: 1908.65MIN: 1807.97MIN: 1086.08MIN: 1070.35MIN: 906.26MIN: 902.43MIN: 903.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.13020.26040.39060.52080.6510.4575540.4478200.4502610.4514720.2912290.2916870.4171880.5784660.415446MIN: 0.34MIN: 0.37MIN: 0.37MIN: 0.4MIN: 0.27MIN: 0.27MIN: 0.4MIN: 0.4MIN: 0.41. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.62131.24261.86392.48523.10652.673032.702352.761402.708071.700571.650411.822641.841721.83147MIN: 2.09MIN: 2.27MIN: 2.46MIN: 2.09MIN: 1.5MIN: 1.41MIN: 1.71MIN: 1.76MIN: 1.731. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.16030.32060.48090.64120.80150.6803950.6767980.6727680.6725850.4611740.4623860.7085630.7124950.711588MIN: 0.53MIN: 0.53MIN: 0.53MIN: 0.52MIN: 0.43MIN: 0.42MIN: 0.67MIN: 0.68MIN: 0.681. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba70014002100280035003171.153153.223249.283269.05903.36913.20671.23670.20671.69MIN: 3148.29MIN: 3059.88MIN: 3226.78MIN: 3243.11MIN: 874.93MIN: 884.92MIN: 662.9MIN: 663.54MIN: 664.461. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.15210.30420.45630.60840.76050.6721150.6761240.6756640.6744550.3472310.3428360.3531750.3568750.357017MIN: 0.49MIN: 0.49MIN: 0.55MIN: 0.49MIN: 0.3MIN: 0.28MIN: 0.31MIN: 0.31MIN: 0.311. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba4008001200160020001912.741925.681894.071888.101139.631147.34911.76917.08909.69MIN: 1890.93MIN: 1901.2MIN: 1870.66MIN: 1865.76MIN: 1100.83MIN: 1109.85MIN: 901.88MIN: 909.14MIN: 901.11. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba70014002100280035003172.193185.643222.933133.65939.55973.32667.95668.95675.92MIN: 3155.85MIN: 2949.58MIN: 2927.41MIN: 3037.06MIN: 904.78MIN: 937.3MIN: 660.93MIN: 662.29MIN: 668.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.13560.27120.40680.54240.6780.6028310.5932990.6001990.5917380.2935640.3166650.2629200.2633730.263997MIN: 0.48MIN: 0.39MIN: 0.38MIN: 0.43MIN: 0.22MIN: 0.24MIN: 0.2MIN: 0.2MIN: 0.181. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.14290.28580.42870.57160.71450.6271330.6349920.6209070.6217760.3404980.3167790.2854320.2913870.290200MIN: 0.4MIN: 0.55MIN: 0.41MIN: 0.45MIN: 0.28MIN: 0.25MIN: 0.24MIN: 0.23MIN: 0.251. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba2004006008001000437.68437.51439.50439.41438.99438.29962.15962.63962.10MIN: 394.89 / MAX: 478.58MIN: 400.05 / MAX: 473.91MIN: 424.22 / MAX: 477.66MIN: 410.81 / MAX: 465.4MIN: 427.57 / MAX: 484.31MIN: 416.93 / MAX: 496.86MIN: 888.7 / MAX: 1017.92MIN: 893.43 / MAX: 1015.71MIN: 879.24 / MAX: 1018.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba400800120016002000822.50821.93827.03827.07830.04828.671679.031675.961671.46MIN: 717.65 / MAX: 997.43MIN: 725.25 / MAX: 1010.56MIN: 723.77 / MAX: 1003.25MIN: 724.84 / MAX: 1037.91MIN: 722.6 / MAX: 1015.67MIN: 730.29 / MAX: 1036.1MIN: 865.58 / MAX: 1995.12MIN: 1231.52 / MAX: 1967.75MIN: 924.15 / MAX: 1977.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba400800120016002000828.01826.67832.70833.15834.17833.991704.021685.261701.70MIN: 716.19 / MAX: 1018.34MIN: 724.1 / MAX: 1006.75MIN: 723.65 / MAX: 1031.69MIN: 725.84 / MAX: 1017.38MIN: 732.01 / MAX: 1006.46MIN: 723.91 / MAX: 1011.94MIN: 828.99 / MAX: 1969.02MIN: 891.16 / MAX: 1979.37MIN: 1395.71 / MAX: 2063.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba481216206.005.996.036.026.016.0115.1015.5416.30MIN: 5.21 / MAX: 25.51MIN: 5.13 / MAX: 31.29MIN: 5.17 / MAX: 38.35MIN: 5.27 / MAX: 25.12MIN: 5.02 / MAX: 36.88MIN: 5.2 / MAX: 37.8MIN: 6.94 / MAX: 60.59MIN: 8.28 / MAX: 57.72MIN: 7.91 / MAX: 51.621. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba110220330440550228.94227.93230.06230.21228.01229.46500.30500.83499.32MIN: 214.92 / MAX: 248.29MIN: 210.46 / MAX: 252.96MIN: 210.58 / MAX: 251.42MIN: 211.56 / MAX: 253.58MIN: 212.99 / MAX: 267.17MIN: 217.93 / MAX: 265.81MIN: 410.04 / MAX: 531.93MIN: 418.76 / MAX: 546.62MIN: 264.54 / MAX: 537.261. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba2468103.933.933.963.953.953.958.138.138.11MIN: 3.61 / MAX: 23.62MIN: 3.61 / MAX: 42.82MIN: 3.66 / MAX: 32.83MIN: 3.61 / MAX: 34.38MIN: 3.68 / MAX: 42.53MIN: 3.61 / MAX: 38MIN: 3.83 / MAX: 59.87MIN: 5.35 / MAX: 55.84MIN: 5.39 / MAX: 69.871. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba36912154.524.524.544.544.544.549.769.759.76MIN: 4.03 / MAX: 45.52MIN: 4.12 / MAX: 33.17MIN: 4.11 / MAX: 42.14MIN: 4.07 / MAX: 35.16MIN: 4.09 / MAX: 55.78MIN: 4.12 / MAX: 27.91MIN: 4.98 / MAX: 36.12MIN: 5.25 / MAX: 35.53MIN: 5.03 / MAX: 28.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba2040608010045.3445.3145.6645.7145.7345.8689.4688.6188.71MIN: 39.4 / MAX: 73.83MIN: 39.35 / MAX: 73.19MIN: 38.82 / MAX: 75.65MIN: 39.78 / MAX: 73.33MIN: 39.68 / MAX: 86.83MIN: 39.29 / MAX: 91.13MIN: 42.16 / MAX: 123.4MIN: 47.57 / MAX: 124.67MIN: 44.2 / MAX: 132.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba36912159.269.259.289.289.189.1810.1110.1010.10MIN: 8.12 / MAX: 30.29MIN: 8.12 / MAX: 19.04MIN: 8.13 / MAX: 24.28MIN: 8.1 / MAX: 22.87MIN: 8.21 / MAX: 24.31MIN: 8.17 / MAX: 31.1MIN: 5.43 / MAX: 36.27MIN: 5.47 / MAX: 28.16MIN: 5.46 / MAX: 35.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba2468104.914.904.954.924.914.908.378.388.34MIN: 4.51 / MAX: 27.27MIN: 4.5 / MAX: 29.95MIN: 4.54 / MAX: 24.23MIN: 4.52 / MAX: 34.8MIN: 4.49 / MAX: 34.72MIN: 4.46 / MAX: 56.52MIN: 6.83 / MAX: 50.24MIN: 6.4 / MAX: 32.33MIN: 6.61 / MAX: 55.541. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.14850.2970.44550.5940.74250.530.530.530.530.580.570.660.660.65MIN: 0.5 / MAX: 8.86MIN: 0.5 / MAX: 9.15MIN: 0.5 / MAX: 9.61MIN: 0.5 / MAX: 24.2MIN: 0.5 / MAX: 12.8MIN: 0.5 / MAX: 13.02MIN: 0.31 / MAX: 22.67MIN: 0.32 / MAX: 19.99MIN: 0.32 / MAX: 20.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUsmt dsmt csmt bsmt ano smt bno smt acba0.24530.49060.73590.98121.22650.970.960.970.971.011.011.091.091.09MIN: 0.86 / MAX: 13.31MIN: 0.87 / MAX: 9.72MIN: 0.87 / MAX: 10.96MIN: 0.87 / MAX: 9.78MIN: 0.86 / MAX: 8.72MIN: 0.86 / MAX: 8.97MIN: 0.49 / MAX: 22.06MIN: 0.48 / MAX: 25.82MIN: 0.49 / MAX: 19.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba2004006008001000974.99971.90975.50972.52955.24955.161122.061118.441115.76

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba81624324033.0531.3131.4631.4833.6031.3328.4728.4928.71

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba71421283530.7230.5830.7530.7530.6430.4230.4930.4630.59

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba1.28282.56563.84845.13126.4145.43415.27735.30535.30045.70155.22625.05735.08595.0715

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba306090120150117.22116.97116.48117.12115.64116.15119.70119.38119.21

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba4812162013.2314.2512.9112.8313.9013.8610.1410.1410.08

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba20406080100102.76102.10103.19103.09100.42100.24109.25109.11108.68

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba36912159.365610.38528.35068.19149.93959.88998.80049.57939.5962

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba112233445542.4842.5542.6542.9542.8442.8147.2947.3547.46

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba2468107.14906.10577.30547.18656.06506.01185.50075.49805.3018

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba2040608010073.6273.3473.3573.3173.2173.2076.6277.3177.34

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba2468107.06407.35506.88447.52256.41747.58565.16965.16335.1812

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba70140210280350301.92303.25304.08303.33303.74304.21320.05319.96319.98

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba51015202521.3620.4921.7421.0320.4220.7416.5216.6716.58

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba306090120150144.91144.47145.27145.40145.36145.35151.39151.60152.14

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba4812162015.1314.2014.6413.6414.4214.4611.1611.1911.36

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamsmt dsmt csmt bsmt ano smt bno smt acba2004006008001000966.76971.67969.21970.22955.34956.011117.731116.291116.43

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamsmt dsmt csmt bsmt ano smt bno smt acba81624324032.1833.9932.2432.3032.1831.9228.5728.7128.62

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.0Time To Compilesmt dsmt csmt bsmt ano smt bno smt acba369121510.3710.4110.2610.3810.6610.6012.4712.4312.57

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigsmt dsmt csmt bsmt ano smt bno smt acba61218243017.0817.0517.0217.3817.5917.6125.6825.7525.77

Phoronix Test Suite v10.8.5