9654 new

2 x AMD EPYC 9654 96-Core testing with a AMD Titanite_4G (RTI1004D BIOS) and llvmpipe on Red Hat Enterprise Linux 9.1 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2303114-NE-9654NEW5019&grt&export=pdf&sor&rro.

9654 newProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionOpenGLabcno smt ano smt bsmt asmt bsmt csmt dAMD EPYC 9654 96-Core @ 2.40GHz (96 Cores / 192 Threads)AMD Titanite_4G (RTI1004D BIOS)AMD Device 14a4768GB2 x 1920GB SAMSUNG MZWLJ1T9HBJR-00007ASPEEDVGA HDMIBroadcom NetXtreme BCM5720 PCIeRed Hat Enterprise Linux 9.15.14.0-162.6.1.el9_1.x86_64 (x86_64)GNOME Shell 40.10X Server 1.20.11GCC 11.3.1 20220421xfs1600x12002 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores)1520GBllvmpipe4.5 Mesa 22.1.5 (LLVM 14.0.6 256 bits)1024x7682 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: alwaysCompiler Details- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-host-bind-now --enable-host-pie --enable-initfini-array --enable-languages=c,c++,fortran,lto --enable-link-serialization=1 --enable-multilib --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=x86-64 --with-arch_64=x86-64-v2 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver --without-isl Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa101111Python Details- Python 3.9.14Security Details- a: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - b: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - c: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - no smt a: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - no smt b: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: disabled RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt a: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt b: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt c: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - smt d: SELinux + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

9654 newclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Rungromacs: MPI CPU - water_GMX50_barekvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 1080p - Super Fastkvazaar: Bosphorus 1080p - Ultra Fastmemcached: 1:5memcached: 1:10memcached: 1:100deepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvkl: vklBenchmark ISPCopenvkl: vklBenchmark Scalarrocksdb: Rand Fillrocksdb: Rand Readrocksdb: Update Randrocksdb: Seq Fillrocksdb: Rand Fill Syncrocksdb: Read While Writingrocksdb: Read Rand Write Randstress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pollstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Forkingstress-ng: Pthreadstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: Function Callstress-ng: Memory Copyingstress-ng: Socket Activitystress-ng: Context Switchingstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingbuild-ffmpeg: Time To Compilebuild-linux-kernel: defconfiguvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Ultra Fastvpxenc: Speed 0 - Bosphorus 4Kvpxenc: Speed 5 - Bosphorus 4Kvpxenc: Speed 0 - Bosphorus 1080pvpxenc: Speed 5 - Bosphorus 1080pvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastvvenc: Bosphorus 1080p - Fastercompress-zstd: 3 - Compression Speedcompress-zstd: 3 - Decompression Speedcompress-zstd: 8 - Compression Speedcompress-zstd: 8 - Decompression Speedcompress-zstd: 12 - Compression Speedcompress-zstd: 12 - Decompression Speedcompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 3, Long Mode - Compression Speedcompress-zstd: 3, Long Mode - Decompression Speedcompress-zstd: 8, Long Mode - Compression Speedcompress-zstd: 8, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedcompress-zstd: 19, Long Mode - Decompression Speedabcno smt ano smt bsmt asmt bsmt csmt d600.70625.91625.1610.56940.6341.4139.92143.3180.981.983.45296.93307.49310.734143044.216861088.89487886042.98931115.760234.826228.70771566.56430.5924197.10185.0715401.7766119.206799.149310.0811440.8533108.6775104.11789.59621009.848647.464188.53785.3018619.753177.3363192.88065.1812149.7446319.981560.252216.5828314.8361152.137787.963111.36242.95811116.42634.928928.62332.015811.564613.114970.534458.745761.877770.6933677.357461.170040.3114050.5552770.304972907.489674.088911.2450.4154461.831470.711588671.690.357017909.691675.9150.2639970.290249.72962.128.471671.4627.971701.72941.4716.395.76499.325908.898.114914.179.76540.4188.719494.2210.15750.748.34112346.360.6574495.171.09108955653392746823143454438454225637660192961852926458189549361663.08483.912653709.642794694.37518.4659479783.64174.72203073.15312709034.0558156.36109397.781950323.9677.51205134.8718128283.29382305.69556875.59621015.3420106.518873.5818941003.9716257100.251122.3910473084.0912.56925.76829.3733.0381.1691.3768.8269.3370.56234.95238.68240.987.6817.3614.6929.375.8212.33612.4430.0393033.91514.81233.81669.3330.81704.819.11472.6892.71536.6938.51677.99.221383.7610.79627.20628.3710.60940.8641.39139.07144.2181.6180.6884.77290.59303.99305.524162812.476792746.344876951.3642.8971118.438335.096228.48661573.749630.4608196.54145.0859401.2053119.379998.617510.136439.0373109.1129104.29089.57931012.349447.3532181.81235.498619.944277.305193.53055.1633149.8207319.964859.922216.6745316.2907151.600389.335511.187242.83481116.289934.818928.71371.92341.562574.278580.5130689.19571.729750.6890647.282431.166960.3127210.5519660.305731903.272671.654912.1140.5784661.841720.712495670.2020.356875917.077668.9520.2633730.29138749.72962.6328.421675.9628.231685.263085.5315.5495.48500.835894.278.134915.429.75541.0388.619496.9510.15720.98.38111378.390.6674353.411.0910755575346814668888885455565453963730028620352289196218955118.11664.75498.6712661687.462805836.52507.7460031543.97223.29203147.15314418461.0258664.97109356.781913590.7767.21217072.2718100474.36382304.04556797.27621003.9220340.48851.6516313126.8616168655.171132.3510471889.9712.43425.74929.2933.1381.4191.4768.796970.68234.68239.92240.917.7117.3714.6729.55.80912.39112.39929.84530951516.61239.316513321716.719.11467.8909.41537.5910.81673.79.291378.2614.24621.88636.1810.58740.7641.47140.1143.8180.3184.5582.7291.03301.4309.644155273.466839975.874852421.6742.74331122.058435.118828.46871571.828130.4911197.66015.0573400.0427119.702698.592210.1384438.4372109.2467113.50578.80041013.735747.2942181.72435.5007625.551276.6181193.31195.1696149.6905320.050460.488416.5185316.6282151.389989.54711.160542.91521117.732334.993728.56981.886861.567424.39720.5469913.830171.63860.6926677.381161.169190.3122890.5568510.305599906.139669.146915.0840.4171881.822640.708563671.2330.353175911.762667.950.262920.28543249.77962.1528.331679.0327.891704.023174.0415.195.59500.35898.798.134910.139.76535.7889.469485.6510.115724.818.37112186.250.6674486.081.0910665495365514680697925435725445653569228316379291002318961773.181668.92478.0512676101.412794473.75507.9759929401.4183.33203095.44313768771.2664299.62109609.151891202.3797.04217304.1918088584.67382328.5556833.5621041.9320297.918876.116862185.5416537965.141125.8610475486.3912.46525.6829.4133.181.191.2969.0469.9271.13237.44237.96238.777.717.4614.7629.465.80812.39912.44130.0813049.41517.41241.11661.9330.11715.619.11470.5916.91540.9926.91675.49.31384635.48666.43665.0019.17547.1347.97155.56159.6370.0275.576.05269.62288.41278.622444886.824244908.833192061.6897.4442955.163131.914631.3273107.295730.4213191.26055.2262813.9832116.153272.129813.8559941.2443100.2418101.00959.88992204.753342.805166.27256.01181291.973373.1993131.75867.5856308.4294304.207548.184920.7385649.302145.354869.106314.463897.3996956.008831.318731.92292.040032.196454.878830.5560696.192572.022860.403599.252920.6642950.2548450.6643590.1603611148.26930.2571151.250.2916871.650410.462386913.2010.3428361147.34973.3180.3166650.316779109.08438.2957.58828.6757.18833.997979.056.01208.82229.4612119.663.9510556.934.541045.8145.8620836.19.189784.094.9160545.410.57127833.521.01109864747862912096110554620184657003506737643831207980427408413.14520.4820.5110458275.243746361.52303.5663581395.67400.03435615.35456657338.8443094.9668076.033284433.240.94328297.0413141129.68932248.18920216.27829106.6311342.698968.2847222624.4926755146.691978.87402514.7410.59717.60634.5938.3887.1598.2157.1359.8357.78196.25181.67186.247.0414.4814.2829.625.8912.47712.35728.6892804.21500.41227.51669.7279.9172819.81483.1955.61542.5859.91684.89.391395.8622.73649.52662.0118.83747.4347.93159.79161.469.9474.0374.37268.77280.18271.452460416.334220522.493216133.9197.3838955.238629.754433.60123086.359130.6403175.31995.7015817.6313115.636971.887813.9039938.9084100.4198100.5099.93952203.157342.8393164.81266.0651292.803873.2087155.73576.4174308.3033303.737748.925720.4223647.7596145.362769.326614.417897.3441955.343831.0732.17781.931262.123794.793020.6290267.988612.028330.4003259.317510.6513010.2557960.6705740.1648451124.75901.0441119.170.2912291.700570.461174903.3580.3472311139.63939.5470.2935640.340498109.04438.9957.49830.0457.19834.177979.826.01210.14228.0112128.383.9510549.244.541048.7445.7320849.759.189758.744.91162294.470.58127770.391.01110865246821012135402994522284640443440407913568206383127422305.533591.7119.7810393402.013802292.6308.6765500297.73395.95437065.75456651508.0445685.2867451.33282827.555.84326819.7213192391.85925984.24920642.34829445.3810949.98924.144683906.6828009942.561963.757372780.7210.66217.58634.6838.6588.1396.6758.0958.3357.23183.75216.15209.857.1614.513.7229.715.89512.3112.37428.522865.91511.51234.21667.6278.21727.819.81483.81032.31538.88921682.89.761397.6500.13524.04534.8218.81864.6365.56132.67140.7875.9176.6477.96250.71296.72302.5525202534530948.624383314.6597.0249972.516331.759231.48053114.684830.7462188.58265.3004817.7536117.123377.882712.8322929.0246103.0888121.92328.19142230.309942.9515139.09737.18651306.667773.306132.86557.5225314.6186303.327247.50621.0323658.2111145.396673.292413.63797.2916970.220230.957232.29567.605663.3915111.43260.97535715.4213.388330.53853920.26950.978590.407431.200490.2796381912.1631871830.410.4514722.708070.6725853269.050.6744551888.13133.650.5917380.621776108.93439.4157.72827.0757.29833.157953.216.02208.13230.2112117.163.9510544.034.541049.1645.7120610.239.289746.084.92173926.920.53148316.880.971318764423027122566285241319941416838805215317250178768241966139.678360.7624.8215359471.732333781.39464.7136339636.91184.34466292.12634718750.4136266.0274978.514329963.2647.58487359.3920047519.05946032.881291689.331414423.6515914.18748.9912895047.7335687958.372564.4810103952.1310.38117.37645.5647.5680.1789.459.359.0657.96183.99178.49216.157.2413.914.0829.542795.11515.61023.91664.3254.11723.718.81495.21051.41539.5853.81682.59.781393.5516.09527.88538.6319.01566.2265.69136.33138.3374.1176.777274.63267.04295.182507331.294392934.754357453.7696.906975.50431.780631.45933114.429330.7508188.41475.3053822.1552116.481377.409612.9106927.679103.1902119.59648.35062245.803642.6536136.83247.30541306.583973.3496145.17366.8844314.2452304.078245.964221.7398658.341145.274568.292414.635697.3528969.212231.009332.24157.42273.494537.301470.97170419.5493.596430.55178320.5720.9735550.4080741.181350.2910871890.283034.621937.650.4502612.76140.6727683249.280.6756641894.073222.930.6001990.620907108.89439.557.67827.0357.31832.77949.056.03208.19230.0612109.643.9610549.154.541050.3745.6620610.629.289680.444.95175754.350.53147582.870.971243810417882123116809341151341370840129513830689176141641989522.689017.1224.7715341564.162396325.93564.05135855921.28186.64466609.22634995429.6636020.16180407.594329824.3844.38487987.3219927313.52946660.881291704.571413555.4415430.188750.6112221058.3435996976.132520.388586858.5110.25917.01746.2546.6279.9589.757.8659.257.51209.55220.79179.566.9714.2713.5729.62513.41519.11122.41671259.11726.319.51483.51038.91540.4852.71676.59.871392.4495.85524.75530.4719.04565.4965.59135.8140.8973.5778.7276.14243.36288.09303.432517750.474549313.424394194.4996.9975971.898831.927731.31463132.383830.5784189.40545.2773818.6037116.968970.141814.2486937.992102.099996.173710.38522253.141142.5521163.71116.10571305.713773.3407135.89077.355315.3318303.254948.77220.4884662.2585144.466170.382814.201196.9077971.667729.416333.98799.349813.6019412.0130.9957118.65943.365350.54511821.03010.9728630.3943771.201460.2759171888.213011.211926.150.447822.702350.6767983153.220.6761241925.683185.640.5932990.634992109.36437.5158.05821.9357.71826.677993.185.99210.19227.9312168.053.9310603.844.521058.5745.3120684.299.259773.264.9173620.310.53148047.130.961235793416006123457051241998541428239485213948914161391341972765.937633.1624.7915228320.072067499.58413.34138939958.5184.24468159.21639757070.5234917.3977834.394351871.1242.55490300.4819866440.86952461.481295970.281422505.5115077.698747.8312328933.6534602827.772517.268609357.6810.40717.05346.3446.5779.6389.1657.4458.3457.33192.25178.78218.286.9215.3813.9729.542604.61516.21005.81664249.81732.319.21475.21046.61540.9860.81683.79.821389500.118340751515.11527.8019.07766.0865.49135.56136.4273.2475.578.85270.76256.45303.632527084.874569476.864403267.4296.7169974.98530.249433.05143116.090930.7247183.9495.4341816.7562117.221975.52413.2331931.8223102.7646106.65189.36562255.42242.4798139.82417.1491301.181173.6196141.47057.064316.0328301.919246.781521.3593660.2132144.914466.08315.12697.8908966.760631.072732.17588.260783.5056312.15710.97509111.75732.974270.6306320.97260.9739840.3892231.23340.2478251957.773349.361883.760.4575542.673030.6803953171.150.6721151912.743172.190.6028310.627133109.23437.6858822.557.62828.017990.476209.24228.9412172.923.9310587.34.521057.7445.3420679.689.269767.994.91172228.340.53149647.680.971238781415428123191619742051441404740446313098097175290441965286.067273.1924.7115403597.242077119.76394.49137579874.56182.8468006640853365.5434685.8591735.754351920.4240.56489998.7519842969.28951700.171300693.931425621.4413370.338864.7812728401.4536111781.822516.0912418451.7110.37317.07946.2546.218088.9157.5258.6658.76181.83218.91224.317.1515.1113.6829.662528.71513.51024.81664.2256.21731.219.61479.110591543.6879.61677.69.811391.7OpenBenchmarking.org

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cachesmt csmt dsmt asmt babcno smt bno smt a140280420560700495.85500.12500.13516.09600.70610.79614.24622.73635.48MIN: 51.06 / MAX: 6000MIN: 69.61 / MAX: 6000MIN: 65.15 / MAX: 6000MIN: 89.55 / MAX: 6000MIN: 57.75 / MAX: 6000MIN: 58.14 / MAX: 6666.67MIN: 57.14 / MAX: 6666.67MIN: 83.22 / MAX: 5454.55MIN: 85.35 / MAX: 6000

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Runsmt dsmt asmt csmt bcabno smt bno smt a140280420560700515.11524.04524.75527.88621.88625.91627.20649.52666.43MIN: 88.5 / MAX: 6000MIN: 90.5 / MAX: 6666.67MIN: 90.23 / MAX: 6000MIN: 90.63 / MAX: 6666.67MIN: 58.54 / MAX: 6666.67MIN: 56.13 / MAX: 7500MIN: 58.54 / MAX: 6000MIN: 86.46 / MAX: 6000MIN: 85.11 / MAX: 6666.67

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Runsmt dsmt csmt asmt babcno smt bno smt a140280420560700527.80530.47534.82538.63625.16628.37636.18662.01665.00MIN: 81.52 / MAX: 6000MIN: 92.02 / MAX: 5454.55MIN: 91.32 / MAX: 6000MIN: 89.82 / MAX: 6000MIN: 57.69 / MAX: 6000MIN: 58.37 / MAX: 6666.67MIN: 58.03 / MAX: 6666.67MIN: 86.33 / MAX: 6000MIN: 85.84 / MAX: 6000

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_bareacbsmt ano smt bsmt bsmt csmt dno smt a51015202510.5710.5910.6118.8218.8419.0219.0519.0819.181. (CXX) g++ options: -O3

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Slowacbno smt ano smt bsmt asmt csmt dsmt b153045607540.6340.7640.8647.1347.4364.6365.4966.0866.221. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Mediumbacno smt bno smt asmt dsmt asmt csmt b153045607541.3941.4041.4747.9347.9765.4965.5665.5965.691. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Slowsmt asmt dsmt csmt bbacno smt ano smt b4080120160200132.67135.56135.80136.33139.07139.92140.10155.56159.791. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Mediumsmt dsmt bsmt asmt cacbno smt ano smt b4080120160200136.42138.33140.78140.89143.31143.81144.21159.63161.401. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very Fastno smt bno smt asmt dsmt csmt bsmt acab2040608010069.9470.0273.2473.5774.1175.9180.3180.9081.611. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fastno smt bno smt asmt dsmt asmt bsmt cbac2040608010074.0375.5075.5076.6476.7078.7280.6881.9084.551. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fastno smt bno smt asmt csmt bsmt asmt dcab2040608010074.3776.0576.1477.0077.9678.8582.7083.4584.771. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very Fastsmt csmt ano smt bno smt asmt dsmt bbca60120180240300243.36250.71268.77269.62270.76274.63290.59291.03296.931. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super Fastsmt dsmt bno smt bsmt cno smt asmt acba70140210280350256.45267.04280.18288.09288.41296.72301.40303.99307.491. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra Fastno smt bno smt asmt bsmt asmt csmt dbca70140210280350271.45278.62295.18302.55303.43303.63305.52309.64310.731. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Memcached

Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:5no smt ano smt bsmt bsmt csmt asmt dacb900K1800K2700K3600K4500K2444886.822460416.332507331.292517750.472520253.002527084.874143044.214155273.464162812.471. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Memcached

Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:10no smt bno smt asmt bsmt asmt csmt dbca1.5M3M4.5M6M7.5M4220522.494244908.834392934.754530948.624549313.424569476.866792746.346839975.876861088.891. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Memcached

Set To Get Ratio: 1:100

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.18Set To Get Ratio: 1:100no smt ano smt bsmt bsmt asmt csmt dcba1000K2000K3000K4000K5000K3192061.683216133.914357453.764383314.654394194.494403267.424852421.674876951.364878860.001. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamcbasmt dsmt bsmt csmt ano smt bno smt a2040608010042.7442.9042.9996.7296.9197.0097.0297.3897.44

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamcbasmt bsmt dsmt asmt cno smt bno smt a20040060080010001122.061118.441115.76975.50974.99972.52971.90955.24955.16

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamno smt bsmt dsmt asmt bno smt asmt cabc81624324029.7530.2531.7631.7831.9131.9334.8335.1035.12

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamno smt bsmt dsmt asmt bno smt asmt cabc81624324033.6033.0531.4831.4631.3331.3128.7128.4928.47

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamacbno smt bno smt asmt bsmt asmt dsmt c70014002100280035001566.561571.831573.753086.363107.303114.433114.683116.093132.38

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamsmt bsmt asmt dno smt basmt ccbno smt a71421283530.7530.7530.7230.6430.5930.5830.4930.4630.42

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Streamno smt bsmt dsmt bsmt asmt cno smt abac4080120160200175.32183.95188.41188.58189.41191.26196.54197.10197.66

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Streamno smt bsmt dsmt bsmt asmt cno smt abac1.28282.56563.84845.13126.4145.70155.43415.30535.30045.27735.22625.08595.07155.0573

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamcbano smt asmt dno smt bsmt asmt csmt b2004006008001000400.04401.21401.78813.98816.76817.63817.75818.60822.16

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamcbasmt dsmt asmt csmt bno smt ano smt b306090120150119.70119.38119.21117.22117.12116.97116.48116.15115.64

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Streamsmt cno smt bno smt asmt dsmt bsmt acba2040608010070.1471.8972.1375.5277.4177.8898.5998.6299.15

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Streamsmt cno smt bno smt asmt dsmt bsmt acba4812162014.2513.9013.8613.2312.9112.8310.1410.1410.08

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamcbasmt bsmt asmt dsmt cno smt bno smt a2004006008001000438.44439.04440.85927.68929.02931.82937.99938.91941.24

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamcbasmt bsmt asmt dsmt cno smt bno smt a20406080100109.25109.11108.68103.19103.09102.76102.10100.42100.24

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamsmt cno smt bno smt aabsmt dcsmt bsmt a30609012015096.17100.51101.01104.12104.29106.65113.51119.60121.92

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamsmt cno smt bno smt aabsmt dcsmt bsmt a369121510.38529.93959.88999.59629.57939.36568.80048.35068.1914

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabcno smt bno smt asmt asmt bsmt csmt d50010001500200025001009.851012.351013.742203.162204.752230.312245.802253.142255.42

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabcsmt ano smt bno smt asmt bsmt csmt d112233445547.4647.3547.2942.9542.8442.8142.6542.5542.48

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamsmt bsmt asmt dsmt cno smt bno smt acba4080120160200136.83139.10139.82163.71164.81166.27181.72181.81188.54

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamsmt bsmt asmt dsmt cno smt bno smt acba2468107.30547.18657.14906.10576.06506.01185.50075.49805.3018

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabcno smt ano smt bsmt dsmt csmt bsmt a30060090012001500619.75619.94625.551291.971292.801301.181305.711306.581306.67

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabcsmt dsmt bsmt csmt ano smt bno smt a2040608010077.3477.3176.6273.6273.3573.3473.3173.2173.20

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streamno smt asmt asmt csmt dsmt bno smt bacb4080120160200131.76132.87135.89141.47145.17155.74192.88193.31193.53

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streamno smt asmt asmt csmt dsmt bno smt bacb2468107.58567.52257.35507.06406.88446.41745.18125.16965.1633

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamcabno smt bno smt asmt bsmt asmt csmt d70140210280350149.69149.74149.82308.30308.43314.25314.62315.33316.03

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamcabno smt asmt bno smt bsmt asmt csmt d70140210280350320.05319.98319.96304.21304.08303.74303.33303.25301.92

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streamsmt bsmt dsmt ano smt asmt cno smt bbac142842567045.9646.7847.5148.1848.7748.9359.9260.2560.49

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streamsmt bsmt dsmt ano smt asmt cno smt bbac51015202521.7421.3621.0320.7420.4920.4216.6716.5816.52

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamabcno smt bno smt asmt asmt bsmt dsmt c140280420560700314.84316.29316.63647.76649.30658.21658.34660.21662.26

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamabcsmt ano smt bno smt asmt bsmt dsmt c306090120150152.14151.60151.39145.40145.36145.35145.27144.91144.47

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Streamsmt dsmt bno smt ano smt bsmt csmt aabc2040608010066.0868.2969.1169.3370.3873.2987.9689.3489.55

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Streamsmt dsmt bno smt ano smt bsmt csmt aabc4812162015.1314.6414.4614.4214.2013.6411.3611.1911.16

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streambcasmt csmt ano smt bsmt bno smt asmt d2040608010042.8342.9242.9696.9197.2997.3497.3597.4097.89

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamcabsmt csmt asmt bsmt dno smt ano smt b20040060080010001117.731116.431116.29971.67970.22969.21966.76956.01955.34

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamsmt csmt asmt bno smt bsmt dno smt abac81624324029.4230.9631.0131.0731.0731.3234.8234.9334.99

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamsmt csmt asmt bno smt bsmt dno smt abac81624324033.9932.3032.2432.1832.1831.9228.7128.6228.57

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUsmt csmt dsmt asmt bno smt aano smt bbc36912159.349818.260787.605667.422702.040032.015811.931261.923401.88686MIN: 7.73MIN: 7.09MIN: 6.54MIN: 6.44MIN: 1.78MIN: 1.81MIN: 1.77MIN: 1.72MIN: 1.681. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUsmt csmt dsmt bsmt ano smt ano smt bcab0.81041.62082.43123.24164.0523.601943.505633.494533.391512.196452.123791.567421.564611.56257MIN: 3.08MIN: 3.19MIN: 3.11MIN: 2.93MIN: 2MIN: 1.9MIN: 1.39MIN: 1.41MIN: 1.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt asmt bno smt ano smt bcba369121512.1571012.0130011.432607.301474.878834.793024.397204.278583.11497MIN: 8.52MIN: 8.02MIN: 7.59MIN: 5.77MIN: 3.53MIN: 3.4MIN: 3.21MIN: 3.37MIN: 2.471. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPUsmt csmt asmt dsmt bno smt bno smt acab0.2240.4480.6720.8961.120.9957100.9753570.9750910.9717040.6290260.5560690.5469910.5344500.513068MIN: 0.87MIN: 0.92MIN: 0.91MIN: 0.82MIN: 0.51MIN: 0.46MIN: 0.5MIN: 0.49MIN: 0.471. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPUsmt bsmt csmt asmt dbano smt bno smt ac51015202519.5490018.6594015.4210011.757309.195708.745767.988616.192573.83017MIN: 10.67MIN: 11.23MIN: 10.4MIN: 8.17MIN: 4.13MIN: 3.65MIN: 3.88MIN: 3.65MIN: 2.721. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPUsmt bsmt asmt csmt dno smt bno smt aabc0.80921.61842.42763.23684.0463.596433.388333.365352.974272.028332.022861.877771.729751.63860MIN: 2.7MIN: 2.76MIN: 2.7MIN: 2.3MIN: 1.43MIN: 1.56MIN: 1.23MIN: 1.27MIN: 1.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUacbsmt dsmt bsmt csmt ano smt ano smt b0.1560.3120.4680.6240.780.6933670.6926670.6890640.6306300.5517830.5451180.5385390.4035900.400325MIN: 0.64MIN: 0.65MIN: 0.64MIN: 0.48MIN: 0.49MIN: 0.45MIN: 0.48MIN: 0.38MIN: 0.381. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUsmt csmt dsmt bsmt ano smt bno smt acab51015202521.0301020.9726020.5720020.269509.317519.252927.381167.357467.28243MIN: 17.96MIN: 18.21MIN: 18.25MIN: 17.68MIN: 8.07MIN: 7.79MIN: 6.77MIN: 4.85MIN: 6.581. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUacbsmt asmt dsmt bsmt cno smt ano smt b0.26330.52660.78991.05321.31651.1700401.1691901.1669600.9785900.9739840.9735550.9728630.6642950.651301MIN: 1.07MIN: 1.07MIN: 1.07MIN: 0.93MIN: 0.92MIN: 0.92MIN: 0.92MIN: 0.63MIN: 0.621. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPUsmt bsmt asmt csmt dbcano smt bno smt a0.09180.18360.27540.36720.4590.4080740.4074300.3943770.3892230.3127210.3122890.3114050.2557960.254845MIN: 0.27MIN: 0.27MIN: 0.29MIN: 0.29MIN: 0.28MIN: 0.28MIN: 0.3MIN: 0.18MIN: 0.181. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPUsmt dsmt csmt asmt bno smt bno smt acab0.27750.5550.83251.111.38751.2334001.2014601.2004901.1813500.6705740.6643590.5568510.5552770.551966MIN: 1.08MIN: 1.08MIN: 1.04MIN: 1.08MIN: 0.55MIN: 0.56MIN: 0.53MIN: 0.53MIN: 0.491. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPUbcasmt bsmt asmt csmt dno smt bno smt a0.06880.13760.20640.27520.3440.3057310.3055990.3049720.2910870.2796380.2759170.2478250.1648450.160361MIN: 0.28MIN: 0.28MIN: 0.28MIN: 0.23MIN: 0.23MIN: 0.23MIN: 0.23MIN: 0.15MIN: 0.151. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUsmt dsmt asmt bsmt cno smt ano smt bacb4008001200160020001957.771912.161890.281888.211148.261124.75907.49906.14903.27MIN: 1929.47MIN: 1891.03MIN: 1864.29MIN: 1860.29MIN: 1108.42MIN: 1091.36MIN: 897.95MIN: 898.41MIN: 894.761. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUsmt dsmt asmt bsmt cno smt ano smt babc70014002100280035003349.363187.003034.623011.21930.26901.04674.09671.65669.15MIN: 3325.75MIN: 3034.82MIN: 2821.2MIN: 2853.26MIN: 898.89MIN: 864.28MIN: 667.01MIN: 664.19MIN: 661.711. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPUsmt bsmt csmt dsmt ano smt ano smt bcba4008001200160020001937.651926.151883.761830.411151.251119.17915.08912.11911.25MIN: 1908.65MIN: 1901.09MIN: 1850.75MIN: 1807.97MIN: 1070.35MIN: 1086.08MIN: 906.26MIN: 902.43MIN: 903.011. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPUbsmt dsmt asmt bsmt ccano smt ano smt b0.13020.26040.39060.52080.6510.5784660.4575540.4514720.4502610.4478200.4171880.4154460.2916870.291229MIN: 0.4MIN: 0.34MIN: 0.4MIN: 0.37MIN: 0.37MIN: 0.4MIN: 0.4MIN: 0.27MIN: 0.271. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPUsmt bsmt asmt csmt dbacno smt bno smt a0.62131.24261.86392.48523.10652.761402.708072.702352.673031.841721.831471.822641.700571.65041MIN: 2.46MIN: 2.09MIN: 2.27MIN: 2.09MIN: 1.76MIN: 1.73MIN: 1.71MIN: 1.5MIN: 1.411. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPUbacsmt dsmt csmt bsmt ano smt ano smt b0.16030.32060.48090.64120.80150.7124950.7115880.7085630.6803950.6767980.6727680.6725850.4623860.461174MIN: 0.68MIN: 0.68MIN: 0.67MIN: 0.53MIN: 0.53MIN: 0.53MIN: 0.52MIN: 0.42MIN: 0.431. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPUsmt asmt bsmt dsmt cno smt ano smt bacb70014002100280035003269.053249.283171.153153.22913.20903.36671.69671.23670.20MIN: 3243.11MIN: 3226.78MIN: 3148.29MIN: 3059.88MIN: 884.92MIN: 874.93MIN: 664.46MIN: 662.9MIN: 663.541. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPUsmt csmt bsmt asmt dabcno smt bno smt a0.15210.30420.45630.60840.76050.6761240.6756640.6744550.6721150.3570170.3568750.3531750.3472310.342836MIN: 0.49MIN: 0.55MIN: 0.49MIN: 0.49MIN: 0.31MIN: 0.31MIN: 0.31MIN: 0.3MIN: 0.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUsmt csmt dsmt bsmt ano smt ano smt bbca4008001200160020001925.681912.741894.071888.101147.341139.63917.08911.76909.69MIN: 1901.2MIN: 1890.93MIN: 1870.66MIN: 1865.76MIN: 1109.85MIN: 1100.83MIN: 909.14MIN: 901.88MIN: 901.11. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUsmt bsmt csmt dsmt ano smt ano smt babc70014002100280035003222.933185.643172.193133.65973.32939.55675.92668.95667.95MIN: 2927.41MIN: 2949.58MIN: 3155.85MIN: 3037.06MIN: 937.3MIN: 904.78MIN: 668.99MIN: 662.29MIN: 660.931. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPUsmt dsmt bsmt csmt ano smt ano smt babc0.13560.27120.40680.54240.6780.6028310.6001990.5932990.5917380.3166650.2935640.2639970.2633730.262920MIN: 0.48MIN: 0.38MIN: 0.39MIN: 0.43MIN: 0.24MIN: 0.22MIN: 0.18MIN: 0.2MIN: 0.21. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPUsmt csmt dsmt asmt bno smt bno smt abac0.14290.28580.42870.57160.71450.6349920.6271330.6217760.6209070.3404980.3167790.2913870.2902000.285432MIN: 0.55MIN: 0.4MIN: 0.45MIN: 0.41MIN: 0.28MIN: 0.25MIN: 0.23MIN: 0.25MIN: 0.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUabcsmt bsmt ano smt bno smt asmt dsmt c2040608010049.7249.7249.77108.89108.93109.04109.08109.23109.361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16 - Device: CPUbcasmt bsmt ano smt bno smt asmt dsmt c2004006008001000962.63962.15962.10439.50439.41438.99438.29437.68437.51MIN: 893.43 / MAX: 1015.71MIN: 888.7 / MAX: 1017.92MIN: 879.24 / MAX: 1018.81MIN: 424.22 / MAX: 477.66MIN: 410.81 / MAX: 465.4MIN: 427.57 / MAX: 484.31MIN: 416.93 / MAX: 496.86MIN: 394.89 / MAX: 478.58MIN: 400.05 / MAX: 473.911. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUcbano smt bno smt asmt bsmt asmt dsmt c132639526528.3328.4228.4757.4957.5857.6757.7258.0058.051. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUcbano smt bno smt asmt asmt bsmt dsmt c4008001200160020001679.031675.961671.46830.04828.67827.07827.03822.50821.93MIN: 865.58 / MAX: 1995.12MIN: 1231.52 / MAX: 1967.75MIN: 924.15 / MAX: 1977.46MIN: 722.6 / MAX: 1015.67MIN: 730.29 / MAX: 1036.1MIN: 724.84 / MAX: 1037.91MIN: 723.77 / MAX: 1003.25MIN: 717.65 / MAX: 997.43MIN: 725.25 / MAX: 1010.561. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUcabno smt ano smt bsmt asmt bsmt dsmt c132639526527.8927.9728.2357.1857.1957.2957.3157.6257.711. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP32 - Device: CPUcabno smt bno smt asmt asmt bsmt dsmt c4008001200160020001704.021701.701685.26834.17833.99833.15832.70828.01826.67MIN: 828.99 / MAX: 1969.02MIN: 1395.71 / MAX: 2063.97MIN: 891.16 / MAX: 1979.37MIN: 732.01 / MAX: 1006.46MIN: 723.91 / MAX: 1011.94MIN: 725.84 / MAX: 1017.38MIN: 723.65 / MAX: 1031.69MIN: 716.19 / MAX: 1018.34MIN: 724.1 / MAX: 1006.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUabcsmt bsmt ano smt ano smt bsmt dsmt c2K4K6K8K10K2941.473085.533174.047949.057953.217979.057979.827990.477993.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16 - Device: CPUabcsmt bsmt ano smt bno smt asmt dsmt c4812162016.3015.5415.106.036.026.016.016.005.99MIN: 7.91 / MAX: 51.62MIN: 8.28 / MAX: 57.72MIN: 6.94 / MAX: 60.59MIN: 5.17 / MAX: 38.35MIN: 5.27 / MAX: 25.12MIN: 5.02 / MAX: 36.88MIN: 5.2 / MAX: 37.8MIN: 5.21 / MAX: 25.51MIN: 5.13 / MAX: 31.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUbcasmt asmt bno smt asmt dno smt bsmt c5010015020025095.4895.5995.76208.13208.19208.82209.24210.14210.191. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUbcasmt asmt bno smt asmt dno smt bsmt c110220330440550500.83500.30499.32230.21230.06229.46228.94228.01227.93MIN: 418.76 / MAX: 546.62MIN: 410.04 / MAX: 531.93MIN: 264.54 / MAX: 537.26MIN: 211.56 / MAX: 253.58MIN: 210.58 / MAX: 251.42MIN: 217.93 / MAX: 265.81MIN: 214.92 / MAX: 248.29MIN: 212.99 / MAX: 267.17MIN: 210.46 / MAX: 252.961. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUbcasmt bsmt ano smt ano smt bsmt csmt d3K6K9K12K15K5894.275898.795908.8912109.6412117.1612119.6612128.3812168.0512172.921. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUcbasmt bsmt ano smt bno smt asmt dsmt c2468108.138.138.113.963.953.953.953.933.93MIN: 3.83 / MAX: 59.87MIN: 5.35 / MAX: 55.84MIN: 5.39 / MAX: 69.87MIN: 3.66 / MAX: 32.83MIN: 3.61 / MAX: 34.38MIN: 3.68 / MAX: 42.53MIN: 3.61 / MAX: 38MIN: 3.61 / MAX: 23.62MIN: 3.61 / MAX: 42.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUcabsmt asmt bno smt bno smt asmt dsmt c2K4K6K8K10K4910.134914.174915.4210544.0310549.1510549.2410556.9310587.3010603.841. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16 - Device: CPUcabsmt bsmt ano smt bno smt asmt dsmt c36912159.769.769.754.544.544.544.544.524.52MIN: 4.98 / MAX: 36.12MIN: 5.03 / MAX: 28.1MIN: 5.25 / MAX: 35.53MIN: 4.11 / MAX: 42.14MIN: 4.07 / MAX: 35.16MIN: 4.09 / MAX: 55.78MIN: 4.12 / MAX: 27.91MIN: 4.03 / MAX: 45.52MIN: 4.12 / MAX: 33.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUcabno smt ano smt bsmt asmt bsmt dsmt c2004006008001000535.78540.41541.031045.811048.741049.161050.371057.741058.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUcabno smt ano smt bsmt asmt bsmt dsmt c2040608010089.4688.7188.6145.8645.7345.7145.6645.3445.31MIN: 42.16 / MAX: 123.4MIN: 44.2 / MAX: 132.86MIN: 47.57 / MAX: 124.67MIN: 39.29 / MAX: 91.13MIN: 39.68 / MAX: 86.83MIN: 39.78 / MAX: 73.33MIN: 38.82 / MAX: 75.65MIN: 39.4 / MAX: 73.83MIN: 39.35 / MAX: 73.191. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUcabsmt asmt bsmt dsmt cno smt ano smt b4K8K12K16K20K9485.659494.229496.9520610.2320610.6220679.6820684.2920836.1020849.751. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUcbasmt bsmt asmt dsmt cno smt bno smt a369121510.1110.1010.109.289.289.269.259.189.18MIN: 5.43 / MAX: 36.27MIN: 5.47 / MAX: 28.16MIN: 5.46 / MAX: 35.41MIN: 8.13 / MAX: 24.28MIN: 8.1 / MAX: 22.87MIN: 8.12 / MAX: 30.29MIN: 8.12 / MAX: 19.04MIN: 8.21 / MAX: 24.31MIN: 8.17 / MAX: 31.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUbcasmt bsmt ano smt bsmt dsmt cno smt a2K4K6K8K10K5720.905724.815750.749680.449746.089758.749767.999773.269784.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUbcasmt bsmt asmt dno smt bsmt cno smt a2468108.388.378.344.954.924.914.914.904.90MIN: 6.4 / MAX: 32.33MIN: 6.83 / MAX: 50.24MIN: 6.61 / MAX: 55.54MIN: 4.54 / MAX: 24.23MIN: 4.52 / MAX: 34.8MIN: 4.51 / MAX: 27.27MIN: 4.49 / MAX: 34.72MIN: 4.5 / MAX: 29.95MIN: 4.46 / MAX: 56.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUbcano smt ano smt bsmt dsmt csmt asmt b40K80K120K160K200K111378.39112186.25112346.36160545.41162294.47172228.34173620.31173926.92175754.351. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUcbano smt bno smt asmt dsmt csmt bsmt a0.14850.2970.44550.5940.74250.660.660.650.580.570.530.530.530.53MIN: 0.31 / MAX: 22.67MIN: 0.32 / MAX: 19.99MIN: 0.32 / MAX: 20.68MIN: 0.5 / MAX: 12.8MIN: 0.5 / MAX: 13.02MIN: 0.5 / MAX: 8.86MIN: 0.5 / MAX: 9.15MIN: 0.5 / MAX: 9.61MIN: 0.5 / MAX: 24.21. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUbcano smt bno smt asmt bsmt csmt asmt d30K60K90K120K150K74353.4174486.0874495.17127770.39127833.52147582.87148047.13148316.88149647.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUcbano smt bno smt asmt dsmt bsmt asmt c0.24530.49060.73590.98121.22651.091.091.091.011.010.970.970.970.96MIN: 0.49 / MAX: 22.06MIN: 0.48 / MAX: 25.82MIN: 0.49 / MAX: 19.01MIN: 0.86 / MAX: 8.72MIN: 0.86 / MAX: 8.97MIN: 0.86 / MAX: 13.31MIN: 0.87 / MAX: 10.96MIN: 0.87 / MAX: 9.78MIN: 0.87 / MAX: 9.721. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie -ldl

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCcbano smt ano smt bsmt csmt dsmt bsmt a30060090012001500106610751089109811081235123812431318MIN: 180 / MAX: 6427MIN: 179 / MAX: 6442MIN: 179 / MAX: 7194MIN: 297 / MAX: 4284MIN: 297 / MAX: 4208MIN: 392 / MAX: 4332MIN: 392 / MAX: 3738MIN: 390 / MAX: 3501MIN: 391 / MAX: 3855

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark Scalarcabno smt ano smt bsmt asmt dsmt csmt b2004006008001000549556557647652764781793810MIN: 60 / MAX: 5475MIN: 61 / MAX: 5994MIN: 61 / MAX: 6019MIN: 101 / MAX: 4024MIN: 102 / MAX: 3990MIN: 139 / MAX: 3808MIN: 139 / MAX: 3776MIN: 139 / MAX: 3583MIN: 138 / MAX: 3650

RocksDB

Test: Random Fill

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fillsmt dsmt csmt bsmt ano smt bno smt aabc110K220K330K440K550K4154284160064178824230274682104786295339275346815365511. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Random Read

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Readbcano smt ano smt bsmt asmt bsmt dsmt c300M600M900M1200M1500M4668888884680697924682314341209611055121354029912256628521231168093123191619712345705121. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Update Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Update Randomsmt bsmt asmt csmt dno smt bno smt acab120K240K360K480K600K4115134131994199854205144522284620185435725443845455561. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Sequential Fill

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Sequential Fillsmt bsmt dsmt asmt cno smt bno smt aacb120K240K360K480K600K4137084140474141684142824640444657005422565445655453961. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Random Fill Sync

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Random Fill Syncno smt bno smt acbasmt asmt csmt bsmt d90K180K270K360K450K3440403506733569223730023766013880523948524012954044631. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read While Writing

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read While Writingno smt ano smt bcbasmt dsmt bsmt csmt a3M6M9M12M15M76438317913568831637986203529296185130980971383068913948914153172501. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

RocksDB

Test: Read Random Write Random

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 7.9.2Test: Read Random Write Randomsmt csmt dsmt bsmt ano smt bno smt abca600K1200K1800K2400K3000K1613913175290417614161787682206383120798042891962291002329264581. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Hashabcno smt ano smt bsmt dsmt asmt csmt b9M18M27M36M45M18954936.0018955118.1018961773.1827408413.1027422305.5341965286.0641966139.6741972765.9341989522.681. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: MMAPabcno smt bno smt asmt dsmt csmt asmt b2K4K6K8K10K1663.081664.751668.923591.714520.487273.197633.168360.769017.121. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: NUMAno smt bno smt asmt dsmt bsmt csmt acab11022033044055019.7820.5124.7124.7724.7924.82478.05483.90498.671. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Pollno smt bno smt aabcsmt csmt bsmt asmt d3M6M9M12M15M10393402.0110458275.2412653709.6412661687.4612676101.4115228320.0715341564.1615359471.7315403597.241. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Futexsmt csmt dsmt asmt bcabno smt ano smt b800K1600K2400K3200K4000K2067499.582077119.762333781.392396325.932794473.752794694.372805836.523746361.523802292.601. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: MEMFDno smt ano smt bsmt dsmt csmt abcasmt b120240360480600303.56308.67394.49413.34464.70507.74507.97518.46564.051. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Mutexacbno smt ano smt bsmt bsmt asmt dsmt c30M60M90M120M150M59479783.6459929401.4060031543.9763581395.6765500297.73135855921.28136339636.91137579874.56138939958.501. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Atomicasmt dcsmt csmt asmt bbno smt bno smt a90180270360450174.72182.80183.33184.24184.34186.64223.29395.95400.031. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Cryptoacbno smt ano smt bsmt asmt bsmt dsmt c100K200K300K400K500K203073.15203095.44203147.15435615.35437065.75466292.12466609.22468006.00468159.211. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Mallocacbno smt bno smt asmt asmt bsmt csmt d140M280M420M560M700M312709034.05313768771.26314418461.02456651508.04456657338.84634718750.41634995429.66639757070.52640853365.541. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Forkingsmt dsmt csmt bsmt ano smt ano smt babc14K28K42K56K70K34685.8534917.3936020.1636266.0243094.9645685.2858156.3658664.9764299.621. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Pthreadno smt bno smt asmt asmt csmt dbacsmt b40K80K120K160K200K67451.3068076.0374978.5177834.3991735.75109356.78109397.78109609.15180407.591. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: SENDFILEcbano smt bno smt asmt bsmt asmt csmt d900K1800K2700K3600K4500K1891202.371913590.771950323.963282827.503284433.204329824.384329963.264351871.124351920.421. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: CPU Cachesmt dno smt asmt csmt bsmt ano smt bbac2040608010040.5640.9442.5544.3847.5855.8467.2177.5197.041. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: CPU Stressabcno smt bno smt asmt asmt bsmt dsmt c110K220K330K440K550K205134.87217072.27217304.19326819.72328297.04487359.39487987.32489998.75490300.481. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Semaphoresno smt ano smt bcbasmt dsmt csmt bsmt a4M8M12M16M20M13141129.6813192391.8518088584.6718100474.3618128283.2919842969.2819866440.8619927313.5220047519.051. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Matrix Mathbacno smt bno smt asmt asmt bsmt dsmt c200K400K600K800K1000K382304.04382305.69382328.50925984.24932248.18946032.88946660.88951700.17952461.481. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Vector Mathbcano smt ano smt bsmt asmt bsmt csmt d300K600K900K1200K1500K556797.27556833.50556875.59920216.27920642.341291689.331291704.571295970.281300693.931. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Function Callbacno smt ano smt bsmt bsmt asmt csmt d300K600K900K1200K1500K621003.92621015.34621041.93829106.63829445.381413555.441414423.651422505.511425621.441. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Memory Copyingno smt bno smt asmt dsmt csmt bsmt aacb4K8K12K16K20K10949.9011342.6913370.3315077.6915430.1815914.1020106.5120297.9120340.401. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Socket Activitysmt csmt asmt bbsmt dacno smt bno smt a2K4K6K8K10K8747.838748.998750.618851.658864.788873.588876.108924.108968.281. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Context Switchingsmt bsmt csmt dsmt abcano smt bno smt a10M20M30M40M50M12221058.3412328933.6512728401.4512895047.7316313126.8616862185.5418941003.9744683906.6847222624.491. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Glibc C String Functionsbacno smt ano smt bsmt csmt asmt bsmt d8M16M24M32M40M16168655.1716257100.2516537965.1426755146.6928009942.5634602827.7735687958.3735996976.1336111781.821. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: Glibc Qsort Data Sortingacbno smt bno smt asmt dsmt csmt bsmt a60012001800240030001122.391125.861132.351963.751978.802516.092517.262520.382564.481. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.15.04Test: System V Message Passingno smt bno smt asmt bsmt csmt abacsmt d3M6M9M12M15M7372780.727402514.748586858.518609357.6810103952.1310471889.9710473084.0910475486.3912418451.711. (CC) gcc options: -std=gnu99 -O2 -lm -lc -lcrypt -ldl -lrt -pthread

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.0Time To Compileacbno smt bno smt asmt csmt asmt dsmt b369121512.5712.4712.4310.6610.6010.4110.3810.3710.26

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigabcno smt ano smt bsmt asmt dsmt csmt b61218243025.7725.7525.6817.6117.5917.3817.0817.0517.02

uvg266

Video Input: Bosphorus 4K - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Slowbacno smt ano smt bsmt asmt bsmt dsmt c112233445529.2929.3729.4134.5934.6845.5646.2546.2546.34

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Mediumacbno smt ano smt bsmt dsmt csmt bsmt a112233445533.0333.1033.1338.3838.6546.2146.5746.6247.56

uvg266

Video Input: Bosphorus 1080p - Video Preset: Slow

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Slowsmt csmt bsmt dsmt acabno smt ano smt b2040608010079.6379.9580.0080.1781.1081.1681.4187.1588.13

uvg266

Video Input: Bosphorus 1080p - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Mediumsmt dsmt csmt asmt bcabno smt bno smt a2040608010088.9189.1689.4089.7091.2991.3791.4796.6798.21

uvg266

Video Input: Bosphorus 4K - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very Fastno smt asmt csmt dsmt bno smt bsmt abac153045607557.1357.4457.5257.8658.0959.3068.7968.8269.04

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fastno smt bsmt csmt dsmt asmt bno smt abac163248648058.3358.3458.6659.0659.2059.8369.0069.3369.92

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fastno smt bsmt csmt bno smt asmt asmt dabc163248648057.2357.3357.5157.7857.9658.7670.5670.6871.13

uvg266

Video Input: Bosphorus 1080p - Video Preset: Very Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very Fastsmt dno smt bsmt asmt cno smt asmt bbac50100150200250181.83183.75183.99192.25196.25209.55234.68234.95237.44

uvg266

Video Input: Bosphorus 1080p - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super Fastsmt asmt cno smt ano smt bsmt dsmt bcab50100150200250178.49178.78181.67216.15218.91220.79237.96238.68239.92

uvg266

Video Input: Bosphorus 1080p - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra Fastsmt bno smt ano smt bsmt asmt csmt dcba50100150200250179.56186.24209.85216.15218.28224.31238.77240.91240.98

VP9 libvpx Encoding

Speed: Speed 0 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 0 - Input: Bosphorus 4Ksmt csmt bno smt asmt dno smt bsmt aacb2468106.926.977.047.157.167.247.687.707.711. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 4Ksmt asmt bno smt ano smt bsmt dsmt cabc4812162013.9014.2714.4814.5015.1115.3817.3617.3717.461. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VP9 libvpx Encoding

Speed: Speed 0 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 0 - Input: Bosphorus 1080psmt bsmt dno smt bsmt csmt ano smt abac4812162013.5713.6813.7213.9714.0814.2814.6714.6914.761. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 1080pacbsmt asmt csmt bno smt asmt dno smt b71421283529.3729.4629.5029.5429.5429.6029.6229.6629.711. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fastcbano smt ano smt b1.32642.65283.97925.30566.6325.8085.8095.8205.8905.8951. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fasterno smt babcno smt a369121512.3112.3412.3912.4012.481. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 1080p - Video Preset: Fastno smt ano smt bbac369121512.3612.3712.4012.4412.441. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 1080p - Video Preset: Fasterno smt bno smt abac71421283528.5228.6929.8530.0430.081. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Zstd Compression

Compression Level: 3 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Compression Speedsmt bsmt dsmt csmt ano smt ano smt bacb70014002100280035002513.42528.72604.62795.12804.22865.93033.93049.43095.01. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 3 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3 - Decompression Speedno smt ano smt bsmt dasmt asmt cbcsmt b300600900120015001500.41511.51513.51514.81515.61516.21516.61517.41519.11. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Compression Speedsmt csmt asmt dsmt bno smt aano smt bbc300600900120015001005.81023.91024.81122.41227.51233.81234.21239.31241.11. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8 - Decompression Speedbcsmt csmt dsmt ano smt bano smt asmt b4008001200160020001651.01661.91664.01664.21664.31667.61669.31669.71671.01. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 12 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Compression Speedsmt csmt asmt dsmt bno smt bno smt acab70140210280350249.8254.1256.2259.1278.2279.9330.1330.8332.01. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 12 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Decompression Speedacbsmt asmt bno smt bno smt asmt dsmt c4008001200160020001704.81715.61716.71723.71726.31727.81728.01731.21732.31. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression Speedsmt aabcsmt csmt bsmt dno smt ano smt b51015202518.819.119.119.119.219.519.619.819.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression Speedbcasmt csmt dno smt asmt bno smt bsmt a300600900120015001467.81470.51472.61475.21479.11483.11483.51483.81495.21. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 3, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Compression Speedabcno smt ano smt bsmt bsmt csmt asmt d2004006008001000892.7909.4916.9955.61032.31038.91046.61051.41059.01. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 3, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 3, Long Mode - Decompression Speedabno smt bsmt asmt bcsmt cno smt asmt d300600900120015001536.61537.51538.81539.51540.41540.91540.91542.51543.61. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Compression Speedsmt bsmt ano smt asmt csmt dno smt bbca2004006008001000852.7853.8859.9860.8879.6892.0910.8926.9938.51. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 8, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 8, Long Mode - Decompression Speedbcsmt bsmt dasmt ano smt bsmt cno smt a4008001200160020001673.71675.41676.51677.61677.91682.51682.81683.71684.81. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression Speedabcno smt ano smt bsmt asmt dsmt csmt b36912159.229.299.309.399.769.789.819.829.871. (CC) gcc options: -O3 -pthread -lz

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression Speedbacsmt csmt dsmt bsmt ano smt ano smt b300600900120015001378.21383.71384.01389.01391.71392.41393.51395.81397.61. (CC) gcc options: -O3 -pthread -lz

Phoronix Test Suite v10.8.5