fhe

AMD Ryzen 5 5500U testing with a NB01 NL5xNU (1.07.11RTR1 BIOS) and AMD Lucienne 512MB on Tuxedo 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2312189-NE-FHE94421920&grs.

fheProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionabcAMD Ryzen 5 5500U @ 4.06GHz (6 Cores / 12 Threads)NB01 NL5xNU (1.07.11RTR1 BIOS)AMD Renoir/Cezanne16GBSamsung SSD 970 EVO Plus 500GBAMD Lucienne 512MB (1800/400MHz)AMD Renoir Radeon HD AudioRealtek RTL8111/8168/8411 + Intel Wi-Fi 6 AX200Tuxedo 22.046.0.0-1010-oem (x86_64)KDE Plasma 5.26.5X Server 1.21.1.34.6 Mesa 22.3.7 (LLVM 14.0.0 DRM 3.48)1.3.230GCC 11.3.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: amd-pstate ondemand (Boost: Enabled) - CPU Microcode: 0x8608103 Java Details- OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu222.04)Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

fhedacapobench: Apache Xalan XSLTonednn: IP Shapes 3D - f32 - CPUstress-ng: Semaphoresoidn: RTLightmap.hdr.4096x4096 - CPU-Onlydacapobench: PMD Source Code Analyzerdacapobench: Apache Lucene Search Engineembree: Pathtracer - Asian Dragondacapobench: Tradesoapdacapobench: FOP Print Formatterstress-ng: Fused Multiply-Addpytorch: CPU - 64 - ResNet-50java-scimark2: Fast Fourier Transformcpuminer-opt: Ringcoincpuminer-opt: Myriad-Groestldacapobench: Batik SVG Toolkitdacapobench: Zxing 1D/2D Barcode Image Processingncnn: Vulkan GPU - efficientnet-b0stress-ng: Futexjava-scimark2: Monte Carlostress-ng: Pipencnn: CPU - shufflenet-v2ncnn: CPU - blazefacedacapobench: H2O In-Memory Platform For Machine Learningonednn: Deconvolution Batch shapes_1d - f32 - CPUdacapobench: Apache Lucene Search Indexsvt-av1: Preset 13 - Bosphorus 1080pstress-ng: NUMApytorch: CPU - 1 - ResNet-50ncnn: Vulkan GPU - mobilenetstress-ng: Mixed Schedulerdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamstress-ng: CPU Stressncnn: Vulkan GPU-v2-v2 - mobilenet-v2stress-ng: Wide Vector Mathblosc: blosclz bitshuffle - 8MBspark-tpch: 1 - Geometric Mean Of All Queriesstress-ng: CPU Cachencnn: Vulkan GPU - mnasnetncnn: CPU - FastestDetdacapobench: Jythonjava-scimark2: Dense LU Matrix Factorizationdacapobench: H2 Database Engineopenradioss: Cell Phone Drop Testdacapobench: Tradebeansncnn: Vulkan GPU - squeezenet_ssdxmrig: Wownero - 1Mopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUncnn: Vulkan GPU-v3-v3 - mobilenet-v3stress-ng: Glibc C String Functionsmemtier-benchmark: Redis - 50 - 1:5easywave: e2Asean Grid + BengkuluSept2007 Source - 240openvkl: vklBenchmarkCPU Scalaropenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUstress-ng: SENDFILEmemtier-benchmark: Redis - 100 - 1:5dacapobench: Eclipsedeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamncnn: Vulkan GPU - resnet18deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16 - CPUblosc: blosclz shuffle - 8MBmemtier-benchmark: Redis - 50 - 1:10stress-ng: Vector Floating Pointdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16 - CPUjava-scimark2: Sparse Matrix Multiplyncnn: CPU - mnasnetembree: Pathtracer - Crownopenradioss: INIVOL and Fluid Structure Interaction Drop Containervvenc: Bosphorus 1080p - Fastopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUembree: Pathtracer ISPC - Crownonednn: Deconvolution Batch shapes_3d - f32 - CPUdacapobench: Apache Cassandrapytorch: CPU - 64 - Efficientnet_v2_ldacapobench: GraphChipytorch: CPU - 16 - ResNet-50stress-ng: Pthreadncnn: CPU - efficientnet-b0ffmpeg: libx265 - Livencnn: CPU - squeezenet_ssdopenradioss: Bird Strike on Windshieldncnn: Vulkan GPU - googlenetncnn: CPU - vision_transformerncnn: CPU-v3-v3 - mobilenet-v3stress-ng: AVL Treencnn: Vulkan GPU - vision_transformervvenc: Bosphorus 4K - Fastersvt-av1: Preset 12 - Bosphorus 1080popenvino: Face Detection FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamncnn: Vulkan GPU - resnet50xmrig: KawPow - 1Mncnn: CPU - yolov4-tinycpuminer-opt: scryptembree: Pathtracer ISPC - Asian Dragonxmrig: Monero - 1Mncnn: Vulkan GPU - FastestDetcloverleaf: clover_bmncnn: Vulkan GPU - regnety_400mpytorch: CPU - 32 - Efficientnet_v2_ldacapobench: Spring Bootstress-ng: Memory Copyingjava-scimark2: Compositeopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUpytorch: CPU - 32 - ResNet-50stress-ng: MMAPdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamstress-ng: MEMFDdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamonednn: IP Shapes 1D - f32 - CPUstress-ng: Floating Pointopenvino: Handwritten English Recognition FP16 - CPUncnn: CPU-v2-v2 - mobilenet-v2avifenc: 10, Losslessopenvino: Handwritten English Recognition FP16 - CPUcloverleaf: clover_bm64_shortxmrig: CryptoNight-Femto UPX2 - 1Mopenvkl: vklBenchmarkCPU ISPCdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streampytorch: CPU - 16 - ResNet-152pytorch: CPU - 32 - ResNet-152webp2: Defaultdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamstress-ng: Context Switchingdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamncnn: CPU - googlenetdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamblender: Fishy Cat - CPU-Onlyavifenc: 0deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamvvenc: Bosphorus 4K - Fastdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streambuild-gem5: Time To Compileffmpeg: libx264 - Livesvt-av1: Preset 4 - Bosphorus 1080pstress-ng: Matrix 3D Mathopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUavifenc: 6, Losslessdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamstress-ng: Vector Mathpytorch: CPU - 1 - ResNet-152pytorch: CPU - 64 - ResNet-152ncnn: CPU - alexnetstress-ng: IO_uringncnn: CPU - resnet18svt-av1: Preset 4 - Bosphorus 4Kxmrig: CryptoNight-Heavy - 1Mstress-ng: Cloningncnn: CPU - regnety_400mpytorch: CPU - 1 - Efficientnet_v2_lavifenc: 2stress-ng: Forkingmemtier-benchmark: Redis - 100 - 1:10deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamospray-studio: 1 - 1080p - 1 - Path Tracer - CPUstress-ng: Cryptoncnn: Vulkan GPU - shufflenet-v2deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamopenvino: Face Detection FP16 - CPUffmpeg: libx265 - Video On Demandopenradioss: Bumper Beamffmpeg: libx265 - Uploaddeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamstress-ng: Zlibembree: Pathtracer ISPC - Asian Dragon Objstress-ng: Matrix Mathospray-studio: 1 - 1080p - 16 - Path Tracer - CPUopenvino: Vehicle Detection FP16-INT8 - CPUsvt-av1: Preset 8 - Bosphorus 1080popenvino: Weld Porosity Detection FP16-INT8 - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUopenvino: Vehicle Detection FP16-INT8 - CPUcassandra: Writesopenvino: Weld Porosity Detection FP16-INT8 - CPUbuild-ffmpeg: Time To Compiledeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamopenvino: Face Detection FP16-INT8 - CPUsvt-av1: Preset 13 - Bosphorus 4Kopenvino: Face Detection Retail FP16-INT8 - CPUcpuminer-opt: Garlicoinscylladb: Writespytorch: CPU - 16 - Efficientnet_v2_lblender: Classroom - CPU-Onlyopenvino: Face Detection Retail FP16-INT8 - CPUdacapobench: Avrora AVR Simulation Frameworkcpuminer-opt: LBC, LBRY Creditsopenradioss: Rubber O-Ring Seal Installationopenvino: Age Gender Recognition Retail 0013 FP16 - CPUdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamstress-ng: Mutexospray-studio: 3 - 1080p - 32 - Path Tracer - CPUopenvino: Machine Translation EN To DE FP16 - CPUblosc: blosclz noshuffle - 8MBcpuminer-opt: Blake-2 Sonednn: Convolution Batch Shapes Auto - f32 - CPUwebp2: Quality 100, Compression Effort 5ncnn: Vulkan GPU - vgg16dacapobench: BioJava Biological Data Frameworkdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamospray-studio: 2 - 1080p - 32 - Path Tracer - CPUopenvino: Machine Translation EN To DE FP16 - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 2 - 1080p - 16 - Path Tracer - CPUonednn: Recurrent Neural Network Inference - f32 - CPUdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamffmpeg: libx265 - Platformospray-studio: 1 - 4K - 1 - Path Tracer - CPUstress-ng: Function Callsvt-av1: Preset 8 - Bosphorus 4Kncnn: CPU - vgg16ospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 2 - 4K - 16 - Path Tracer - CPUvvenc: Bosphorus 1080p - Fasterdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamffmpeg: libx264 - Video On Demandffmpeg: libx264 - Uploadopenvino: Vehicle Detection FP16 - CPUavifenc: 6ncnn: CPU - resnet50openvino: Vehicle Detection FP16 - CPUembree: Pathtracer - Asian Dragon Objonednn: Recurrent Neural Network Training - f32 - CPUquantlib: Multi-Threadedstress-ng: AVX-512 VNNIstress-ng: Hashncnn: Vulkan GPU - alexnetcpuminer-opt: Skeincoinncnn: CPU - mobilenetospray-studio: 2 - 1080p - 1 - Path Tracer - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamstress-ng: Pollospray-studio: 3 - 1080p - 16 - Path Tracer - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamstress-ng: Socket Activitycpuminer-opt: Deepcoindacapobench: Apache Kafkastress-ng: System V Message Passingcpuminer-opt: Magiopenvino: Road Segmentation ADAS FP16 - CPUdacapobench: Apache Tomcatbuild-gcc: Time To Compilencnn: Vulkan GPU - yolov4-tinydeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamospray-studio: 2 - 4K - 32 - Path Tracer - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamopenvino: Age Gender Recognition Retail 0013 FP16 - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamopenvino: Person Detection FP16 - CPUstress-ng: Glibc Qsort Data Sortingopenvino: Road Segmentation ADAS FP16 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamxmrig: GhostRider - 1Mdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamospray-studio: 3 - 1080p - 1 - Path Tracer - CPUbrl-cad: VGR Performance Metricdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamsvt-av1: Preset 12 - Bosphorus 4Kopenvino: Person Detection FP16 - CPUopenvino: Face Detection Retail FP16 - CPUdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamopenvino: Face Detection Retail FP16 - CPUblender: BMW27 - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyopenradioss: Chrysler Neon 1Mopenvino: Face Detection FP16 - CPUcpuminer-opt: Quad SHA-256, Pyritedeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamblender: Barbershop - CPU-Onlyospray-studio: 2 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUffmpeg: libx264 - Platformstress-ng: Vector Shuffledeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamospray-studio: 3 - 4K - 32 - Path Tracer - CPUjava-scimark2: Jacobi Successive Over-Relaxationopenvino: Person Vehicle Bike Detection FP16 - CPUstress-ng: Mallocquantlib: Single-Threadeddeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdacapobench: jMonkeyEnginecpuminer-opt: Triple SHA-256, Onecoinstress-ng: Atomicopenvino: Person Vehicle Bike Detection FP16 - CPUeasywave: e2Asean Grid + BengkuluSept2007 Source - 1200ospray-studio: 3 - 4K - 1 - Path Tracer - CPUstress-ng: x86_64 RdRandncnn: Vulkan GPU - blazefaceoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlywebp2: Quality 100, Lossless Compressionwebp2: Quality 95, Compression Effort 7webp2: Quality 75, Compression Effort 7spark-tpch: 1 - Q22spark-tpch: 1 - Q21spark-tpch: 1 - Q20spark-tpch: 1 - Q19spark-tpch: 1 - Q18spark-tpch: 1 - Q17spark-tpch: 1 - Q16spark-tpch: 1 - Q15spark-tpch: 1 - Q14spark-tpch: 1 - Q13spark-tpch: 1 - Q12spark-tpch: 1 - Q11spark-tpch: 1 - Q10spark-tpch: 1 - Q09spark-tpch: 1 - Q08spark-tpch: 1 - Q07spark-tpch: 1 - Q06spark-tpch: 1 - Q05spark-tpch: 1 - Q04spark-tpch: 1 - Q03spark-tpch: 1 - Q02spark-tpch: 1 - Q01abc147110.607812140043.030.11318049257.12561166210565581744.411.10236.1809.382685.02165622418.542056701.461535.013369398.64.341.43589812.06525266262.016107.8320.2822.075998.564.821113802.285.84246414.847005.62.400138731567966.454.515.0169883008.935448203.691487115.42532.356.3670.914.65307606.721762546.4419.01956115.0552.1397345.171749374.051446525.729211.74616.597328.727200.81746685.7116476.3116.5721139.152151.264.566.26611282.017.8954919.465.571711.280696893.47453612.0687982.488.5659.7115.39563.8916.33152.524.5936.2152.594.944210.8452292.524.596628.381705.232.3954.027.09731706.35.1189.249.523.5240801903.461725.8815.03265.8311.87108.29322.1667260.269.28838.886661929.2349.865.917.764120.25357.591708.3103116.5395.195.244.2156.82752044079.4625.716616.22518.3032352.65253.54328.3037105.83972.32652.74711036.06166.567.407655.731.1918.16323.522142.499538176.438.785.209.18154334.5211.891.9921711.3805.439.565.51116.48424389.051767574.95226.5659714113443.744.314.40221.4625.62343.3112.455.75647.892520.8692714.266.152431801.4119816142.748.99531.29070662843060192.289.9345.1875192.76021.7257.997451.52699.76484623.49741.288.84149533717.99457.851.81649.70012874216.79274754226.55092.93401022.04912.0670.937853652.295823662017.644554721213533525.964.591825.65347964081.4215.79571.2153753146505717.19652.117440.9310.9936.4812.42228.6109.516.87985852.617332.3239957.631369137.059.198334.9121.69718771.7605699249.9614029841.75324105.681836.3960906906619.23160.75163.39110391914.16932.3457.505592256426.03123262.6138.4017225.6284.431856.3421261.73150.1924.4689.2555248.811.195483558227753.191420.925847.76455.75515.26383.6223.833941.947310.39274.06926.752140.542709.931255040.086224.93522872.43520323287340.874032.3203.72194.908310704521698.07195.632857973.822767.1224.56974.452769581796045920.42337.427397636663.751.440.230.230.010.030.071.302993549.07305052.413729191.560506584.206442363.627112151.49608291.744464281.667633891.702048182.259276871.408072712.772442824.395793912.589612252.905851361.320014363.343907122.957426793.146645072.695819144.986022129611.817811087929.70.12345649377.59221147410405561152.611.67251.73857.492827.68157723438.562147335.671593.683503830.274.51.42600011.93435113265.763110.7220.7221.526043.574.897113473.645.98240673.8369852.438337261533029.064.535.0268382980.355525203.231459815.272513.956.7870.384.685411002.921729895.5618.96855113.3252.9199090.81719244.181454026.1311.94611.924428.827309.51734539.8816206.61114.7826138.632117.344.496.17011293.897.7934992.25.642311.445596103.52449211.9188920.648.4459.3015.28563.7416.29151.154.6236.13150.734.981212.3712273.394.540428.651726.13254.37.11781726.75.11187.029.633.4840691882.011727.9515.2262.8611.80107.12318.7207258.689.38848.880021936.0149.725.97.761120.56354.081725.2104117.59165.245.204.2057.35652025241.4325.505616.34521.4212353.84252.63328.4701105.21212.30752.27941044.611165.237.466652.41.1818.10723.399442.72237936.858.825.249.11154554.511.81.9991724800.449.595.51117.32624288.061762578.3224.9789712213458.674.344.43281.4625.64345.1712.445.725947.598220.9979717.656.149631958.65119397142.3749.29631.0191073728.0742968193.3490.4665.1603193.77361.7358.334452.11698.16485723.47740.038.83150333697.25457.971.8653.14712878214.99274126227.425107.43410022.15662.0771.167820655.298823614517.574575401214763516.724.574625.64349454065.4415.85471.553977346431917.16352.273540.8310.9536.4612.37828.5109.566.86735868.6317273.4239843.621364579.59.188349.0321.66720071.684698234.2613987841.83044096.521838.9861086910876.85160.98163.32110701919.53432.2557.361392392825.96143271.3838.5047225.94864.425656.3774262.39150.5224.4789.183224911.204283518211853.165820.880847.865155.86515.23384.3723.880441.86610.37273.88926.692140.082709.891255040.025524.97252875.213516223302940.824031.9203.53864.912710694181696.66195.62856309.442769.2224.64364.4513696217950459.1420.42337.548397726665.261.440.230.230.010.030.071.535104639.547798162.547008511.779425744.267047413.6193491.517686371.779198171.661646721.569976812.203383451.288396722.799874544.367016322.552676922.909097191.394137983.216317652.871533163.496449712.768858915.20342541130511.940111469661.560.12332753147.6511123169855947777.7111.84247.29815.832704.56160322558.922102668.911530.093501532.414.461.47610311.70125225258.675108.9620.8221.876149.714.940513732.885.98241097.0371472.383609431539578.224.435.1268952945.785563199.581489815.092564.555.6771.784.6953170941743565.7119.3145611353.0798736.211735403.811471625.692211.82606.381929.27320.81763427.6716263.83116.6805136.892122.284.516.23811274.17.9094942.115.653611.412795503.48447211.8989239.528.4860.1315.49556.3116.51150.534.6536.6150.675.007213.5052301.994.576428.731725.832.2154.677.18221724.15.05188.409.543.5040341897.681708.6115.14264.0711.93107.46320.0604257.489.34918.972031949.1250.235.857.686119.36354.291724.4104117.66895.205.254.2456.92042036534.7825.480216.37516.6462350.61251.24228.5625104.88132.32852.68211035.725165.157.47650.21.1918.01523.590742.375938241.248.755.239.17155512.7411.812.0071723.8799.569.635.47117.28124216.781775067.44225.1522709113364.444.344.42951.4725.79345.5712.525.762547.900420.8656718.756.188132000.11119077143.2549.19831.0390520627.942804193.2390.0465.1904192.65131.7258.087454.14702.2482933.49737.068.79149483704.54455.421.81649.56832889633.43273323227.685119.13418022.07312.0771.277857653.460723554517.564560871209273510.034.59525.75348854082.6915.86271.253770446329017.13152.081840.9810.9636.5912.39728.54109.186.85625872.6717326.6240648.241366996.539.218361.8521.73717871.5417700345.6114005741.87824108.671841.8360976891049.07161.21163.78110601917.26432.3157.518192141225.98683265.8938.467225.37064.436956.2353262.13150.5624.4189.4012248.411.177383358230453.284420.906647.807855.86315.23384.0623.841441.93410.38273.54925.222137.082705.551253040.078324.93992871.443515723316540.874036.74203.75664.907510703411697.6195.762858628.372767.4224.49014.4543695917950458.9120.41337.546397746664.611.440.230.230.010.030.071.507564078.86384012.362868311.629401454.272692683.50928021.444920421.7699071.675243621.501641752.181554081.307765012.889416934.189742572.657721522.904565811.391615273.146521572.766784433.211069353.074456455.06900406OpenBenchmarking.org

DaCapo Benchmark

Java Test: Apache Xalan XSLT

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Xalan XSLTabc30060090012001500147112961305

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUabc369121510.6111.8211.94MIN: 10.34MIN: 11.43MIN: 11.641. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphoresabc3M6M9M12M15M12140043.0311087929.7011469661.561. (CXX) g++ options: -O2 -std=gnu99 -lc

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlyabc0.0270.0540.0810.1080.1350.110.120.12

DaCapo Benchmark

Java Test: PMD Source Code Analyzer

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: PMD Source Code Analyzerabc7001400210028003500318034563327

DaCapo Benchmark

Java Test: Apache Lucene Search Engine

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search Engineabc11002200330044005500492549375314

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragonabc2468107.12567.59227.6511MIN: 7.08 / MAX: 7.28MIN: 7.54 / MAX: 7.76MIN: 7.6 / MAX: 7.84

DaCapo Benchmark

Java Test: Tradesoap

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Tradesoapabc3K6K9K12K15K116621147412316

DaCapo Benchmark

Java Test: FOP Print Formatter

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: FOP Print Formatterabc200400600800100010561040985

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Addabc1.3M2.6M3.9M5.2M6.5M5581744.405561152.605947777.711. (CXX) g++ options: -O2 -std=gnu99 -lc

PyTorch

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50abc369121511.1011.6711.84MIN: 9.27 / MAX: 12.44MIN: 9.24 / MAX: 13.18MIN: 9.81 / MAX: 13.3

Java SciMark

Computational Test: Fast Fourier Transform

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Fast Fourier Transformabc50100150200250236.10251.73247.29

Cpuminer-Opt

Algorithm: Ringcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Ringcoinabc2004006008001000809.38857.49815.831. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Myriad-Groestl

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Myriad-Groestlabc60012001800240030002685.022827.682704.561. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

DaCapo Benchmark

Java Test: Batik SVG Toolkit

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Batik SVG Toolkitabc400800120016002000165615771603

DaCapo Benchmark

Java Test: Zxing 1D/2D Barcode Image Processing

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Zxing 1D/2D Barcode Image Processingabc5001000150020002500224123432255

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b0abc2468108.548.568.92MIN: 8.18 / MAX: 14.64MIN: 8.27 / MAX: 16.23MIN: 8.23 / MAX: 96.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Futexabc500K1000K1500K2000K2500K2056701.462147335.672102668.911. (CXX) g++ options: -O2 -std=gnu99 -lc

Java SciMark

Computational Test: Monte Carlo

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Monte Carloabc300600900120015001535.011593.681530.09

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipeabc800K1600K2400K3200K4000K3369398.603503830.273501532.411. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v2abc1.01252.0253.03754.055.06254.344.504.46MIN: 4.18 / MAX: 7.26MIN: 4.23 / MAX: 32.01MIN: 4.17 / MAX: 7.151. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazefaceabc0.33080.66160.99241.32321.6541.431.421.47MIN: 1.38 / MAX: 1.65MIN: 1.38 / MAX: 2.05MIN: 1.4 / MAX: 2.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

DaCapo Benchmark

Java Test: H2O In-Memory Platform For Machine Learning

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: H2O In-Memory Platform For Machine Learningabc13002600390052006500589860006103

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUabc369121512.0711.9311.70MIN: 7.42MIN: 7.67MIN: 7.481. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

DaCapo Benchmark

Java Test: Apache Lucene Search Index

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search Indexabc11002200330044005500526651135225

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 1080pabc60120180240300262.02265.76258.681. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMAabc20406080100107.83110.72108.961. (CXX) g++ options: -O2 -std=gnu99 -lc

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50abc51015202520.2820.7220.82MIN: 17 / MAX: 22.8MIN: 16.36 / MAX: 23.54MIN: 17.2 / MAX: 23.53

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenetabc51015202522.0721.5221.87MIN: 21.39 / MAX: 54.54MIN: 20.87 / MAX: 32.66MIN: 20.95 / MAX: 68.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed Schedulerabc130026003900520065005998.566043.576149.711. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamabc1.11162.22323.33484.44645.5584.82114.89714.9405

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stressabc3K6K9K12K15K13802.2813473.6413732.881. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2abc1.34552.6914.03655.3826.72755.845.985.98MIN: 5.6 / MAX: 8.12MIN: 5.65 / MAX: 12.76MIN: 5.6 / MAX: 12.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Mathabc50K100K150K200K250K246414.84240673.83241097.031. (CXX) g++ options: -O2 -std=gnu99 -lc

C-Blosc

Test: blosclz bitshuffle - Buffer Size: 8MB

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.11Test: blosclz bitshuffle - Buffer Size: 8MBabc150030004500600075007005.66985.07147.01. (CC) gcc options: -std=gnu99 -O3 -ldl -lrt -lm

Apache Spark TPC-H

Scale Factor: 1 - Geometric Mean Of All Queries

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Geometric Mean Of All Queriesabc0.54861.09721.64582.19442.7432.400138732.438337262.38360943MIN: 1.3 / MAX: 9.07MIN: 1.29 / MAX: 9.55MIN: 1.31 / MAX: 8.86

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cacheabc300K600K900K1200K1500K1567966.451533029.061539578.221. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnetabc1.01932.03863.05794.07725.09654.514.534.43MIN: 4.3 / MAX: 12.69MIN: 4.34 / MAX: 6.59MIN: 4.27 / MAX: 6.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDetabc1.1522.3043.4564.6085.765.015.025.12MIN: 4.86 / MAX: 7.02MIN: 4.86 / MAX: 6.77MIN: 5.01 / MAX: 7.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Jythonabc15003000450060007500698868386895

Java SciMark

Computational Test: Dense LU Matrix Factorization

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Dense LU Matrix Factorizationabc60012001800240030003008.932980.352945.78

DaCapo Benchmark

Java Test: H2 Database Engine

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: H2 Database Engineabc12002400360048006000544855255563

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop Testabc4080120160200203.69203.23199.58

DaCapo Benchmark

Java Test: Tradebeans

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Tradebeansabc3K6K9K12K15K148711459814898

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssdabc4812162015.4015.2715.09MIN: 14.87 / MAX: 28.18MIN: 14.83 / MAX: 21.07MIN: 14.67 / MAX: 21.11. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1Mabc60012001800240030002532.32513.92564.51. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUabc132639526556.3656.7855.67MIN: 44.65 / MAX: 78.53MIN: 33.46 / MAX: 74.61MIN: 47.49 / MAX: 82.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUabc163248648070.9170.3871.781. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3abc1.05532.11063.16594.22125.27654.604.684.69MIN: 4.41 / MAX: 10.59MIN: 4.47 / MAX: 17.72MIN: 4.44 / MAX: 18.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functionsabc1.2M2.4M3.6M4.8M6M5307606.725411002.925317094.001. (CXX) g++ options: -O2 -std=gnu99 -lc

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5abc400K800K1200K1600K2000K1762546.441729895.561743565.711. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240abc51015202519.0218.9719.311. (CXX) g++ options: -O3 -fopenmp

OpenVKL

Benchmark: vklBenchmarkCPU Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU Scalarabc1326395265565556MIN: 4 / MAX: 1095MIN: 4 / MAX: 1098MIN: 4 / MAX: 1096

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUabc306090120150115.05113.32113.00MIN: 66.21 / MAX: 156.66MIN: 87.68 / MAX: 144.49MIN: 81.78 / MAX: 141.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUabc122436486052.1352.9153.071. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILEabc20K40K60K80K100K97345.1799090.8098736.211. (CXX) g++ options: -O2 -std=gnu99 -lc

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5abc400K800K1200K1600K2000K1749374.051719244.181735403.811. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

DaCapo Benchmark

Java Test: Eclipse

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Eclipseabc3K6K9K12K15K144651454014716

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc61218243025.7326.1325.69

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet18abc369121511.7411.9411.82MIN: 11.45 / MAX: 18.54MIN: 11.32 / MAX: 60.89MIN: 11.46 / MAX: 18.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamabc130260390520650616.60611.92606.38

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUabc71421283528.7228.8229.20MIN: 24.22 / MAX: 46.15MIN: 24.57 / MAX: 45.98MIN: 20.8 / MAX: 91.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

C-Blosc

Test: blosclz shuffle - Buffer Size: 8MB

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.11Test: blosclz shuffle - Buffer Size: 8MBabc160032004800640080007200.87309.57320.81. (CC) gcc options: -std=gnu99 -O3 -ldl -lrt -lm

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10abc400K800K1200K1600K2000K1746685.711734539.881763427.671. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Pointabc4K8K12K16K20K16476.3016206.6116263.831. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc306090120150116.57114.78116.68

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUabc306090120150139.15138.63136.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Java SciMark

Computational Test: Sparse Matrix Multiply

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Sparse Matrix Multiplyabc50010001500200025002151.262117.342122.28

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnetabc1.0262.0523.0784.1045.134.564.494.51MIN: 4.31 / MAX: 10.03MIN: 4.35 / MAX: 6.6MIN: 4.31 / MAX: 6.831. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Crownabc2468106.26616.17016.2381MIN: 6.22 / MAX: 6.37MIN: 6.13 / MAX: 6.27MIN: 6.19 / MAX: 6.33

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop Containerabc300600900120015001282.011293.891274.10

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fastabc2468107.8957.7937.9091. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabc110022003300440055004919.464992.204942.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Crownabc1.27212.54423.81635.08846.36055.57175.64235.6536MIN: 5.54 / MAX: 5.63MIN: 5.6 / MAX: 5.73MIN: 5.61 / MAX: 5.73

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUabc369121511.2811.4511.41MIN: 10.65MIN: 10.89MIN: 10.791. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

DaCapo Benchmark

Java Test: Apache Cassandra

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Cassandraabc2K4K6K8K10K968996109550

PyTorch

Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_labc0.7921.5842.3763.1683.963.473.523.48MIN: 2.92 / MAX: 3.91MIN: 2.89 / MAX: 3.88MIN: 2.92 / MAX: 3.82

DaCapo Benchmark

Java Test: GraphChi

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: GraphChiabc10002000300040005000453644924472

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-50abc369121512.0611.9111.89MIN: 9.84 / MAX: 13.85MIN: 10.01 / MAX: 13.53MIN: 10.04 / MAX: 13.47

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthreadabc20K40K60K80K100K87982.4888920.6489239.521. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b0abc2468108.568.448.48MIN: 8.24 / MAX: 15.56MIN: 8.16 / MAX: 11.8MIN: 8.19 / MAX: 11.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

FFmpeg

Encoder: libx265 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Liveabc132639526559.7159.3060.131. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssdabc4812162015.3915.2815.49MIN: 14.89 / MAX: 31.68MIN: 14.79 / MAX: 22.91MIN: 14.8 / MAX: 34.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on Windshieldabc120240360480600563.89563.74556.31

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenetabc4812162016.3316.2916.51MIN: 15.7 / MAX: 24.12MIN: 15.71 / MAX: 22.39MIN: 15.79 / MAX: 22.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformerabc306090120150152.52151.15150.53MIN: 149.07 / MAX: 186.85MIN: 147.31 / MAX: 195.77MIN: 147.14 / MAX: 193.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v3abc1.04632.09263.13894.18525.23154.594.624.65MIN: 4.44 / MAX: 6.6MIN: 4.46 / MAX: 6.86MIN: 4.41 / MAX: 8.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Treeabc81624324036.2036.1336.601. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformerabc306090120150152.59150.73150.67MIN: 148.63 / MAX: 239.62MIN: 147.59 / MAX: 166.06MIN: 147.18 / MAX: 169.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fasterabc1.12662.25323.37984.50645.6334.9444.9815.0071. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 1080pabc50100150200250210.85212.37213.511. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUabc50010001500200025002292.522273.392301.99MIN: 1831.17 / MAX: 2445.01MIN: 1955.16 / MAX: 2430.88MIN: 1851.05 / MAX: 2439.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabc1.03422.06843.10264.13685.1714.59664.54044.5764

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet50abc71421283528.3828.6528.73MIN: 27.04 / MAX: 35.23MIN: 26.91 / MAX: 36.74MIN: 26.98 / MAX: 77.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Xmrig

Variant: KawPow - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1Mabc4008001200160020001705.21726.11725.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tinyabc81624324032.3932.0032.21MIN: 31.6 / MAX: 38.22MIN: 31.34 / MAX: 41.92MIN: 31.5 / MAX: 42.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Cpuminer-Opt

Algorithm: scrypt

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: scryptabc122436486054.0254.3054.671. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragonabc2468107.09737.11787.1822MIN: 7.05 / MAX: 7.25MIN: 7.07 / MAX: 7.27MIN: 7.13 / MAX: 7.34

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1Mabc4008001200160020001706.31726.71724.11. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDetabc1.14982.29963.44944.59925.7495.105.115.05MIN: 4.99 / MAX: 6.93MIN: 4.94 / MAX: 6.99MIN: 4.93 / MAX: 7.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

CloverLeaf

Input: clover_bm

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bmabc4080120160200189.24187.02188.401. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400mabc36912159.529.639.54MIN: 9.26 / MAX: 15.11MIN: 9.28 / MAX: 14.8MIN: 9.27 / MAX: 13.761. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

PyTorch

Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_labc0.7921.5842.3763.1683.963.523.483.50MIN: 2.9 / MAX: 3.86MIN: 2.9 / MAX: 3.78MIN: 2.92 / MAX: 3.8

DaCapo Benchmark

Java Test: Spring Boot

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Spring Bootabc9001800270036004500408040694034

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copyingabc4008001200160020001903.461882.011897.681. (CXX) g++ options: -O2 -std=gnu99 -lc

Java SciMark

Computational Test: Composite

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Compositeabc4008001200160020001725.881727.951708.61

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUabc4812162015.0315.2015.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUabc60120180240300265.83262.86264.07MIN: 154.12 / MAX: 298.88MIN: 232.22 / MAX: 299.62MIN: 228.94 / MAX: 302.081. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PyTorch

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-50abc369121511.8711.8011.93MIN: 9.95 / MAX: 13.33MIN: 9.72 / MAX: 13.59MIN: 9.9 / MAX: 13.75

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPabc20406080100108.29107.12107.461. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc70140210280350322.17318.72320.06

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDabc60120180240300260.26258.68257.481. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc36912159.28839.38849.3491

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUabc36912158.886668.880028.97203MIN: 8.48MIN: 8.5MIN: 8.581. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Pointabc4008001200160020001929.231936.011949.121. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUabc112233445549.8649.7250.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v2abc1.32982.65963.98945.31926.6495.915.905.85MIN: 5.61 / MAX: 13.79MIN: 5.59 / MAX: 12.01MIN: 5.62 / MAX: 8.371. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, Losslessabc2468107.7647.7617.6861. (CXX) g++ options: -O3 -fPIC -lm

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUabc306090120150120.25120.56119.36MIN: 79.3 / MAX: 149.21MIN: 91.75 / MAX: 152.9MIN: 89.26 / MAX: 148.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

CloverLeaf

Input: clover_bm64_short

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortabc80160240320400357.59354.08354.291. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

Xmrig

Variant: CryptoNight-Femto UPX2 - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1Mabc4008001200160020001708.31725.21724.41. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCabc20406080100103104104MIN: 8 / MAX: 1377MIN: 8 / MAX: 1392MIN: 8 / MAX: 1386

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabc306090120150116.54117.59117.67

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-152abc1.1792.3583.5374.7165.8955.195.245.20MIN: 4.28 / MAX: 5.82MIN: 4.23 / MAX: 5.83MIN: 4.2 / MAX: 5.88

PyTorch

Device: CPU - Batch Size: 32 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-152abc1.18132.36263.54394.72525.90655.245.205.25MIN: 4.14 / MAX: 5.89MIN: 4.3 / MAX: 5.83MIN: 4.31 / MAX: 5.89

WebP2 Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Defaultabc0.9541.9082.8623.8164.774.214.204.241. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamabc132639526556.8357.3656.92

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context Switchingabc400K800K1200K1600K2000K2044079.462025241.432036534.781. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabc61218243025.7225.5125.48

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenetabc4812162016.2216.3416.37MIN: 15.74 / MAX: 23.62MIN: 15.74 / MAX: 25.53MIN: 15.93 / MAX: 21.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabc110220330440550518.30521.42516.65

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-Onlyabc80160240320400352.65353.84350.61

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0abc60120180240300253.54252.63251.241. (CXX) g++ options: -O3 -fPIC -lm

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc71421283528.3028.4728.56

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc20406080100105.84105.21104.88

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fastabc0.52381.04761.57142.09522.6192.3262.3072.3281. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamabc122436486052.7552.2852.68

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To Compileabc20040060080010001036.061044.611035.73

FFmpeg

Encoder: libx264 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Liveabc4080120160200166.56165.23165.151. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 1080pabc2468107.4077.4667.4701. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Mathabc140280420560700655.73652.40650.201. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUabc0.26780.53560.80341.07121.3391.191.181.19MIN: 0.55 / MAX: 10.47MIN: 0.57 / MAX: 15.06MIN: 0.57 / MAX: 13.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslessabc4812162018.1618.1118.021. (CXX) g++ options: -O3 -fPIC -lm

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamabc61218243023.5223.4023.59

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamabc102030405042.5042.7242.38

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Mathabc8K16K24K32K40K38176.4337936.8538241.241. (CXX) g++ options: -O2 -std=gnu99 -lc

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152abc2468108.788.828.75MIN: 6.78 / MAX: 9.95MIN: 7.02 / MAX: 10.05MIN: 7.08 / MAX: 9.99

PyTorch

Device: CPU - Batch Size: 64 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152abc1.1792.3583.5374.7165.8955.205.245.23MIN: 4.15 / MAX: 5.77MIN: 4.28 / MAX: 5.84MIN: 4.22 / MAX: 5.85

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnetabc36912159.189.119.17MIN: 8.91 / MAX: 16.93MIN: 8.86 / MAX: 18.25MIN: 8.9 / MAX: 16.021. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringabc30K60K90K120K150K154334.52154554.50155512.741. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet18abc369121511.8911.8011.81MIN: 11.52 / MAX: 18.09MIN: 11.48 / MAX: 20.39MIN: 11.46 / MAX: 17.51. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4Kabc0.45160.90321.35481.80642.2581.9921.9992.0071. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Xmrig

Variant: CryptoNight-Heavy - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1Mabc4008001200160020001711.31724.01723.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Stress-NG

Test: Cloning

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cloningabc2004006008001000805.43800.44799.561. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400mabc36912159.569.599.63MIN: 9.28 / MAX: 16.82MIN: 9.28 / MAX: 14.12MIN: 9.32 / MAX: 12.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

PyTorch

Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_labc1.23982.47963.71944.95926.1995.515.515.47MIN: 4.63 / MAX: 5.95MIN: 4.61 / MAX: 6.06MIN: 4.63 / MAX: 6.05

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2abc306090120150116.48117.33117.281. (CXX) g++ options: -O3 -fPIC -lm

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Forkingabc5K10K15K20K25K24389.0524288.0624216.781. (CXX) g++ options: -O2 -std=gnu99 -lc

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10abc400K800K1200K1600K2000K1767574.951762578.301775067.441. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Streamabc50100150200250226.57224.98225.15

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUabc15003000450060007500714171227091

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cryptoabc3K6K9K12K15K13443.7413458.6713364.441. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v2abc0.97651.9532.92953.9064.88254.314.344.34MIN: 4.18 / MAX: 6.35MIN: 4.19 / MAX: 11.27MIN: 4.17 / MAX: 9.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Streamabc0.99741.99482.99223.98964.9874.40224.43284.4295

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUabc0.33080.66160.99241.32321.6541.461.461.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

FFmpeg

Encoder: libx265 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On Demandabc61218243025.6225.6425.791. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper Beamabc80160240320400343.31345.17345.57

FFmpeg

Encoder: libx265 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Uploadabc369121512.4512.4412.521. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamabc1.29662.59323.88985.18646.4835.75605.72595.7625

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Synchronous Single-Streamabc112233445547.8947.6047.90

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Synchronous Single-Streamabc51015202520.8721.0020.87

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlibabc160320480640800714.26717.65718.751. (CXX) g++ options: -O2 -std=gnu99 -lc

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon Objabc2468106.15246.14966.1881MIN: 6.11 / MAX: 6.3MIN: 6.11 / MAX: 6.28MIN: 6.15 / MAX: 6.31

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Mathabc7K14K21K28K35K31801.4031958.6532000.111. (CXX) g++ options: -O2 -std=gnu99 -lc

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUabc30K60K90K120K150K119816119397119077

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUabc306090120150142.70142.37143.251. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 1080pabc112233445549.0049.3049.201. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUabc71421283531.2031.0131.03MIN: 23.75 / MAX: 44.87MIN: 24.54 / MAX: 43.5MIN: 21.89 / MAX: 48.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUabc200K400K600K800K1000K907066910737905206

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUabc71421283528.0028.0727.90MIN: 17.95 / MAX: 41.21MIN: 15.75 / MAX: 46.54MIN: 20.57 / MAX: 43.211. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writesabc9K18K27K36K45K430604296842804

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUabc4080120160200192.20193.34193.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To Compileabc2040608010089.9390.4790.05

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Streamabc1.16782.33563.50344.67125.8395.18755.16035.1904

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Streamabc4080120160200192.76193.77192.65

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUabc0.38930.77861.16791.55721.94651.721.731.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4Kabc132639526558.0058.3358.091. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUabc100200300400500451.52452.11454.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Garlicoinabc150300450600750699.76698.16702.201. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

ScyllaDB

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterScyllaDB 5.2.9Test: Writesabc10K20K30K40K50K484624857248293

PyTorch

Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_labc0.78531.57062.35593.14123.92653.493.473.49MIN: 2.86 / MAX: 3.79MIN: 2.91 / MAX: 3.79MIN: 2.92 / MAX: 3.88

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-Onlyabc160320480640800741.28740.03737.06

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUabc2468108.848.838.79MIN: 6.3 / MAX: 17.28MIN: 6 / MAX: 16.62MIN: 5.75 / MAX: 20.161. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

DaCapo Benchmark

Java Test: Avrora AVR Simulation Framework

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Avrora AVR Simulation Frameworkabc3K6K9K12K15K149531503314948

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: LBC, LBRY Creditsabc80016002400320040003717.993697.253704.541. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal Installationabc100200300400500457.85457.97455.42

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUabc0.40730.81461.22191.62922.03651.811.801.81MIN: 1 / MAX: 10.22MIN: 1.01 / MAX: 19.26MIN: 0.98 / MAX: 11.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamabc140280420560700649.70653.15649.57

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutexabc600K1200K1800K2400K3000K2874216.792878214.992889633.431. (CXX) g++ options: -O2 -std=gnu99 -lc

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUabc60K120K180K240K300K274754274126273323

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUabc50100150200250226.50227.42227.68MIN: 142.3 / MAX: 257.79MIN: 134.56 / MAX: 364.33MIN: 164.95 / MAX: 261.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

C-Blosc

Test: blosclz noshuffle - Buffer Size: 8MB

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.11Test: blosclz noshuffle - Buffer Size: 8MBabc110022003300440055005092.95107.45119.11. (CC) gcc options: -std=gnu99 -O3 -ldl -lrt -lm

Cpuminer-Opt

Algorithm: Blake-2 S

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Blake-2 Sabc7K14K21K28K35K3401034100341801. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUabc51015202522.0522.1622.07MIN: 21.6MIN: 21.68MIN: 21.591. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

WebP2 Image Encode

Encode Settings: Quality 100, Compression Effort 5

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Compression Effort 5abc0.46580.93161.39741.86322.3292.062.072.071. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg16abc163248648070.9371.1671.27MIN: 69.58 / MAX: 79.76MIN: 69.68 / MAX: 111.48MIN: 69.92 / MAX: 80.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

DaCapo Benchmark

Java Test: BioJava Biological Data Framework

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: BioJava Biological Data Frameworkabc2K4K6K8K10K785378207857

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamabc140280420560700652.30655.30653.46

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUabc50K100K150K200K250K236620236145235545

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUabc4812162017.6417.5717.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUabc100K200K300K400K500K455472457540456087

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUabc30K60K90K120K150K121353121476120927

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUabc80016002400320040003525.963516.723510.03MIN: 3431.46MIN: 3421.71MIN: 3418.071. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamabc1.03392.06783.10174.13565.16954.59184.57464.5950

FFmpeg

Encoder: libx265 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Platformabc61218243025.6525.6425.751. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUabc7K14K21K28K35K347963494534885

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Callabc90018002700360045004081.424065.444082.691. (CXX) g++ options: -O2 -std=gnu99 -lc

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4Kabc4812162015.8015.8515.861. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg16abc163248648071.2171.5071.20MIN: 69.71 / MAX: 119.51MIN: 69.77 / MAX: 94.55MIN: 69.67 / MAX: 81.341. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUabc120K240K360K480K600K537531539773537704

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUabc100K200K300K400K500K465057464319463290

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fasterabc4812162017.2017.1617.131. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabc122436486052.1252.2752.08

FFmpeg

Encoder: libx264 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Video On Demandabc91827364540.9340.8340.981. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Uploadabc369121510.9910.9510.961. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUabc81624324036.4836.4636.59MIN: 22.64 / MAX: 65.82MIN: 25.47 / MAX: 56.25MIN: 18.14 / MAX: 60.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6abc369121512.4212.3812.401. (CXX) g++ options: -O3 -fPIC -lm

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet50abc71421283528.6028.5028.54MIN: 27.3 / MAX: 36.9MIN: 26.91 / MAX: 36.74MIN: 26.96 / MAX: 39.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUabc20406080100109.51109.56109.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon Objabc2468106.87986.86736.8562MIN: 6.83 / MAX: 7.02MIN: 6.82 / MAX: 7.03MIN: 6.81 / MAX: 7

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUabc130026003900520065005852.605868.635872.67MIN: 5725.89MIN: 5739.43MIN: 5729.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

QuantLib

Configuration: Multi-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-Threadedabc4K8K12K16K20K17332.317273.417326.61. (CXX) g++ options: -O3 -march=native -fPIE -pie

Stress-NG

Test: AVX-512 VNNI

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNIabc50K100K150K200K250K239957.63239843.62240648.241. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hashabc300K600K900K1200K1500K1369137.051364579.501366996.531. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnetabc36912159.199.189.21MIN: 8.87 / MAX: 12.08MIN: 8.82 / MAX: 16.24MIN: 8.84 / MAX: 17.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Skeincoinabc2K4K6K8K10K8334.918349.038361.851. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenetabc51015202521.6921.6621.73MIN: 21.1 / MAX: 28.63MIN: 21.04 / MAX: 28.26MIN: 21.2 / MAX: 28.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUabc15003000450060007500718772007178

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabc163248648071.7671.6871.54

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pollabc150K300K450K600K750K699249.96698234.26700345.611. (CXX) g++ options: -O2 -std=gnu99 -lc

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUabc30K60K90K120K150K140298139878140057

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamabc102030405041.7541.8341.88

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket Activityabc90018002700360045004105.684096.524108.671. (CXX) g++ options: -O2 -std=gnu99 -lc

Cpuminer-Opt

Algorithm: Deepcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Deepcoinabc4008001200160020001836.391838.981841.831. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

DaCapo Benchmark

Java Test: Apache Kafka

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Kafkaabc13002600390052006500609061086097

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passingabc1.5M3M4.5M6M7.5M6906619.236910876.856891049.071. (CXX) g++ options: -O2 -std=gnu99 -lc

Cpuminer-Opt

Algorithm: Magi

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Magiabc4080120160200160.75160.98161.211. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUabc4080120160200163.39163.32163.78MIN: 98.97 / MAX: 221.05MIN: 76.65 / MAX: 208.06MIN: 128.38 / MAX: 215.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

DaCapo Benchmark

Java Test: Apache Tomcat

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Tomcatabc2K4K6K8K10K110391107011060

Timed GCC Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 13.2Time To Compileabc4008001200160020001914.171919.531917.26

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tinyabc81624324032.3432.2532.31MIN: 31.72 / MAX: 37.86MIN: 31.59 / MAX: 40.48MIN: 31.47 / MAX: 40.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamabc132639526557.5157.3657.52

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUabc200K400K600K800K1000K922564923928921412

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streamabc61218243026.0325.9625.99

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUabc70014002100280035003262.613271.383265.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streamabc91827364538.4038.5038.47

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamabc50100150200250225.63225.95225.37

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamabc0.99831.99662.99493.99324.99154.43184.42564.4369

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc132639526556.3456.3856.24

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUabc60120180240300261.73262.39262.13MIN: 211.82 / MAX: 297.88MIN: 143.56 / MAX: 301.51MIN: 196.09 / MAX: 303.221. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sortingabc306090120150150.19150.52150.561. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUabc61218243024.4624.4724.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Streamabc2040608010089.2689.1889.40

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1Mabc50100150200250248.8249.0248.41. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Streamabc369121511.2011.2011.18

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUabc2K4K6K8K10K835583518335

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metricabc20K40K60K80K100K8227782118823041. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc122436486053.1953.1753.28

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamabc51015202520.9320.8820.91

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streamabc112233445547.7647.8747.81

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4Kabc132639526555.7655.8755.861. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUabc4812162015.2615.2315.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUabc80160240320400383.62384.37384.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Streamabc61218243023.8323.8823.84

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Streamabc102030405041.9541.8741.93

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUabc369121510.3910.3710.38MIN: 5.19 / MAX: 22.54MIN: 6.89 / MAX: 21.86MIN: 5.14 / MAX: 21.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-Onlyabc60120180240300274.06273.88273.54

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-Onlyabc2004006008001000926.75926.69925.22

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1Mabc50010001500200025002140.542140.082137.08

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUabc60012001800240030002709.932709.892705.55MIN: 2079.4 / MAX: 2803.64MIN: 2071.72 / MAX: 2802.51MIN: 2050.1 / MAX: 2797.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Quad SHA-256, Pyriteabc3K6K9K12K15K1255012550125301. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Streamabc91827364540.0940.0340.08

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Streamabc61218243024.9424.9724.94

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-Onlyabc60012001800240030002872.402875.212871.44

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUabc8K16K24K32K40K352033516235157

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUabc50K100K150K200K250K232873233029233165

FFmpeg

Encoder: libx264 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Platformabc91827364540.8740.8240.871. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shuffleabc90018002700360045004032.304031.904036.741. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streamabc4080120160200203.72203.54203.76

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streamabc1.10542.21083.31624.42165.5274.90834.91274.9075

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUabc200K400K600K800K1000K107045210694181070341

Java SciMark

Computational Test: Jacobi Successive Over-Relaxation

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Jacobi Successive Over-Relaxationabc4008001200160020001698.071696.661697.60

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUabc4080120160200195.63195.60195.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mallocabc600K1200K1800K2400K3000K2857973.822856309.442858628.371. (CXX) g++ options: -O2 -std=gnu99 -lc

QuantLib

Configuration: Single-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-Threadedabc60012001800240030002767.12769.22767.41. (CXX) g++ options: -O3 -march=native -fPIE -pie

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamabc50100150200250224.57224.64224.49

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamabc1.00222.00443.00664.00885.0114.45274.45134.4543

DaCapo Benchmark

Java Test: jMonkeyEngine

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: jMonkeyEngineabc15003000450060007500695869626959

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Triple SHA-256, Onecoinabc4K8K12K16K20K1796017950179501. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Atomicabc100200300400500459.00459.14458.911. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUabc51015202520.4220.4220.41MIN: 12.43 / MAX: 70.22MIN: 12.75 / MAX: 44.83MIN: 15.23 / MAX: 35.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200abc70140210280350337.43337.55337.551. (CXX) g++ options: -O3 -fopenmp

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUabc9K18K27K36K45K397633977239774

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRandabc140028004200560070006663.756665.266664.611. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazefaceabc0.3240.6480.9721.2961.621.441.441.44MIN: 1.4 / MAX: 1.6MIN: 1.39 / MAX: 1.55MIN: 1.38 / MAX: 1.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlyabc0.05180.10360.15540.20720.2590.230.230.23

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlyabc0.05180.10360.15540.20720.2590.230.230.23

WebP2 Image Encode

Encode Settings: Quality 100, Lossless Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Lossless Compressionabc0.00230.00460.00690.00920.01150.010.010.011. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 95, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 95, Compression Effort 7abc0.00680.01360.02040.02720.0340.030.030.031. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 75, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 75, Compression Effort 7abc0.01580.03160.04740.06320.0790.070.070.071. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Apache Spark TPC-H

Scale Factor: 1 - Q22

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q22abc0.34540.69081.03621.38161.7271.302993541.535104631.50756407

Apache Spark TPC-H

Scale Factor: 1 - Q21

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q21abc36912159.073050509.547798168.86384010

Apache Spark TPC-H

Scale Factor: 1 - Q20

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q20abc0.57311.14621.71932.29242.86552.413729192.547008512.36286831

Apache Spark TPC-H

Scale Factor: 1 - Q19

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q19abc0.40040.80081.20121.60162.0021.560506581.779425741.62940145

Apache Spark TPC-H

Scale Factor: 1 - Q18

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q18abc0.96141.92282.88423.84564.8074.206442364.267047414.27269268

Apache Spark TPC-H

Scale Factor: 1 - Q17

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q17abc0.81611.63222.44833.26444.08053.627112153.619349003.50928020

Apache Spark TPC-H

Scale Factor: 1 - Q16

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q16abc0.34150.6831.02451.3661.70751.496082901.517686371.44492042

Apache Spark TPC-H

Scale Factor: 1 - Q15

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q15abc0.40030.80061.20091.60122.00151.744464281.779198171.76990700

Apache Spark TPC-H

Scale Factor: 1 - Q14

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q14abc0.37690.75381.13071.50761.88451.667633891.661646721.67524362

Apache Spark TPC-H

Scale Factor: 1 - Q13

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q13abc0.3830.7661.1491.5321.9151.702048181.569976811.50164175

Apache Spark TPC-H

Scale Factor: 1 - Q12

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q12abc0.50831.01661.52492.03322.54152.259276872.203383452.18155408

Apache Spark TPC-H

Scale Factor: 1 - Q11

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q11abc0.31680.63360.95041.26721.5841.408072711.288396721.30776501

Apache Spark TPC-H

Scale Factor: 1 - Q10

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q10abc0.65011.30021.95032.60043.25052.772442822.799874542.88941693

Apache Spark TPC-H

Scale Factor: 1 - Q09

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q09abc0.98911.97822.96733.95644.94554.395793914.367016324.18974257

Apache Spark TPC-H

Scale Factor: 1 - Q08

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q08abc0.5981.1961.7942.3922.992.589612252.552676922.65772152

Apache Spark TPC-H

Scale Factor: 1 - Q07

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q07abc0.65451.3091.96352.6183.27252.905851362.909097192.90456581

Apache Spark TPC-H

Scale Factor: 1 - Q06

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q06abc0.31370.62740.94111.25481.56851.320014361.394137981.39161527

Apache Spark TPC-H

Scale Factor: 1 - Q05

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q05abc0.75241.50482.25723.00963.7623.343907123.216317653.14652157

Apache Spark TPC-H

Scale Factor: 1 - Q04

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q04abc0.66541.33081.99622.66163.3272.957426792.871533162.76678443

Apache Spark TPC-H

Scale Factor: 1 - Q03

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q03abc0.78671.57342.36013.14683.93353.146645073.496449713.21106935

Apache Spark TPC-H

Scale Factor: 1 - Q02

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q02abc0.69181.38362.07542.76723.4592.695819142.768858913.07445645

Apache Spark TPC-H

Scale Factor: 1 - Q01

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q01abc1.17082.34163.51244.68325.8544.986022005.203425415.06900406


Phoronix Test Suite v10.8.4