fhe

AMD Ryzen 5 5500U testing with a NB01 NL5xNU (1.07.11RTR1 BIOS) and AMD Lucienne 512MB on Tuxedo 22.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2312189-NE-FHE94421920&sor&grs.

fheProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionabcAMD Ryzen 5 5500U @ 4.06GHz (6 Cores / 12 Threads)NB01 NL5xNU (1.07.11RTR1 BIOS)AMD Renoir/Cezanne16GBSamsung SSD 970 EVO Plus 500GBAMD Lucienne 512MB (1800/400MHz)AMD Renoir Radeon HD AudioRealtek RTL8111/8168/8411 + Intel Wi-Fi 6 AX200Tuxedo 22.046.0.0-1010-oem (x86_64)KDE Plasma 5.26.5X Server 1.21.1.34.6 Mesa 22.3.7 (LLVM 14.0.0 DRM 3.48)1.3.230GCC 11.3.0ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: amd-pstate ondemand (Boost: Enabled) - CPU Microcode: 0x8608103 Java Details- OpenJDK Runtime Environment (build 11.0.17+8-post-Ubuntu-1ubuntu222.04)Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

fhedacapobench: Apache Xalan XSLTonednn: IP Shapes 3D - f32 - CPUstress-ng: Semaphoresoidn: RTLightmap.hdr.4096x4096 - CPU-Onlydacapobench: PMD Source Code Analyzerdacapobench: Apache Lucene Search Engineembree: Pathtracer - Asian Dragondacapobench: Tradesoapdacapobench: FOP Print Formatterstress-ng: Fused Multiply-Addpytorch: CPU - 64 - ResNet-50java-scimark2: Fast Fourier Transformcpuminer-opt: Ringcoincpuminer-opt: Myriad-Groestldacapobench: Batik SVG Toolkitdacapobench: Zxing 1D/2D Barcode Image Processingncnn: Vulkan GPU - efficientnet-b0stress-ng: Futexjava-scimark2: Monte Carlostress-ng: Pipencnn: CPU - shufflenet-v2ncnn: CPU - blazefacedacapobench: H2O In-Memory Platform For Machine Learningonednn: Deconvolution Batch shapes_1d - f32 - CPUdacapobench: Apache Lucene Search Indexsvt-av1: Preset 13 - Bosphorus 1080pstress-ng: NUMApytorch: CPU - 1 - ResNet-50ncnn: Vulkan GPU - mobilenetstress-ng: Mixed Schedulerdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamstress-ng: CPU Stressncnn: Vulkan GPU-v2-v2 - mobilenet-v2stress-ng: Wide Vector Mathblosc: blosclz bitshuffle - 8MBspark-tpch: 1 - Geometric Mean Of All Queriesstress-ng: CPU Cachencnn: Vulkan GPU - mnasnetncnn: CPU - FastestDetdacapobench: Jythonjava-scimark2: Dense LU Matrix Factorizationdacapobench: H2 Database Engineopenradioss: Cell Phone Drop Testdacapobench: Tradebeansncnn: Vulkan GPU - squeezenet_ssdxmrig: Wownero - 1Mopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUncnn: Vulkan GPU-v3-v3 - mobilenet-v3stress-ng: Glibc C String Functionsmemtier-benchmark: Redis - 50 - 1:5easywave: e2Asean Grid + BengkuluSept2007 Source - 240openvkl: vklBenchmarkCPU Scalaropenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUstress-ng: SENDFILEmemtier-benchmark: Redis - 100 - 1:5dacapobench: Eclipsedeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamncnn: Vulkan GPU - resnet18deepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16 - CPUblosc: blosclz shuffle - 8MBmemtier-benchmark: Redis - 50 - 1:10stress-ng: Vector Floating Pointdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamopenvino: Weld Porosity Detection FP16 - CPUjava-scimark2: Sparse Matrix Multiplyncnn: CPU - mnasnetembree: Pathtracer - Crownopenradioss: INIVOL and Fluid Structure Interaction Drop Containervvenc: Bosphorus 1080p - Fastopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUembree: Pathtracer ISPC - Crownonednn: Deconvolution Batch shapes_3d - f32 - CPUdacapobench: Apache Cassandrapytorch: CPU - 64 - Efficientnet_v2_ldacapobench: GraphChipytorch: CPU - 16 - ResNet-50stress-ng: Pthreadncnn: CPU - efficientnet-b0ffmpeg: libx265 - Livencnn: CPU - squeezenet_ssdopenradioss: Bird Strike on Windshieldncnn: Vulkan GPU - googlenetncnn: CPU - vision_transformerncnn: CPU-v3-v3 - mobilenet-v3stress-ng: AVL Treencnn: Vulkan GPU - vision_transformervvenc: Bosphorus 4K - Fastersvt-av1: Preset 12 - Bosphorus 1080popenvino: Face Detection FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamncnn: Vulkan GPU - resnet50xmrig: KawPow - 1Mncnn: CPU - yolov4-tinycpuminer-opt: scryptembree: Pathtracer ISPC - Asian Dragonxmrig: Monero - 1Mncnn: Vulkan GPU - FastestDetcloverleaf: clover_bmncnn: Vulkan GPU - regnety_400mpytorch: CPU - 32 - Efficientnet_v2_ldacapobench: Spring Bootstress-ng: Memory Copyingjava-scimark2: Compositeopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUpytorch: CPU - 32 - ResNet-50stress-ng: MMAPdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamstress-ng: MEMFDdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamonednn: IP Shapes 1D - f32 - CPUstress-ng: Floating Pointopenvino: Handwritten English Recognition FP16 - CPUncnn: CPU-v2-v2 - mobilenet-v2avifenc: 10, Losslessopenvino: Handwritten English Recognition FP16 - CPUcloverleaf: clover_bm64_shortxmrig: CryptoNight-Femto UPX2 - 1Mopenvkl: vklBenchmarkCPU ISPCdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streampytorch: CPU - 16 - ResNet-152pytorch: CPU - 32 - ResNet-152webp2: Defaultdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamstress-ng: Context Switchingdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamncnn: CPU - googlenetdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamblender: Fishy Cat - CPU-Onlyavifenc: 0deepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamvvenc: Bosphorus 4K - Fastdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streambuild-gem5: Time To Compileffmpeg: libx264 - Livesvt-av1: Preset 4 - Bosphorus 1080pstress-ng: Matrix 3D Mathopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUavifenc: 6, Losslessdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO - Synchronous Single-Streamstress-ng: Vector Mathpytorch: CPU - 1 - ResNet-152pytorch: CPU - 64 - ResNet-152ncnn: CPU - alexnetstress-ng: IO_uringncnn: CPU - resnet18svt-av1: Preset 4 - Bosphorus 4Kxmrig: CryptoNight-Heavy - 1Mstress-ng: Cloningncnn: CPU - regnety_400mpytorch: CPU - 1 - Efficientnet_v2_lavifenc: 2stress-ng: Forkingmemtier-benchmark: Redis - 100 - 1:10deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamospray-studio: 1 - 1080p - 1 - Path Tracer - CPUstress-ng: Cryptoncnn: Vulkan GPU - shufflenet-v2deepsparse: ResNet-50, Sparse INT8 - Synchronous Single-Streamopenvino: Face Detection FP16 - CPUffmpeg: libx265 - Video On Demandopenradioss: Bumper Beamffmpeg: libx265 - Uploaddeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamdeepsparse: ResNet-50, Baseline - Synchronous Single-Streamstress-ng: Zlibembree: Pathtracer ISPC - Asian Dragon Objstress-ng: Matrix Mathospray-studio: 1 - 1080p - 16 - Path Tracer - CPUopenvino: Vehicle Detection FP16-INT8 - CPUsvt-av1: Preset 8 - Bosphorus 1080popenvino: Weld Porosity Detection FP16-INT8 - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUopenvino: Vehicle Detection FP16-INT8 - CPUcassandra: Writesopenvino: Weld Porosity Detection FP16-INT8 - CPUbuild-ffmpeg: Time To Compiledeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering - Synchronous Single-Streamopenvino: Face Detection FP16-INT8 - CPUsvt-av1: Preset 13 - Bosphorus 4Kopenvino: Face Detection Retail FP16-INT8 - CPUcpuminer-opt: Garlicoinscylladb: Writespytorch: CPU - 16 - Efficientnet_v2_lblender: Classroom - CPU-Onlyopenvino: Face Detection Retail FP16-INT8 - CPUdacapobench: Avrora AVR Simulation Frameworkcpuminer-opt: LBC, LBRY Creditsopenradioss: Rubber O-Ring Seal Installationopenvino: Age Gender Recognition Retail 0013 FP16 - CPUdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamstress-ng: Mutexospray-studio: 3 - 1080p - 32 - Path Tracer - CPUopenvino: Machine Translation EN To DE FP16 - CPUblosc: blosclz noshuffle - 8MBcpuminer-opt: Blake-2 Sonednn: Convolution Batch Shapes Auto - f32 - CPUwebp2: Quality 100, Compression Effort 5ncnn: Vulkan GPU - vgg16dacapobench: BioJava Biological Data Frameworkdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamospray-studio: 2 - 1080p - 32 - Path Tracer - CPUopenvino: Machine Translation EN To DE FP16 - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 2 - 1080p - 16 - Path Tracer - CPUonednn: Recurrent Neural Network Inference - f32 - CPUdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamffmpeg: libx265 - Platformospray-studio: 1 - 4K - 1 - Path Tracer - CPUstress-ng: Function Callsvt-av1: Preset 8 - Bosphorus 4Kncnn: CPU - vgg16ospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 2 - 4K - 16 - Path Tracer - CPUvvenc: Bosphorus 1080p - Fasterdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamffmpeg: libx264 - Video On Demandffmpeg: libx264 - Uploadopenvino: Vehicle Detection FP16 - CPUavifenc: 6ncnn: CPU - resnet50openvino: Vehicle Detection FP16 - CPUembree: Pathtracer - Asian Dragon Objonednn: Recurrent Neural Network Training - f32 - CPUquantlib: Multi-Threadedstress-ng: AVX-512 VNNIstress-ng: Hashncnn: Vulkan GPU - alexnetcpuminer-opt: Skeincoinncnn: CPU - mobilenetospray-studio: 2 - 1080p - 1 - Path Tracer - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamstress-ng: Pollospray-studio: 3 - 1080p - 16 - Path Tracer - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamstress-ng: Socket Activitycpuminer-opt: Deepcoindacapobench: Apache Kafkastress-ng: System V Message Passingcpuminer-opt: Magiopenvino: Road Segmentation ADAS FP16 - CPUdacapobench: Apache Tomcatbuild-gcc: Time To Compilencnn: Vulkan GPU - yolov4-tinydeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamospray-studio: 2 - 4K - 32 - Path Tracer - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamopenvino: Age Gender Recognition Retail 0013 FP16 - CPUdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamopenvino: Person Detection FP16 - CPUstress-ng: Glibc Qsort Data Sortingopenvino: Road Segmentation ADAS FP16 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamxmrig: GhostRider - 1Mdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Synchronous Single-Streamospray-studio: 3 - 1080p - 1 - Path Tracer - CPUbrl-cad: VGR Performance Metricdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Synchronous Single-Streamsvt-av1: Preset 12 - Bosphorus 4Kopenvino: Person Detection FP16 - CPUopenvino: Face Detection Retail FP16 - CPUdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Synchronous Single-Streamopenvino: Face Detection Retail FP16 - CPUblender: BMW27 - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyopenradioss: Chrysler Neon 1Mopenvino: Face Detection FP16 - CPUcpuminer-opt: Quad SHA-256, Pyritedeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Synchronous Single-Streamblender: Barbershop - CPU-Onlyospray-studio: 2 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 1080p - 32 - Path Tracer - CPUffmpeg: libx264 - Platformstress-ng: Vector Shuffledeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Synchronous Single-Streamospray-studio: 3 - 4K - 32 - Path Tracer - CPUjava-scimark2: Jacobi Successive Over-Relaxationopenvino: Person Vehicle Bike Detection FP16 - CPUstress-ng: Mallocquantlib: Single-Threadeddeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdacapobench: jMonkeyEnginecpuminer-opt: Triple SHA-256, Onecoinstress-ng: Atomicopenvino: Person Vehicle Bike Detection FP16 - CPUeasywave: e2Asean Grid + BengkuluSept2007 Source - 1200ospray-studio: 3 - 4K - 1 - Path Tracer - CPUstress-ng: x86_64 RdRandncnn: Vulkan GPU - blazefaceoidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlyoidn: RT.hdr_alb_nrm.3840x2160 - CPU-Onlywebp2: Quality 100, Lossless Compressionwebp2: Quality 95, Compression Effort 7webp2: Quality 75, Compression Effort 7spark-tpch: 1 - Q22spark-tpch: 1 - Q21spark-tpch: 1 - Q20spark-tpch: 1 - Q19spark-tpch: 1 - Q18spark-tpch: 1 - Q17spark-tpch: 1 - Q16spark-tpch: 1 - Q15spark-tpch: 1 - Q14spark-tpch: 1 - Q13spark-tpch: 1 - Q12spark-tpch: 1 - Q11spark-tpch: 1 - Q10spark-tpch: 1 - Q09spark-tpch: 1 - Q08spark-tpch: 1 - Q07spark-tpch: 1 - Q06spark-tpch: 1 - Q05spark-tpch: 1 - Q04spark-tpch: 1 - Q03spark-tpch: 1 - Q02spark-tpch: 1 - Q01abc147110.607812140043.030.11318049257.12561166210565581744.411.10236.1809.382685.02165622418.542056701.461535.013369398.64.341.43589812.06525266262.016107.8320.2822.075998.564.821113802.285.84246414.847005.62.400138731567966.454.515.0169883008.935448203.691487115.42532.356.3670.914.65307606.721762546.4419.01956115.0552.1397345.171749374.051446525.729211.74616.597328.727200.81746685.7116476.3116.5721139.152151.264.566.26611282.017.8954919.465.571711.280696893.47453612.0687982.488.5659.7115.39563.8916.33152.524.5936.2152.594.944210.8452292.524.596628.381705.232.3954.027.09731706.35.1189.249.523.5240801903.461725.8815.03265.8311.87108.29322.1667260.269.28838.886661929.2349.865.917.764120.25357.591708.3103116.5395.195.244.2156.82752044079.4625.716616.22518.3032352.65253.54328.3037105.83972.32652.74711036.06166.567.407655.731.1918.16323.522142.499538176.438.785.209.18154334.5211.891.9921711.3805.439.565.51116.48424389.051767574.95226.5659714113443.744.314.40221.4625.62343.3112.455.75647.892520.8692714.266.152431801.4119816142.748.99531.29070662843060192.289.9345.1875192.76021.7257.997451.52699.76484623.49741.288.84149533717.99457.851.81649.70012874216.79274754226.55092.93401022.04912.0670.937853652.295823662017.644554721213533525.964.591825.65347964081.4215.79571.2153753146505717.19652.117440.9310.9936.4812.42228.6109.516.87985852.617332.3239957.631369137.059.198334.9121.69718771.7605699249.9614029841.75324105.681836.3960906906619.23160.75163.39110391914.16932.3457.505592256426.03123262.6138.4017225.6284.431856.3421261.73150.1924.4689.2555248.811.195483558227753.191420.925847.76455.75515.26383.6223.833941.947310.39274.06926.752140.542709.931255040.086224.93522872.43520323287340.874032.3203.72194.908310704521698.07195.632857973.822767.1224.56974.452769581796045920.42337.427397636663.751.440.230.230.010.030.071.302993549.07305052.413729191.560506584.206442363.627112151.49608291.744464281.667633891.702048182.259276871.408072712.772442824.395793912.589612252.905851361.320014363.343907122.957426793.146645072.695819144.986022129611.817811087929.70.12345649377.59221147410405561152.611.67251.73857.492827.68157723438.562147335.671593.683503830.274.51.42600011.93435113265.763110.7220.7221.526043.574.897113473.645.98240673.8369852.438337261533029.064.535.0268382980.355525203.231459815.272513.956.7870.384.685411002.921729895.5618.96855113.3252.9199090.81719244.181454026.1311.94611.924428.827309.51734539.8816206.61114.7826138.632117.344.496.17011293.897.7934992.25.642311.445596103.52449211.9188920.648.4459.3015.28563.7416.29151.154.6236.13150.734.981212.3712273.394.540428.651726.13254.37.11781726.75.11187.029.633.4840691882.011727.9515.2262.8611.80107.12318.7207258.689.38848.880021936.0149.725.97.761120.56354.081725.2104117.59165.245.204.2057.35652025241.4325.505616.34521.4212353.84252.63328.4701105.21212.30752.27941044.611165.237.466652.41.1818.10723.399442.72237936.858.825.249.11154554.511.81.9991724800.449.595.51117.32624288.061762578.3224.9789712213458.674.344.43281.4625.64345.1712.445.725947.598220.9979717.656.149631958.65119397142.3749.29631.0191073728.0742968193.3490.4665.1603193.77361.7358.334452.11698.16485723.47740.038.83150333697.25457.971.8653.14712878214.99274126227.425107.43410022.15662.0771.167820655.298823614517.574575401214763516.724.574625.64349454065.4415.85471.553977346431917.16352.273540.8310.9536.4612.37828.5109.566.86735868.6317273.4239843.621364579.59.188349.0321.66720071.684698234.2613987841.83044096.521838.9861086910876.85160.98163.32110701919.53432.2557.361392392825.96143271.3838.5047225.94864.425656.3774262.39150.5224.4789.183224911.204283518211853.165820.880847.865155.86515.23384.3723.880441.86610.37273.88926.692140.082709.891255040.025524.97252875.213516223302940.824031.9203.53864.912710694181696.66195.62856309.442769.2224.64364.4513696217950459.1420.42337.548397726665.261.440.230.230.010.030.071.535104639.547798162.547008511.779425744.267047413.6193491.517686371.779198171.661646721.569976812.203383451.288396722.799874544.367016322.552676922.909097191.394137983.216317652.871533163.496449712.768858915.20342541130511.940111469661.560.12332753147.6511123169855947777.7111.84247.29815.832704.56160322558.922102668.911530.093501532.414.461.47610311.70125225258.675108.9620.8221.876149.714.940513732.885.98241097.0371472.383609431539578.224.435.1268952945.785563199.581489815.092564.555.6771.784.6953170941743565.7119.3145611353.0798736.211735403.811471625.692211.82606.381929.27320.81763427.6716263.83116.6805136.892122.284.516.23811274.17.9094942.115.653611.412795503.48447211.8989239.528.4860.1315.49556.3116.51150.534.6536.6150.675.007213.5052301.994.576428.731725.832.2154.677.18221724.15.05188.409.543.5040341897.681708.6115.14264.0711.93107.46320.0604257.489.34918.972031949.1250.235.857.686119.36354.291724.4104117.66895.205.254.2456.92042036534.7825.480216.37516.6462350.61251.24228.5625104.88132.32852.68211035.725165.157.47650.21.1918.01523.590742.375938241.248.755.239.17155512.7411.812.0071723.8799.569.635.47117.28124216.781775067.44225.1522709113364.444.344.42951.4725.79345.5712.525.762547.900420.8656718.756.188132000.11119077143.2549.19831.0390520627.942804193.2390.0465.1904192.65131.7258.087454.14702.2482933.49737.068.79149483704.54455.421.81649.56832889633.43273323227.685119.13418022.07312.0771.277857653.460723554517.564560871209273510.034.59525.75348854082.6915.86271.253770446329017.13152.081840.9810.9636.5912.39728.54109.186.85625872.6717326.6240648.241366996.539.218361.8521.73717871.5417700345.6114005741.87824108.671841.8360976891049.07161.21163.78110601917.26432.3157.518192141225.98683265.8938.467225.37064.436956.2353262.13150.5624.4189.4012248.411.177383358230453.284420.906647.807855.86315.23384.0623.841441.93410.38273.54925.222137.082705.551253040.078324.93992871.443515723316540.874036.74203.75664.907510703411697.6195.762858628.372767.4224.49014.4543695917950458.9120.41337.546397746664.611.440.230.230.010.030.071.507564078.86384012.362868311.629401454.272692683.50928021.444920421.7699071.675243621.501641752.181554081.307765012.889416934.189742572.657721522.904565811.391615273.146521572.766784433.211069353.074456455.06900406OpenBenchmarking.org

DaCapo Benchmark

Java Test: Apache Xalan XSLT

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Xalan XSLTbca30060090012001500129613051471

oneDNN

Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 3D - Data Type: f32 - Engine: CPUabc369121510.6111.8211.94MIN: 10.34MIN: 11.43MIN: 11.641. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Semaphoresacb3M6M9M12M15M12140043.0311469661.5611087929.701. (CXX) g++ options: -O2 -std=gnu99 -lc

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RTLightmap.hdr.4096x4096 - Device: CPU-Onlycba0.0270.0540.0810.1080.1350.120.120.11

DaCapo Benchmark

Java Test: PMD Source Code Analyzer

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: PMD Source Code Analyzeracb7001400210028003500318033273456

DaCapo Benchmark

Java Test: Apache Lucene Search Engine

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search Engineabc11002200330044005500492549375314

Embree

Binary: Pathtracer - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragoncba2468107.65117.59227.1256MIN: 7.6 / MAX: 7.84MIN: 7.54 / MAX: 7.76MIN: 7.08 / MAX: 7.28

DaCapo Benchmark

Java Test: Tradesoap

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Tradesoapbac3K6K9K12K15K114741166212316

DaCapo Benchmark

Java Test: FOP Print Formatter

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: FOP Print Formattercba200400600800100098510401056

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Fused Multiply-Addcab1.3M2.6M3.9M5.2M6.5M5947777.715581744.405561152.601. (CXX) g++ options: -O2 -std=gnu99 -lc

PyTorch

Device: CPU - Batch Size: 64 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50cba369121511.8411.6711.10MIN: 9.81 / MAX: 13.3MIN: 9.24 / MAX: 13.18MIN: 9.27 / MAX: 12.44

Java SciMark

Computational Test: Fast Fourier Transform

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Fast Fourier Transformbca50100150200250251.73247.29236.10

Cpuminer-Opt

Algorithm: Ringcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Ringcoinbca2004006008001000857.49815.83809.381. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Myriad-Groestl

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Myriad-Groestlbca60012001800240030002827.682704.562685.021. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

DaCapo Benchmark

Java Test: Batik SVG Toolkit

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Batik SVG Toolkitbca400800120016002000157716031656

DaCapo Benchmark

Java Test: Zxing 1D/2D Barcode Image Processing

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Zxing 1D/2D Barcode Image Processingacb5001000150020002500224122552343

NCNN

Target: Vulkan GPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: efficientnet-b0abc2468108.548.568.92MIN: 8.18 / MAX: 14.64MIN: 8.27 / MAX: 16.23MIN: 8.23 / MAX: 96.071. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Futexbca500K1000K1500K2000K2500K2147335.672102668.912056701.461. (CXX) g++ options: -O2 -std=gnu99 -lc

Java SciMark

Computational Test: Monte Carlo

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Monte Carlobac300600900120015001593.681535.011530.09

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pipebca800K1600K2400K3200K4000K3503830.273501532.413369398.601. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: shufflenet-v2acb1.01252.0253.03754.055.06254.344.464.50MIN: 4.18 / MAX: 7.26MIN: 4.17 / MAX: 7.15MIN: 4.23 / MAX: 32.011. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: blazefacebac0.33080.66160.99241.32321.6541.421.431.47MIN: 1.38 / MAX: 2.05MIN: 1.38 / MAX: 1.65MIN: 1.4 / MAX: 2.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

DaCapo Benchmark

Java Test: H2O In-Memory Platform For Machine Learning

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: H2O In-Memory Platform For Machine Learningabc13002600390052006500589860006103

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUcba369121511.7011.9312.07MIN: 7.48MIN: 7.67MIN: 7.421. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

DaCapo Benchmark

Java Test: Apache Lucene Search Index

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Lucene Search Indexbca11002200330044005500511352255266

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 1080pbac60120180240300265.76262.02258.681. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: NUMAbca20406080100110.72108.96107.831. (CXX) g++ options: -O2 -std=gnu99 -lc

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50cba51015202520.8220.7220.28MIN: 17.2 / MAX: 23.53MIN: 16.36 / MAX: 23.54MIN: 17 / MAX: 22.8

NCNN

Target: Vulkan GPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mobilenetbca51015202521.5221.8722.07MIN: 20.87 / MAX: 32.66MIN: 20.95 / MAX: 68.72MIN: 21.39 / MAX: 54.541. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mixed Schedulercba130026003900520065006149.716043.575998.561. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamcba1.11162.22323.33484.44645.5584.94054.89714.8211

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Stressacb3K6K9K12K15K13802.2813732.8813473.641. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2abc1.34552.6914.03655.3826.72755.845.985.98MIN: 5.6 / MAX: 8.12MIN: 5.65 / MAX: 12.76MIN: 5.6 / MAX: 12.261. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Wide Vector Mathacb50K100K150K200K250K246414.84241097.03240673.831. (CXX) g++ options: -O2 -std=gnu99 -lc

C-Blosc

Test: blosclz bitshuffle - Buffer Size: 8MB

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.11Test: blosclz bitshuffle - Buffer Size: 8MBcab150030004500600075007147.07005.66985.01. (CC) gcc options: -std=gnu99 -O3 -ldl -lrt -lm

Apache Spark TPC-H

Scale Factor: 1 - Geometric Mean Of All Queries

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Geometric Mean Of All Queriescab0.54861.09721.64582.19442.7432.383609432.400138732.43833726MIN: 1.31 / MAX: 8.86MIN: 1.3 / MAX: 9.07MIN: 1.29 / MAX: 9.55

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: CPU Cacheacb300K600K900K1200K1500K1567966.451539578.221533029.061. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: mnasnetcab1.01932.03863.05794.07725.09654.434.514.53MIN: 4.27 / MAX: 6.68MIN: 4.3 / MAX: 12.69MIN: 4.34 / MAX: 6.591. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: FastestDetabc1.1522.3043.4564.6085.765.015.025.12MIN: 4.86 / MAX: 7.02MIN: 4.86 / MAX: 6.77MIN: 5.01 / MAX: 7.191. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

DaCapo Benchmark

Java Test: Jython

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Jythonbca15003000450060007500683868956988

Java SciMark

Computational Test: Dense LU Matrix Factorization

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Dense LU Matrix Factorizationabc60012001800240030003008.932980.352945.78

DaCapo Benchmark

Java Test: H2 Database Engine

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: H2 Database Engineabc12002400360048006000544855255563

OpenRadioss

Model: Cell Phone Drop Test

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop Testcba4080120160200199.58203.23203.69

DaCapo Benchmark

Java Test: Tradebeans

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Tradebeansbac3K6K9K12K15K145981487114898

NCNN

Target: Vulkan GPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: squeezenet_ssdcba4812162015.0915.2715.40MIN: 14.67 / MAX: 21.1MIN: 14.83 / MAX: 21.07MIN: 14.87 / MAX: 28.181. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Xmrig

Variant: Wownero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1Mcab60012001800240030002564.52532.32513.91. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUcab132639526555.6756.3656.78MIN: 47.49 / MAX: 82.79MIN: 44.65 / MAX: 78.53MIN: 33.46 / MAX: 74.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUcab163248648071.7870.9170.381. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NCNN

Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3abc1.05532.11063.16594.22125.27654.604.684.69MIN: 4.41 / MAX: 10.59MIN: 4.47 / MAX: 17.72MIN: 4.44 / MAX: 18.171. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc C String Functionsbca1.2M2.4M3.6M4.8M6M5411002.925317094.005307606.721. (CXX) g++ options: -O2 -std=gnu99 -lc

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5acb400K800K1200K1600K2000K1762546.441743565.711729895.561. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 240bac51015202518.9719.0219.311. (CXX) g++ options: -O3 -fopenmp

OpenVKL

Benchmark: vklBenchmarkCPU Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU Scalarcab1326395265565655MIN: 4 / MAX: 1096MIN: 4 / MAX: 1095MIN: 4 / MAX: 1098

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUcba306090120150113.00113.32115.05MIN: 81.78 / MAX: 141.49MIN: 87.68 / MAX: 144.49MIN: 66.21 / MAX: 156.661. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUcba122436486053.0752.9152.131. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: SENDFILEbca20K40K60K80K100K99090.8098736.2197345.171. (CXX) g++ options: -O2 -std=gnu99 -lc

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5acb400K800K1200K1600K2000K1749374.051735403.811719244.181. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

DaCapo Benchmark

Java Test: Eclipse

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Eclipseabc3K6K9K12K15K144651454014716

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streambac61218243026.1325.7325.69

NCNN

Target: Vulkan GPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet18acb369121511.7411.8211.94MIN: 11.45 / MAX: 18.54MIN: 11.46 / MAX: 18.3MIN: 11.32 / MAX: 60.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamcba130260390520650606.38611.92616.60

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUabc71421283528.7228.8229.20MIN: 24.22 / MAX: 46.15MIN: 24.57 / MAX: 45.98MIN: 20.8 / MAX: 91.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

C-Blosc

Test: blosclz shuffle - Buffer Size: 8MB

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.11Test: blosclz shuffle - Buffer Size: 8MBcba160032004800640080007320.87309.57200.81. (CC) gcc options: -std=gnu99 -O3 -ldl -lrt -lm

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10cab400K800K1200K1600K2000K1763427.671746685.711734539.881. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Floating Pointacb4K8K12K16K20K16476.3016263.8316206.611. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-Streambac306090120150114.78116.57116.68

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16 - Device: CPUabc306090120150139.15138.63136.891. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Java SciMark

Computational Test: Sparse Matrix Multiply

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Sparse Matrix Multiplyacb50010001500200025002151.262122.282117.34

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mnasnetbca1.0262.0523.0784.1045.134.494.514.56MIN: 4.35 / MAX: 6.6MIN: 4.31 / MAX: 6.83MIN: 4.31 / MAX: 10.031. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Embree

Binary: Pathtracer - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Crownacb2468106.26616.23816.1701MIN: 6.22 / MAX: 6.37MIN: 6.19 / MAX: 6.33MIN: 6.13 / MAX: 6.27

OpenRadioss

Model: INIVOL and Fluid Structure Interaction Drop Container

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop Containercab300600900120015001274.101282.011293.89

VVenC

Video Input: Bosphorus 1080p - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fastcab2468107.9097.8957.7931. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUbca110022003300440055004992.204942.114919.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Crowncba1.27212.54423.81635.08846.36055.65365.64235.5717MIN: 5.61 / MAX: 5.73MIN: 5.6 / MAX: 5.73MIN: 5.54 / MAX: 5.63

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUacb369121511.2811.4111.45MIN: 10.65MIN: 10.79MIN: 10.891. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

DaCapo Benchmark

Java Test: Apache Cassandra

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Cassandracba2K4K6K8K10K955096109689

PyTorch

Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lbca0.7921.5842.3763.1683.963.523.483.47MIN: 2.89 / MAX: 3.88MIN: 2.92 / MAX: 3.82MIN: 2.92 / MAX: 3.91

DaCapo Benchmark

Java Test: GraphChi

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: GraphChicba10002000300040005000447244924536

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-50abc369121512.0611.9111.89MIN: 9.84 / MAX: 13.85MIN: 10.01 / MAX: 13.53MIN: 10.04 / MAX: 13.47

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pthreadcba20K40K60K80K100K89239.5288920.6487982.481. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: efficientnet-b0bca2468108.448.488.56MIN: 8.16 / MAX: 11.8MIN: 8.19 / MAX: 11.92MIN: 8.24 / MAX: 15.561. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

FFmpeg

Encoder: libx265 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Livecab132639526560.1359.7159.301. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: squeezenet_ssdbac4812162015.2815.3915.49MIN: 14.79 / MAX: 22.91MIN: 14.89 / MAX: 31.68MIN: 14.8 / MAX: 34.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenRadioss

Model: Bird Strike on Windshield

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on Windshieldcba120240360480600556.31563.74563.89

NCNN

Target: Vulkan GPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: googlenetbac4812162016.2916.3316.51MIN: 15.71 / MAX: 22.39MIN: 15.7 / MAX: 24.12MIN: 15.79 / MAX: 22.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vision_transformercba306090120150150.53151.15152.52MIN: 147.14 / MAX: 193.7MIN: 147.31 / MAX: 195.77MIN: 149.07 / MAX: 186.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v3-v3 - Model: mobilenet-v3abc1.04632.09263.13894.18525.23154.594.624.65MIN: 4.44 / MAX: 6.6MIN: 4.46 / MAX: 6.86MIN: 4.41 / MAX: 8.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVL Treecab81624324036.6036.2036.131. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vision_transformercba306090120150150.67150.73152.59MIN: 147.18 / MAX: 169.34MIN: 147.59 / MAX: 166.06MIN: 148.63 / MAX: 239.621. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fastercba1.12662.25323.37984.50645.6335.0074.9814.9441. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 1080pcba50100150200250213.51212.37210.851. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUbac50010001500200025002273.392292.522301.99MIN: 1955.16 / MAX: 2430.88MIN: 1831.17 / MAX: 2445.01MIN: 1851.05 / MAX: 2439.191. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamacb1.03422.06843.10264.13685.1714.59664.57644.5404

NCNN

Target: Vulkan GPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: resnet50abc71421283528.3828.6528.73MIN: 27.04 / MAX: 35.23MIN: 26.91 / MAX: 36.74MIN: 26.98 / MAX: 77.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Xmrig

Variant: KawPow - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1Mbca4008001200160020001726.11725.81705.21. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: yolov4-tinybca81624324032.0032.2132.39MIN: 31.34 / MAX: 41.92MIN: 31.5 / MAX: 42.17MIN: 31.6 / MAX: 38.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Cpuminer-Opt

Algorithm: scrypt

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: scryptcba122436486054.6754.3054.021. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragoncba2468107.18227.11787.0973MIN: 7.13 / MAX: 7.34MIN: 7.07 / MAX: 7.27MIN: 7.05 / MAX: 7.25

Xmrig

Variant: Monero - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1Mbca4008001200160020001726.71724.11706.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

NCNN

Target: Vulkan GPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: FastestDetcab1.14982.29963.44944.59925.7495.055.105.11MIN: 4.93 / MAX: 7.03MIN: 4.99 / MAX: 6.93MIN: 4.94 / MAX: 6.991. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

CloverLeaf

Input: clover_bm

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bmbca4080120160200187.02188.40189.241. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

NCNN

Target: Vulkan GPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: regnety_400macb36912159.529.549.63MIN: 9.26 / MAX: 15.11MIN: 9.27 / MAX: 13.76MIN: 9.28 / MAX: 14.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

PyTorch

Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_lacb0.7921.5842.3763.1683.963.523.503.48MIN: 2.9 / MAX: 3.86MIN: 2.92 / MAX: 3.8MIN: 2.9 / MAX: 3.78

DaCapo Benchmark

Java Test: Spring Boot

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Spring Bootcba9001800270036004500403440694080

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Memory Copyingacb4008001200160020001903.461897.681882.011. (CXX) g++ options: -O2 -std=gnu99 -lc

Java SciMark

Computational Test: Composite

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Compositebac4008001200160020001727.951725.881708.61

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUbca4812162015.2015.1415.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP32 - Device: CPUbca60120180240300262.86264.07265.83MIN: 232.22 / MAX: 299.62MIN: 228.94 / MAX: 302.08MIN: 154.12 / MAX: 298.881. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PyTorch

Device: CPU - Batch Size: 32 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-50cab369121511.9311.8711.80MIN: 9.9 / MAX: 13.75MIN: 9.95 / MAX: 13.33MIN: 9.72 / MAX: 13.59

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MMAPacb20406080100108.29107.46107.121. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamacb70140210280350322.17320.06318.72

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: MEMFDabc60120180240300260.26258.68257.481. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-Streamacb36912159.28839.34919.3884

oneDNN

Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: IP Shapes 1D - Data Type: f32 - Engine: CPUbac36912158.880028.886668.97203MIN: 8.5MIN: 8.48MIN: 8.581. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Floating Pointcba4008001200160020001949.121936.011929.231. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUcab112233445550.2349.8649.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU-v2-v2 - Model: mobilenet-v2cba1.32982.65963.98945.31926.6495.855.905.91MIN: 5.62 / MAX: 8.37MIN: 5.59 / MAX: 12.01MIN: 5.61 / MAX: 13.791. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

libavif avifenc

Encoder Speed: 10, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 10, Losslesscba2468107.6867.7617.7641. (CXX) g++ options: -O3 -fPIC -lm

OpenVINO

Model: Handwritten English Recognition FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16 - Device: CPUcab306090120150119.36120.25120.56MIN: 89.26 / MAX: 148.18MIN: 79.3 / MAX: 149.21MIN: 91.75 / MAX: 152.91. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

CloverLeaf

Input: clover_bm64_short

OpenBenchmarking.orgSeconds, Fewer Is BetterCloverLeaf 1.3Input: clover_bm64_shortbca80160240320400354.08354.29357.591. (F9X) gfortran options: -O3 -march=native -funroll-loops -fopenmp

Xmrig

Variant: CryptoNight-Femto UPX2 - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1Mbca4008001200160020001725.21724.41708.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCcba20406080100104104103MIN: 8 / MAX: 1386MIN: 8 / MAX: 1392MIN: 8 / MAX: 1377

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabc306090120150116.54117.59117.67

PyTorch

Device: CPU - Batch Size: 16 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-152bca1.1792.3583.5374.7165.8955.245.205.19MIN: 4.23 / MAX: 5.83MIN: 4.2 / MAX: 5.88MIN: 4.28 / MAX: 5.82

PyTorch

Device: CPU - Batch Size: 32 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-152cab1.18132.36263.54394.72525.90655.255.245.20MIN: 4.31 / MAX: 5.89MIN: 4.14 / MAX: 5.89MIN: 4.3 / MAX: 5.83

WebP2 Image Encode

Encode Settings: Default

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Defaultcab0.9541.9082.8623.8164.774.244.214.201. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamacb132639526556.8356.9257.36

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Context Switchingacb400K800K1200K1600K2000K2044079.462036534.782025241.431. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamabc61218243025.7225.5125.48

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: googlenetabc4812162016.2216.3416.37MIN: 15.74 / MAX: 23.62MIN: 15.74 / MAX: 25.53MIN: 15.93 / MAX: 21.81. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamcab110220330440550516.65518.30521.42

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-Onlycab80160240320400350.61352.65353.84

libavif avifenc

Encoder Speed: 0

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 0cba60120180240300251.24252.63253.541. (CXX) g++ options: -O3 -fPIC -lm

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc71421283528.3028.4728.56

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-Streamabc20406080100105.84105.21104.88

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: Fastcab0.52381.04761.57142.09522.6192.3282.3262.3071. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-Streamacb122436486052.7552.6852.28

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To Compilecab20040060080010001035.731036.061044.61

FFmpeg

Encoder: libx264 - Scenario: Live

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Liveabc4080120160200166.56165.23165.151. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 1080pcba2468107.4707.4667.4071. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix 3D Mathabc140280420560700655.73652.40650.201. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUbac0.26780.53560.80341.07121.3391.181.191.19MIN: 0.57 / MAX: 15.06MIN: 0.55 / MAX: 10.47MIN: 0.57 / MAX: 13.651. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

libavif avifenc

Encoder Speed: 6, Lossless

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6, Losslesscba4812162018.0218.1118.161. (CXX) g++ options: -O3 -fPIC -lm

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamcab61218243023.5923.5223.40

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Streamcab102030405042.3842.5042.72

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Mathcab8K16K24K32K40K38241.2438176.4337936.851. (CXX) g++ options: -O2 -std=gnu99 -lc

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152bac2468108.828.788.75MIN: 7.02 / MAX: 10.05MIN: 6.78 / MAX: 9.95MIN: 7.08 / MAX: 9.99

PyTorch

Device: CPU - Batch Size: 64 - Model: ResNet-152

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152bca1.1792.3583.5374.7165.8955.245.235.20MIN: 4.28 / MAX: 5.84MIN: 4.22 / MAX: 5.85MIN: 4.15 / MAX: 5.77

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: alexnetbca36912159.119.179.18MIN: 8.86 / MAX: 18.25MIN: 8.9 / MAX: 16.02MIN: 8.91 / MAX: 16.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: IO_uringcba30K60K90K120K150K155512.74154554.50154334.521. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet18bca369121511.8011.8111.89MIN: 11.48 / MAX: 20.39MIN: 11.46 / MAX: 17.5MIN: 11.52 / MAX: 18.091. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4Kcba0.45160.90321.35481.80642.2582.0071.9991.9921. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Xmrig

Variant: CryptoNight-Heavy - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1Mbca4008001200160020001724.01723.81711.31. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Stress-NG

Test: Cloning

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cloningabc2004006008001000805.43800.44799.561. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: regnety_400mabc36912159.569.599.63MIN: 9.28 / MAX: 16.82MIN: 9.28 / MAX: 14.12MIN: 9.32 / MAX: 12.951. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

PyTorch

Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lbac1.23982.47963.71944.95926.1995.515.515.47MIN: 4.61 / MAX: 6.06MIN: 4.63 / MAX: 5.95MIN: 4.63 / MAX: 6.05

libavif avifenc

Encoder Speed: 2

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 2acb306090120150116.48117.28117.331. (CXX) g++ options: -O3 -fPIC -lm

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Forkingabc5K10K15K20K25K24389.0524288.0624216.781. (CXX) g++ options: -O2 -std=gnu99 -lc

Redis 7.0.12 + memtier_benchmark

Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10

OpenBenchmarking.orgOps/sec, More Is BetterRedis 7.0.12 + memtier_benchmark 2.0Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10cab400K800K1200K1600K2000K1775067.441767574.951762578.301. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Streamacb50100150200250226.57225.15224.98

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUcba15003000450060007500709171227141

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Cryptobac3K6K9K12K15K13458.6713443.7413364.441. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: shufflenet-v2abc0.97651.9532.92953.9064.88254.314.344.34MIN: 4.18 / MAX: 6.35MIN: 4.19 / MAX: 11.27MIN: 4.17 / MAX: 9.881. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Synchronous Single-Streamacb0.99741.99482.99223.98964.9874.40224.42954.4328

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUcba0.33080.66160.99241.32321.6541.471.461.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

FFmpeg

Encoder: libx265 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On Demandcba61218243025.7925.6425.621. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenRadioss

Model: Bumper Beam

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper Beamabc80160240320400343.31345.17345.57

FFmpeg

Encoder: libx265 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Uploadcab369121512.5212.4512.441. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-Streamcab1.29662.59323.88985.18646.4835.76255.75605.7259

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Synchronous Single-Streamcab112233445547.9047.8947.60

Neural Magic DeepSparse

Model: ResNet-50, Baseline - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Synchronous Single-Streamcab51015202520.8720.8721.00

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Zlibcba160320480640800718.75717.65714.261. (CXX) g++ options: -O2 -std=gnu99 -lc

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon Objcab2468106.18816.15246.1496MIN: 6.15 / MAX: 6.31MIN: 6.11 / MAX: 6.3MIN: 6.11 / MAX: 6.28

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Matrix Mathcba7K14K21K28K35K32000.1131958.6531801.401. (CXX) g++ options: -O2 -std=gnu99 -lc

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUcba30K60K90K120K150K119077119397119816

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUcab306090120150143.25142.70142.371. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 1080pbca112233445549.3049.2049.001. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUbca71421283531.0131.0331.20MIN: 24.54 / MAX: 43.5MIN: 21.89 / MAX: 48.55MIN: 23.75 / MAX: 44.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUcab200K400K600K800K1000K905206907066910737

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUcab71421283527.9028.0028.07MIN: 20.57 / MAX: 43.21MIN: 17.95 / MAX: 41.21MIN: 15.75 / MAX: 46.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 4.1.3Test: Writesabc9K18K27K36K45K430604296842804

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUbca4080120160200193.34193.23192.201. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Timed FFmpeg Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To Compileacb2040608010089.9390.0590.47

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Streamcab1.16782.33563.50344.67125.8395.19045.18755.1603

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Synchronous Single-Streamcab4080120160200192.65192.76193.77

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUbca0.38930.77861.16791.55721.94651.731.721.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4Kbca132639526558.3358.0958.001. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUcba100200300400500454.14452.11451.521. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Garlicoincab150300450600750702.20699.76698.161. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

ScyllaDB

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterScyllaDB 5.2.9Test: Writesbac10K20K30K40K50K485724846248293

PyTorch

Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_l

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_lcab0.78531.57062.35593.14123.92653.493.493.47MIN: 2.92 / MAX: 3.88MIN: 2.86 / MAX: 3.79MIN: 2.91 / MAX: 3.79

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-Onlycba160320480640800737.06740.03741.28

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUcba2468108.798.838.84MIN: 5.75 / MAX: 20.16MIN: 6 / MAX: 16.62MIN: 6.3 / MAX: 17.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

DaCapo Benchmark

Java Test: Avrora AVR Simulation Framework

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Avrora AVR Simulation Frameworkcab3K6K9K12K15K149481495315033

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: LBC, LBRY Creditsacb80016002400320040003717.993704.543697.251. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenRadioss

Model: Rubber O-Ring Seal Installation

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal Installationcab100200300400500455.42457.85457.97

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUbac0.40730.81461.22191.62922.03651.801.811.81MIN: 1.01 / MAX: 19.26MIN: 1 / MAX: 10.22MIN: 0.98 / MAX: 11.341. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamcab140280420560700649.57649.70653.15

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Mutexcba600K1200K1800K2400K3000K2889633.432878214.992874216.791. (CXX) g++ options: -O2 -std=gnu99 -lc

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUcba60K120K180K240K300K273323274126274754

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUabc50100150200250226.50227.42227.68MIN: 142.3 / MAX: 257.79MIN: 134.56 / MAX: 364.33MIN: 164.95 / MAX: 261.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

C-Blosc

Test: blosclz noshuffle - Buffer Size: 8MB

OpenBenchmarking.orgMB/s, More Is BetterC-Blosc 2.11Test: blosclz noshuffle - Buffer Size: 8MBcba110022003300440055005119.15107.45092.91. (CC) gcc options: -std=gnu99 -O3 -ldl -lrt -lm

Cpuminer-Opt

Algorithm: Blake-2 S

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Blake-2 Scba7K14K21K28K35K3418034100340101. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUacb51015202522.0522.0722.16MIN: 21.6MIN: 21.59MIN: 21.681. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

WebP2 Image Encode

Encode Settings: Quality 100, Compression Effort 5

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Compression Effort 5cba0.46580.93161.39741.86322.3292.072.072.061. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

NCNN

Target: Vulkan GPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: vgg16abc163248648070.9371.1671.27MIN: 69.58 / MAX: 79.76MIN: 69.68 / MAX: 111.48MIN: 69.92 / MAX: 80.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

DaCapo Benchmark

Java Test: BioJava Biological Data Framework

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: BioJava Biological Data Frameworkbac2K4K6K8K10K782078537857

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamacb140280420560700652.30653.46655.30

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUcba50K100K150K200K250K235545236145236620

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUabc4812162017.6417.5717.561. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUacb100K200K300K400K500K455472456087457540

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUcab30K60K90K120K150K120927121353121476

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPUcba80016002400320040003510.033516.723525.96MIN: 3418.07MIN: 3421.71MIN: 3431.461. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamcab1.03392.06783.10174.13565.16954.59504.59184.5746

FFmpeg

Encoder: libx265 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Platformcab61218243025.7525.6525.641. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUacb7K14K21K28K35K347963488534945

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Function Callcab90018002700360045004082.694081.424065.441. (CXX) g++ options: -O2 -std=gnu99 -lc

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4Kcba4812162015.8615.8515.801. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: vgg16cab163248648071.2071.2171.50MIN: 69.67 / MAX: 81.34MIN: 69.71 / MAX: 119.51MIN: 69.77 / MAX: 94.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUacb120K240K360K480K600K537531537704539773

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUcba100K200K300K400K500K463290464319465057

VVenC

Video Input: Bosphorus 1080p - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: Fasterabc4812162017.2017.1617.131. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streambac122436486052.2752.1252.08

FFmpeg

Encoder: libx264 - Scenario: Video On Demand

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Video On Demandcab91827364540.9840.9340.831. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

FFmpeg

Encoder: libx264 - Scenario: Upload

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Uploadacb369121510.9910.9610.951. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUbac81624324036.4636.4836.59MIN: 25.47 / MAX: 56.25MIN: 22.64 / MAX: 65.82MIN: 18.14 / MAX: 60.021. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

libavif avifenc

Encoder Speed: 6

OpenBenchmarking.orgSeconds, Fewer Is Betterlibavif avifenc 1.0Encoder Speed: 6bca369121512.3812.4012.421. (CXX) g++ options: -O3 -fPIC -lm

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: resnet50bca71421283528.5028.5428.60MIN: 26.91 / MAX: 36.74MIN: 26.96 / MAX: 39.01MIN: 27.3 / MAX: 36.91. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16 - Device: CPUbac20406080100109.56109.51109.181. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Embree

Binary: Pathtracer - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer - Model: Asian Dragon Objabc2468106.87986.86736.8562MIN: 6.83 / MAX: 7.02MIN: 6.82 / MAX: 7.03MIN: 6.81 / MAX: 7

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.3Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUabc130026003900520065005852.605868.635872.67MIN: 5725.89MIN: 5739.43MIN: 5729.991. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

QuantLib

Configuration: Multi-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-Threadedacb4K8K12K16K20K17332.317326.617273.41. (CXX) g++ options: -O3 -march=native -fPIE -pie

Stress-NG

Test: AVX-512 VNNI

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: AVX-512 VNNIcab50K100K150K200K250K240648.24239957.63239843.621. (CXX) g++ options: -O2 -std=gnu99 -lc

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Hashacb300K600K900K1200K1500K1369137.051366996.531364579.501. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: alexnetbac36912159.189.199.21MIN: 8.82 / MAX: 16.24MIN: 8.87 / MAX: 12.08MIN: 8.84 / MAX: 17.281. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Skeincoincba2K4K6K8K10K8361.858349.038334.911. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: CPU - Model: mobilenetbac51015202521.6621.6921.73MIN: 21.04 / MAX: 28.26MIN: 21.1 / MAX: 28.63MIN: 21.2 / MAX: 28.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUcab15003000450060007500717871877200

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamcba163248648071.5471.6871.76

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Pollcab150K300K450K600K750K700345.61699249.96698234.261. (CXX) g++ options: -O2 -std=gnu99 -lc

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUbca30K60K90K120K150K139878140057140298

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamcba102030405041.8841.8341.75

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Socket Activitycab90018002700360045004108.674105.684096.521. (CXX) g++ options: -O2 -std=gnu99 -lc

Cpuminer-Opt

Algorithm: Deepcoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Deepcoincba4008001200160020001841.831838.981836.391. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

DaCapo Benchmark

Java Test: Apache Kafka

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Kafkaacb13002600390052006500609060976108

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: System V Message Passingbac1.5M3M4.5M6M7.5M6910876.856906619.236891049.071. (CXX) g++ options: -O2 -std=gnu99 -lc

Cpuminer-Opt

Algorithm: Magi

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Magicba4080120160200161.21160.98160.751. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUbac4080120160200163.32163.39163.78MIN: 76.65 / MAX: 208.06MIN: 98.97 / MAX: 221.05MIN: 128.38 / MAX: 215.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

DaCapo Benchmark

Java Test: Apache Tomcat

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: Apache Tomcatacb2K4K6K8K10K110391106011070

Timed GCC Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 13.2Time To Compileacb4008001200160020001914.171917.261919.53

NCNN

Target: Vulkan GPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: yolov4-tinybca81624324032.2532.3132.34MIN: 31.59 / MAX: 40.48MIN: 31.47 / MAX: 40.92MIN: 31.72 / MAX: 37.861. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streambac132639526557.3657.5157.52

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUcab200K400K600K800K1000K921412922564923928

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streambca61218243025.9625.9926.03

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUbca70014002100280035003271.383265.893262.611. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Streambca91827364538.5038.4738.40

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamcab50100150200250225.37225.63225.95

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Streamcab0.99831.99662.99493.99324.99154.43694.43184.4256

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamcab132639526556.2456.3456.38

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUacb60120180240300261.73262.13262.39MIN: 211.82 / MAX: 297.88MIN: 196.09 / MAX: 303.22MIN: 143.56 / MAX: 301.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Glibc Qsort Data Sortingcba306090120150150.56150.52150.191. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenVINO

Model: Road Segmentation ADAS FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16 - Device: CPUbac61218243024.4724.4624.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Streamcab2040608010089.4089.2689.18

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1Mbac50100150200250249.0248.8248.41. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Synchronous Single-Streamcab369121511.1811.2011.20

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUcba2K4K6K8K10K833583518355

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.36VGR Performance Metriccab20K40K60K80K100K8230482277821181. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-Streamcab122436486053.2853.1953.17

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streambca51015202520.8820.9120.93

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Streambca112233445547.8747.8147.76

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4Kbca132639526555.8755.8655.761. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUacb4812162015.2615.2315.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUbca80160240320400384.37384.06383.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Streambca61218243023.8823.8423.83

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Synchronous Single-Streambca102030405041.8741.9341.95

OpenVINO

Model: Face Detection Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16 - Device: CPUbca369121510.3710.3810.39MIN: 6.89 / MAX: 21.86MIN: 5.14 / MAX: 21.27MIN: 5.19 / MAX: 22.541. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-Onlycba60120180240300273.54273.88274.06

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-Onlycba2004006008001000925.22926.69926.75

OpenRadioss

Model: Chrysler Neon 1M

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1Mcba50010001500200025002137.082140.082140.54

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16 - Device: CPUcba60012001800240030002705.552709.892709.93MIN: 2050.1 / MAX: 2797.44MIN: 2071.72 / MAX: 2802.51MIN: 2079.4 / MAX: 2803.641. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Quad SHA-256, Pyritebac3K6K9K12K15K1255012550125301. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Streamacb91827364540.0940.0840.03

Neural Magic DeepSparse

Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Synchronous Single-Streamacb61218243024.9424.9424.97

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-Onlycab60012001800240030002871.442872.402875.21

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUcba8K16K24K32K40K351573516235203

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUabc50K100K150K200K250K232873233029233165

FFmpeg

Encoder: libx264 - Scenario: Platform

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx264 - Scenario: Platformcab91827364540.8740.8740.821. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Vector Shufflecab90018002700360045004036.744032.304031.901. (CXX) g++ options: -O2 -std=gnu99 -lc

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streambac4080120160200203.54203.72203.76

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Streambac1.10542.21083.31624.42165.5274.91274.90834.9075

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUbca200K400K600K800K1000K106941810703411070452

Java SciMark

Computational Test: Jacobi Successive Over-Relaxation

OpenBenchmarking.orgMflops, More Is BetterJava SciMark 2.2Computational Test: Jacobi Successive Over-Relaxationacb4008001200160020001698.071697.601696.66

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUcab4080120160200195.76195.63195.601. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Malloccab600K1200K1800K2400K3000K2858628.372857973.822856309.441. (CXX) g++ options: -O2 -std=gnu99 -lc

QuantLib

Configuration: Single-Threaded

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-Threadedbca60012001800240030002769.22767.42767.11. (CXX) g++ options: -O3 -march=native -fPIE -pie

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamcab50100150200250224.49224.57224.64

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Streamcab1.00222.00443.00664.00885.0114.45434.45274.4513

DaCapo Benchmark

Java Test: jMonkeyEngine

OpenBenchmarking.orgmsec, Fewer Is BetterDaCapo Benchmark 23.11Java Test: jMonkeyEngineacb15003000450060007500695869596962

Cpuminer-Opt

Algorithm: Triple SHA-256, Onecoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 23.5Algorithm: Triple SHA-256, Onecoinacb4K8K12K16K20K1796017950179501. (CXX) g++ options: -O2 -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: Atomicbac100200300400500459.14459.00458.911. (CXX) g++ options: -O2 -std=gnu99 -lc

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUcab51015202520.4120.4220.42MIN: 15.23 / MAX: 35.17MIN: 12.43 / MAX: 70.22MIN: 12.75 / MAX: 44.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

easyWave

Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200acb70140210280350337.43337.55337.551. (CXX) g++ options: -O3 -fopenmp

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.13Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUabc9K18K27K36K45K397633977239774

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.16.04Test: x86_64 RdRandbca140028004200560070006665.266664.616663.751. (CXX) g++ options: -O2 -std=gnu99 -lc

NCNN

Target: Vulkan GPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20230517Target: Vulkan GPU - Model: blazefaceabc0.3240.6480.9721.2961.621.441.441.44MIN: 1.4 / MAX: 1.6MIN: 1.39 / MAX: 1.55MIN: 1.38 / MAX: 1.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-Onlycba0.05180.10360.15540.20720.2590.230.230.23

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Only

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.hdr_alb_nrm.3840x2160 - Device: CPU-Onlycba0.05180.10360.15540.20720.2590.230.230.23

WebP2 Image Encode

Encode Settings: Quality 100, Lossless Compression

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 100, Lossless Compressioncba0.00230.00460.00690.00920.01150.010.010.011. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 95, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 95, Compression Effort 7cba0.00680.01360.02040.02720.0340.030.030.031. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

WebP2 Image Encode

Encode Settings: Quality 75, Compression Effort 7

OpenBenchmarking.orgMP/s, More Is BetterWebP2 Image Encode 20220823Encode Settings: Quality 75, Compression Effort 7cba0.01580.03160.04740.06320.0790.070.070.071. (CXX) g++ options: -msse4.2 -fno-rtti -O3 -ldl

Apache Spark TPC-H

Scale Factor: 1 - Q22

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q22acb0.34540.69081.03621.38161.7271.302993541.507564071.53510463

Apache Spark TPC-H

Scale Factor: 1 - Q21

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q21cab36912158.863840109.073050509.54779816

Apache Spark TPC-H

Scale Factor: 1 - Q20

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q20cab0.57311.14621.71932.29242.86552.362868312.413729192.54700851

Apache Spark TPC-H

Scale Factor: 1 - Q19

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q19acb0.40040.80081.20121.60162.0021.560506581.629401451.77942574

Apache Spark TPC-H

Scale Factor: 1 - Q18

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q18abc0.96141.92282.88423.84564.8074.206442364.267047414.27269268

Apache Spark TPC-H

Scale Factor: 1 - Q17

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q17cba0.81611.63222.44833.26444.08053.509280203.619349003.62711215

Apache Spark TPC-H

Scale Factor: 1 - Q16

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q16cab0.34150.6831.02451.3661.70751.444920421.496082901.51768637

Apache Spark TPC-H

Scale Factor: 1 - Q15

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q15acb0.40030.80061.20091.60122.00151.744464281.769907001.77919817

Apache Spark TPC-H

Scale Factor: 1 - Q14

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q14bac0.37690.75381.13071.50761.88451.661646721.667633891.67524362

Apache Spark TPC-H

Scale Factor: 1 - Q13

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q13cba0.3830.7661.1491.5321.9151.501641751.569976811.70204818

Apache Spark TPC-H

Scale Factor: 1 - Q12

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q12cba0.50831.01661.52492.03322.54152.181554082.203383452.25927687

Apache Spark TPC-H

Scale Factor: 1 - Q11

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q11bca0.31680.63360.95041.26721.5841.288396721.307765011.40807271

Apache Spark TPC-H

Scale Factor: 1 - Q10

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q10abc0.65011.30021.95032.60043.25052.772442822.799874542.88941693

Apache Spark TPC-H

Scale Factor: 1 - Q09

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q09cba0.98911.97822.96733.95644.94554.189742574.367016324.39579391

Apache Spark TPC-H

Scale Factor: 1 - Q08

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q08bac0.5981.1961.7942.3922.992.552676922.589612252.65772152

Apache Spark TPC-H

Scale Factor: 1 - Q07

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q07cab0.65451.3091.96352.6183.27252.904565812.905851362.90909719

Apache Spark TPC-H

Scale Factor: 1 - Q06

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q06acb0.31370.62740.94111.25481.56851.320014361.391615271.39413798

Apache Spark TPC-H

Scale Factor: 1 - Q05

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q05cba0.75241.50482.25723.00963.7623.146521573.216317653.34390712

Apache Spark TPC-H

Scale Factor: 1 - Q04

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q04cba0.66541.33081.99622.66163.3272.766784432.871533162.95742679

Apache Spark TPC-H

Scale Factor: 1 - Q03

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q03acb0.78671.57342.36013.14683.93353.146645073.211069353.49644971

Apache Spark TPC-H

Scale Factor: 1 - Q02

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q02abc0.69181.38362.07542.76723.4592.695819142.768858913.07445645

Apache Spark TPC-H

Scale Factor: 1 - Q01

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 1 - Q01acb1.17082.34163.51244.68325.8544.986022005.069004065.20342541


Phoronix Test Suite v10.8.5