Intel Optimized Power Mode Xeon Platinum Benchmarks

2 x INTEL XEON PLATINUM 8592 testing by Michael Larabel for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2312153-NE-XEONEMRPO30
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Default
December 14 2023
  16 Hours, 25 Minutes
Optimized Power Mode
December 15 2023
  1 Day, 52 Minutes
Invert Behavior (Only Show Selected Data)
  20 Hours, 38 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Intel Optimized Power Mode Xeon Platinum BenchmarksOpenBenchmarking.orgPhoronix Test Suite2 x INTEL XEON PLATINUM 8592+ @ 3.90GHz (128 Cores / 256 Threads)Quanta Cloud S6Q-MB-MPS (3B05.TEL4P1 BIOS)Intel Device 1bce1008GB3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Intel X710 for 10GBASE-TUbuntu 23.106.5.0-13-generic (x86_64)GCC 13.2.0ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionIntel Optimized Power Mode Xeon Platinum Benchmarks PerformanceSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_pstate performance (EPP: performance) - CPU Microcode: 0x21000161- OpenJDK Runtime Environment (build 11.0.21+9-post-Ubuntu-0ubuntu123.10)- Python 3.11.6- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Default vs. Optimized Power Mode ComparisonPhoronix Test SuiteBaseline+13.5%+13.5%+27%+27%+40.5%+40.5%+54%+54%15%10.7%8.4%4.6%4.2%3.7%2.7%2.5%1:1054.1%CPU - 256 - ResNet-5041.2%CPU - 256 - ResNet-15239.3%CPU - 64 - ResNet-15238.5%50035.1%CPU - 64 - ResNet-5033.7%motorBike - Execution Time33.3%100031.7%GET - 5024.5%12 - Compression Speed22.6%CPU - 64 - Efficientnet_v2_l20.2%GhostRider - 1M19.4%Bosphorus 4K - Faster19.1%Bosphorus 4K - Ultra Fast18.3%CPU - 256 - Efficientnet_v2_l18.3%19 - Compression Speed17.9%10 - G.M.O.A.Q16.9%e.G.B.S - 120016.5%19, Long Mode - Compression Speed15.7%Barbershop - CPU-OnlyPreset 12 - Bosphorus 1080p14.4%e.G.B.S - 240014.4%IMDB14.2%Bosphorus 4K - Super Fast14.2%Bosphorus 4K - Very Fast14.2%Create - 100 - 10000014%50012.4%19 - D.S12.3%Preset 8 - Bosphorus 1080p12.3%Preset 8 - Bosphorus 4K12.2%libx265 - Live11.5%Bosphorus 1080p - Faster10.9%12 - D.S10.9%1B32 - 256 - 5710.5%Bosphorus 1080p - Fast10.3%VMAF Optimized - Bosphorus 1080p10.1%64 - 256 - 579.9%Preset 12 - Bosphorus 4K9.9%Preset 4 - Bosphorus 4K9.8%Preset 13 - Bosphorus 4K9.6%Preset 13 - Bosphorus 1080p9.4%R.O.R.S.I9.4%Bosphorus 4K - Ultra Fast9.4%Bosphorus 1080p - Very Fast9.2%Bosphorus 4K - Fast9.2%Bosphorus 1080p - Ultra Fast8.7%Bosphorus 1080p - Super Fast8.6%d.S.M.S - Mesh Time19, Long Mode - D.S8.2%P.S.O - Bosphorus 1080p8%Time To Compile7.5%100 - 1000 - Read Write - Average Latency7.2%100 - 1000 - Read Write7.1%V.Q.O - Bosphorus 1080p6.9%Bosphorus 1080p - Ultra Fast6.9%Bosphorus 4K - Very Fast6.8%Preset 4 - Bosphorus 1080p6.5%10005.9%Unix Makefiles5.9%TPC-H Parquet5.8%Bosphorus 4K - Super Fast5.7%Compression Rating5.4%libx265 - Platform5.2%1:1005.1%Bosphorus 1080p - Super Fast5%128 - 256 - 575%Bosphorus 1080p - Very Fast4.8%SET - 5004.8%R.5.S.I - A.M.S4.7%R.5.S.I - A.M.S4.7%Classroom - CPU-Onlylibx265 - Video On Demand4.2%RT.ldr_alb_nrm.3840x2160 - CPU-Onlylibx265 - Upload3.8%128 - 256 - 32A.G.R.R.0.F.I - CPU3.6%32 - 256 - 5123.4%256 - 256 - 573.2%defconfig3%GET - 5002.8%128 - 256 - 512A.G.R.R.0.F.I - CPU2.5%Bumper BeamNinja2.5%10 - Q0119%10 - Q0240.2%10 - Q0319.3%10 - Q0413.7%10 - Q0539.4%10 - Q0626.8%10 - Q0722.5%10 - Q0830.5%10 - Q0923.3%10 - Q1018.4%10 - Q1133.9%10 - Q1226.8%10 - Q1315.8%10 - Q1413.3%10 - Q158.7%10 - Q1613.8%10 - Q173.4%10 - Q1810.1%10 - Q1912.6%10 - Q2019.6%10 - Q2117.7%10 - Q2210.5%MemcachedPyTorchPyTorchPyTorchnginxPyTorchOpenFOAMnginxRedisZstd CompressionPyTorchXmrigVVenCuvg266PyTorchZstd CompressionApache Spark TPC-HeasyWaveZstd CompressionBlenderSVT-AV1easyWaveDuckDBuvg266uvg266Apache HadoopApache HTTP ServerZstd CompressionSVT-AV1SVT-AV1FFmpegVVenCZstd CompressionY-CruncherLiquid-DSPVVenCSVT-VP9Liquid-DSPSVT-AV1SVT-AV1SVT-AV1SVT-AV1OpenRadiossKvazaaruvg266VVenCuvg266uvg266OpenFOAMZstd CompressionSVT-VP9Timed GCC CompilationPostgreSQLPostgreSQLSVT-VP9KvazaarKvazaarSVT-AV1Apache HTTP ServerTimed LLVM CompilationDuckDBKvazaar7-Zip CompressionFFmpegMemcachedKvazaarLiquid-DSPKvazaarRedisNeural Magic DeepSparseNeural Magic DeepSparseBlenderFFmpegIntel Open Image DenoiseFFmpegLiquid-DSPOpenVINOLiquid-DSPLiquid-DSPTimed Linux Kernel CompilationRedisLiquid-DSPOpenVINOOpenRadiossTimed LLVM CompilationApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HApache Spark TPC-HDefaultOptimized Power Mode

Intel Optimized Power Mode Xeon Platinum Benchmarkspytorch: CPU - 64 - ResNet-50pytorch: CPU - 256 - ResNet-50pytorch: CPU - 64 - ResNet-152pytorch: CPU - 256 - ResNet-152pytorch: CPU - 64 - Efficientnet_v2_lpytorch: CPU - 256 - Efficientnet_v2_lffmpeg: libx265 - Liveffmpeg: libx265 - Uploadffmpeg: libx265 - Platformffmpeg: libx265 - Video On Demandopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUkvazaar: Bosphorus 4K - Slowkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 1080p - Slowkvazaar: Bosphorus 1080p - Mediumkvazaar: Bosphorus 4K - Very Fastkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 1080p - Very Fastkvazaar: Bosphorus 1080p - Super Fastsvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 12 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080psvt-vp9: VMAF Optimized - Bosphorus 1080psvt-vp9: PSNR/SSIM Optimized - Bosphorus 1080puvg266: Bosphorus 4K - Super Fastvvenc: Bosphorus 4K - Fastkvazaar: Bosphorus 1080p - Ultra Fastsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-vp9: Visual Quality Optimized - Bosphorus 1080puvg266: Bosphorus 4K - Slowuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 1080p - Slowuvg266: Bosphorus 1080p - Mediumuvg266: Bosphorus 4K - Very Fastuvg266: Bosphorus 4K - Ultra Fastuvg266: Bosphorus 1080p - Very Fastuvg266: Bosphorus 1080p - Super Fastuvg266: Bosphorus 1080p - Ultra Fastvvenc: Bosphorus 4K - Fastervvenc: Bosphorus 1080p - Fastvvenc: Bosphorus 1080p - Fasterxmrig: KawPow - 1Mxmrig: Wownero - 1Mxmrig: GhostRider - 1Mxmrig: Monero - 1Mxmrig: CryptoNight-Heavy - 1Mxmrig: CryptoNight-Femto UPX2 - 1Moidn: RT.ldr_alb_nrm.3840x2160 - CPU-Onlydeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamcompress-zstd: 12 - Compression Speedcompress-zstd: 12 - Decompression Speedcompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedcompress-zstd: 19, Long Mode - Decompression Speedquantlib: Multi-Threadedquantlib: Single-Threadedcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratinghadoop: Create - 100 - 100000memcached: 1:10memcached: 1:100redis: GET - 50redis: SET - 50redis: GET - 500redis: SET - 500nginx: 500nginx: 1000apache: 500apache: 1000liquid-dsp: 32 - 256 - 32liquid-dsp: 32 - 256 - 57liquid-dsp: 256 - 256 - 32liquid-dsp: 256 - 256 - 57liquid-dsp: 32 - 256 - 512liquid-dsp: 64 - 256 - 512liquid-dsp: 64 - 256 - 32liquid-dsp: 128 - 256 - 32liquid-dsp: 128 - 256 - 57liquid-dsp: 128 - 256 - 512liquid-dsp: 256 - 256 - 512liquid-dsp: 64 - 256 - 57pgbench: 100 - 1000 - Read Onlypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Write - Average Latencyopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamopenfoam: motorBike - Execution Timeopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenradioss: Bumper Beamopenradioss: Chrysler Neon 1Mopenradioss: Cell Phone Drop Testopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: INIVOL and Fluid Structure Interaction Drop Containereasywave: e2Asean Grid + BengkuluSept2007 Source - 1200easywave: e2Asean Grid + BengkuluSept2007 Source - 2400build-gcc: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-llvm: Ninjabuild-llvm: Unix Makefilesy-cruncher: 1Bspark-tpch: 10 - Geometric Mean Of All Queriesspark-tpch: 10 - Q01spark-tpch: 10 - Q02spark-tpch: 10 - Q03spark-tpch: 10 - Q04spark-tpch: 10 - Q05spark-tpch: 10 - Q06spark-tpch: 10 - Q07spark-tpch: 10 - Q08spark-tpch: 10 - Q09spark-tpch: 10 - Q10spark-tpch: 10 - Q11spark-tpch: 10 - Q12spark-tpch: 10 - Q13spark-tpch: 10 - Q14spark-tpch: 10 - Q15spark-tpch: 10 - Q16spark-tpch: 10 - Q17spark-tpch: 10 - Q18spark-tpch: 10 - Q19spark-tpch: 10 - Q20spark-tpch: 10 - Q21spark-tpch: 10 - Q22duckdb: IMDBduckdb: TPC-H Parquetblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Barbershop - CPU-Onlyqmcpack: Li2_STO_aeDefaultOptimized Power Mode43.9144.5817.6717.852.622.59131.8127.0053.9853.63748.10539.698930.0024795.172390.251106.3248795.9710205.613330.19121577.5541.4541.99127.25131.1469.3671.0577.53268.49263.88218.76320.952142.265502.707628.755542.98542.1757.876.921282.057.29769.466218.452463.2727.2029.7980.3088.4656.0659.59160.63158.23166.4710.83619.91532.09170383.275002.316522.570469.870573.069677.84.53137.34394580.63181778.594511244.7941834.1767160.40641791.2737862.13821235.4063182.15911899.2223137.3540333.61422.719.11173.59.901183.8388447.23650.568951663731154903360511.123441439.714744838.93060186.423240001.582503177.67273684.71243384.1990823.0680826.7112117666671429100000618560000058355000005082450001012336667247603333336118666674329866667147390000021445666672810166667893089639621.12415.63442.72236.7014.325.1553.5128.852.4512.5138.410.40463.085413.945135.93145.673276.5445397.773135.669574.072251.7033350.900833.6385462.99324.1328830.0422323.46982284.7885.8225.74111.2381.6997.8736.54689.984706.25923.756149.79296.518177.4315.1998.359196838.841855697.6981140812.590769778.1769722312.944283492.5661711711.4746182812.0530392317.5612882011.879122105.997661757.933933265.644020565.778444924.245615804.9724410412.6007382112.894165685.094584628.5617198926.481879554.49565951121.967148.5512.8934.94149.4994.38432.8331.5812.7612.812.182.19118.2426.0251.3151.45750.43538.208943.8824922.402392.381100.7649494.0610168.063297.81117369.5541.1341.69125.18130.6464.9767.2170.87256.19251.33199.54919.669126.697439.477574.599493.26502.0550.686.340263.966.64561.914198.742433.5326.7129.6278.9386.7849.1050.36147.08145.75153.179.09618.05328.92669196.775701.713832.470298.870338.669847.94.72138.01144590.33751768.910810738.1352834.2706162.58951776.5252863.34741237.0257183.71041883.6573138.1497272.21282.716.21044.68.561094.2391468.43641.465445963813648142180648.213274425.323811819.503050498.003152359.752389636.67202507.42184861.9980817.7376315.651204500000129333333363014833335656600000491426667999663333246086666737452333334125000000151346666721410000002556573333878468596951.14116.75242.59237.3614.305.1353.4528.992.4212.5538.790.41461.146913.909536.12865.938576.5042392.451535.956173.989651.6176346.741133.9032460.68515.5089727.7087323.34883382.7386.3025.37111.7389.3798.4942.559102.928759.21624.476151.27698.905187.8374.6979.7730412710.5253196410.7942171115.018873089.2947692918.041547783.2531764214.0577049315.7232208221.6599576114.062806408.0304369910.057694166.534819476.548335144.614900045.6564852813.0284314914.199875835.7373820010.2426731931.161191124.96957016139.326157.10112.6733.40129.9492.672OpenBenchmarking.org

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringDefaultOptimized Power Mode10002000300040005000Min: 500 / Avg: 3374.53 / Max: 5474Min: 800 / Avg: 3437 / Max: 5154

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringDefaultOptimized Power Mode140280420560700Min: 101.15 / Avg: 445.93 / Max: 802.3Min: 88.73 / Avg: 366.23 / Max: 802.53

PyTorch

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50DefaultOptimized Power Mode0.01910.03820.05730.07640.09550.0850.082

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-50DefaultOptimized Power Mode0.01910.03820.05730.07640.09550.0850.079

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152DefaultOptimized Power Mode0.00720.01440.02160.02880.0360.0320.030

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50DefaultOptimized Power Mode1020304050SE +/- 0.55, N = 4SE +/- 0.39, N = 343.9132.83MIN: 17.29 / MAX: 46.23MIN: 15.85 / MAX: 36.48

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-50DefaultOptimized Power Mode1020304050SE +/- 0.51, N = 4SE +/- 0.02, N = 344.5831.58MIN: 19.44 / MAX: 46.72MIN: 14.91 / MAX: 34.67

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152DefaultOptimized Power Mode48121620SE +/- 0.23, N = 3SE +/- 0.12, N = 1217.6712.76MIN: 10.89 / MAX: 18.38MIN: 5.75 / MAX: 15.71

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-152DefaultOptimized Power Mode48121620SE +/- 0.13, N = 11SE +/- 0.17, N = 317.8512.81MIN: 7.02 / MAX: 19.19MIN: 6.6 / MAX: 13.9

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lDefaultOptimized Power Mode0.58951.1791.76852.3582.9475SE +/- 0.02, N = 3SE +/- 0.02, N = 32.622.18MIN: 1.32 / MAX: 3.9MIN: 0.98 / MAX: 3.41

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_lDefaultOptimized Power Mode0.58281.16561.74842.33122.914SE +/- 0.00, N = 3SE +/- 0.02, N = 32.592.19MIN: 1.19 / MAX: 4MIN: 0.98 / MAX: 3.3

FFmpeg

OpenBenchmarking.orgFPS Per Watt, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On DemandDefaultOptimized Power Mode0.05310.10620.15930.21240.26550.1690.236

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: LiveDefaultOptimized Power Mode306090120150SE +/- 1.03, N = 3SE +/- 0.79, N = 3131.81118.241. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: UploadDefaultOptimized Power Mode612182430SE +/- 0.06, N = 3SE +/- 0.06, N = 327.0026.021. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: PlatformDefaultOptimized Power Mode1224364860SE +/- 0.11, N = 3SE +/- 0.14, N = 353.9851.311. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenBenchmarking.orgFPS, More Is BetterFFmpeg 6.1Encoder: libx265 - Scenario: Video On DemandDefaultOptimized Power Mode1224364860SE +/- 0.04, N = 3SE +/- 0.10, N = 353.6351.451. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUDefaultOptimized Power Mode160320480640800SE +/- 0.71, N = 3SE +/- 0.90, N = 3748.10750.431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUDefaultOptimized Power Mode120240360480600SE +/- 0.65, N = 3SE +/- 1.35, N = 3539.69538.201. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUDefaultOptimized Power Mode2K4K6K8K10KSE +/- 5.30, N = 3SE +/- 4.32, N = 38930.008943.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUDefaultOptimized Power Mode5K10K15K20K25KSE +/- 42.09, N = 3SE +/- 6.86, N = 324795.1724922.401. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUDefaultOptimized Power Mode5001000150020002500SE +/- 3.42, N = 3SE +/- 7.16, N = 32390.252392.381. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUDefaultOptimized Power Mode2004006008001000SE +/- 9.12, N = 3SE +/- 3.05, N = 31106.321100.761. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUDefaultOptimized Power Mode11K22K33K44K55KSE +/- 490.25, N = 3SE +/- 229.19, N = 348795.9749494.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUDefaultOptimized Power Mode2K4K6K8K10KSE +/- 7.22, N = 3SE +/- 6.61, N = 310205.6110168.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUDefaultOptimized Power Mode7001400210028003500SE +/- 7.06, N = 3SE +/- 6.73, N = 33330.193297.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUDefaultOptimized Power Mode30K60K90K120K150KSE +/- 775.18, N = 3SE +/- 1361.46, N = 3121577.55117369.551. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Kvazaar

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowDefaultOptimized Power Mode0.01820.03640.05460.07280.0910.0770.081

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumDefaultOptimized Power Mode0.01890.03780.05670.07560.09450.0780.084

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: SlowDefaultOptimized Power Mode0.09810.19620.29430.39240.49050.3600.436

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: MediumDefaultOptimized Power Mode0.10130.20260.30390.40520.50650.3720.450

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastDefaultOptimized Power Mode0.03940.07880.11820.15760.1970.1640.175

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastDefaultOptimized Power Mode0.04390.08780.13170.17560.21950.1780.195

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastDefaultOptimized Power Mode0.05240.10480.15720.20960.2620.2130.233

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very FastDefaultOptimized Power Mode0.21560.43120.64680.86241.0780.9250.958

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastDefaultOptimized Power Mode0.22280.44560.66840.89121.1140.940.99

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra FastDefaultOptimized Power Mode0.25020.50040.75061.00081.2511.0511.112

SVT-AV1

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KDefaultOptimized Power Mode0.00560.01120.01680.02240.0280.0200.025

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KDefaultOptimized Power Mode0.05060.10120.15180.20240.2530.1920.225

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KDefaultOptimized Power Mode0.20180.40360.60540.80721.0090.8080.897

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KDefaultOptimized Power Mode0.20180.40360.60540.80721.0090.8200.897

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 1080pDefaultOptimized Power Mode0.01940.03880.05820.07760.0970.0680.086

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 1080pDefaultOptimized Power Mode0.12620.25240.37860.50480.6310.4780.561

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 1080pDefaultOptimized Power Mode0.48560.97121.45681.94242.4282.0422.158

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 1080pDefaultOptimized Power Mode0.6391.2781.9172.5563.1952.642.84

SVT-VP9

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-VP9 0.3Tuning: VMAF Optimized - Input: Bosphorus 1080pDefaultOptimized Power Mode0.51191.02381.53572.04762.55952.0032.275

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-VP9 0.3Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080pDefaultOptimized Power Mode0.51461.02921.54382.05842.5731.9992.287

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-VP9 0.3Tuning: Visual Quality Optimized - Input: Bosphorus 1080pDefaultOptimized Power Mode0.43790.87581.31371.75162.18951.6661.946

uvg266

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowDefaultOptimized Power Mode0.01150.0230.03450.0460.05750.0480.051

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumDefaultOptimized Power Mode0.01310.02620.03930.05240.06550.0540.058

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowDefaultOptimized Power Mode0.05130.10260.15390.20520.25650.2080.228

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: MediumDefaultOptimized Power Mode0.05780.11560.17340.23120.2890.2360.257

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastDefaultOptimized Power Mode0.03020.06040.09060.12080.1510.1250.134

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastDefaultOptimized Power Mode0.03240.06480.09720.12960.1620.1310.144

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: SlowDefaultOptimized Power Mode918273645SE +/- 0.06, N = 4SE +/- 0.06, N = 441.4541.131. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: MediumDefaultOptimized Power Mode1020304050SE +/- 0.06, N = 4SE +/- 0.05, N = 441.9941.691. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: SlowDefaultOptimized Power Mode306090120150SE +/- 0.38, N = 8SE +/- 0.35, N = 8127.25125.181. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: MediumDefaultOptimized Power Mode306090120150SE +/- 0.46, N = 8SE +/- 0.58, N = 8131.14130.641. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Very FastDefaultOptimized Power Mode1530456075SE +/- 0.26, N = 5SE +/- 0.44, N = 569.3664.971. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super FastDefaultOptimized Power Mode1632486480SE +/- 0.25, N = 5SE +/- 0.12, N = 571.0567.211. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra FastDefaultOptimized Power Mode20406080100SE +/- 0.23, N = 6SE +/- 0.70, N = 677.5370.871. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Very FastDefaultOptimized Power Mode60120180240300SE +/- 1.16, N = 10SE +/- 1.04, N = 10268.49256.191. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Super FastDefaultOptimized Power Mode60120180240300SE +/- 1.09, N = 10SE +/- 1.69, N = 10263.88251.331. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastDefaultOptimized Power Mode0.03580.07160.10740.14320.1790.1450.159

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super FastDefaultOptimized Power Mode0.12310.24620.36930.49240.61550.5260.547

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KDefaultOptimized Power Mode50100150200250SE +/- 1.12, N = 5SE +/- 1.56, N = 9218.76199.551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 1080pDefaultOptimized Power Mode510152025SE +/- 0.16, N = 5SE +/- 0.11, N = 520.9519.671. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 1080pDefaultOptimized Power Mode306090120150SE +/- 0.36, N = 7SE +/- 0.77, N = 6142.27126.701. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 1080pDefaultOptimized Power Mode110220330440550SE +/- 3.53, N = 9SE +/- 4.01, N = 15502.71439.481. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 1080pDefaultOptimized Power Mode140280420560700SE +/- 4.69, N = 11SE +/- 3.16, N = 10628.76574.601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-VP9

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample YUV input video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: VMAF Optimized - Input: Bosphorus 1080pDefaultOptimized Power Mode120240360480600SE +/- 2.30, N = 9SE +/- 9.88, N = 15542.98493.261. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

Tuning: PSNR/SSIM Optimized - Input: Bosphorus 4K

Default: The test quit with a non-zero exit status.

Optimized Power Mode: The test quit with a non-zero exit status.

uvg266

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastDefaultOptimized Power Mode0.12040.24080.36120.48160.6020.5260.535

OpenBenchmarking.orgFrames Per Second Per Watt, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra FastDefaultOptimized Power Mode0.13250.2650.39750.530.66250.5660.589

VVenC

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FastDefaultOptimized Power Mode0.00470.00940.01410.01880.02350.0170.021

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FasterDefaultOptimized Power Mode0.0070.0140.0210.0280.0350.0270.031

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: FastDefaultOptimized Power Mode0.01510.03020.04530.06040.07550.0530.067

SVT-VP9

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample YUV input video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: PSNR/SSIM Optimized - Input: Bosphorus 1080pDefaultOptimized Power Mode120240360480600SE +/- 4.34, N = 9SE +/- 3.72, N = 8542.17502.051. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super FastDefaultOptimized Power Mode1326395265SE +/- 0.15, N = 5SE +/- 0.48, N = 457.8750.68

VVenC

VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under the Clear BSD License. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FastDefaultOptimized Power Mode246810SE +/- 0.067, N = 3SE +/- 0.066, N = 36.9216.3401. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: FasterDefaultOptimized Power Mode0.02590.05180.07770.10360.12950.0920.115

Kvazaar

This is a test of Kvazaar as a CPU-based H.265/HEVC video encoder written in the C programming language and optimized in Assembly. Kvazaar is the winner of the 2016 ACM Open-Source Software Competition and developed at the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 1080p - Video Preset: Ultra FastDefaultOptimized Power Mode60120180240300SE +/- 2.07, N = 11SE +/- 1.93, N = 10282.05263.961. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KDefaultOptimized Power Mode246810SE +/- 0.098, N = 3SE +/- 0.006, N = 37.2976.6451. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KDefaultOptimized Power Mode1530456075SE +/- 0.39, N = 4SE +/- 0.56, N = 469.4761.911. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KDefaultOptimized Power Mode50100150200250SE +/- 0.90, N = 6SE +/- 2.06, N = 5218.45198.741. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-VP9

This is a test of the Intel Open Visual Cloud Scalable Video Technology SVT-VP9 CPU-based multi-threaded video encoder for the VP9 video format with a sample YUV input video file. Learn more via the OpenBenchmarking.org test page.

Tuning: VMAF Optimized - Input: Bosphorus 4K

Default: The test quit with a non-zero exit status.

Optimized Power Mode: The test quit with a non-zero exit status.

Tuning: Visual Quality Optimized - Input: Bosphorus 4K

Default: The test quit with a non-zero exit status.

Optimized Power Mode: The test quit with a non-zero exit status.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-VP9 0.3Tuning: Visual Quality Optimized - Input: Bosphorus 1080pDefaultOptimized Power Mode100200300400500SE +/- 1.93, N = 8SE +/- 2.86, N = 8463.27433.531. (CC) gcc options: -O3 -fcommon -fPIE -fPIC -fvisibility=hidden -pie -rdynamic -lpthread -lrt -lm

uvg266

uvg266 is an open-source VVC/H.266 (Versatile Video Coding) encoder based on Kvazaar as part of the Ultra Video Group, Tampere University, Finland. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: SlowDefaultOptimized Power Mode612182430SE +/- 0.08, N = 3SE +/- 0.08, N = 327.2026.71

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: MediumDefaultOptimized Power Mode714212835SE +/- 0.08, N = 3SE +/- 0.19, N = 329.7929.62

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: SlowDefaultOptimized Power Mode20406080100SE +/- 0.10, N = 6SE +/- 0.19, N = 680.3078.93

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: MediumDefaultOptimized Power Mode20406080100SE +/- 0.08, N = 6SE +/- 0.25, N = 688.4686.78

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Very FastDefaultOptimized Power Mode1326395265SE +/- 0.07, N = 5SE +/- 0.45, N = 1556.0649.10

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra FastDefaultOptimized Power Mode1326395265SE +/- 0.37, N = 5SE +/- 0.21, N = 459.5950.36

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Very FastDefaultOptimized Power Mode4080120160200SE +/- 0.74, N = 8SE +/- 1.07, N = 11160.63147.08

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Super FastDefaultOptimized Power Mode306090120150SE +/- 1.01, N = 15SE +/- 1.05, N = 15158.23145.75

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 1080p - Video Preset: Ultra FastDefaultOptimized Power Mode4080120160200SE +/- 1.12, N = 9SE +/- 1.12, N = 15166.47153.17

VVenC

VVenC is the Fraunhofer Versatile Video Encoder as a fast/efficient H.266/VVC encoder. The vvenc encoder makes use of SIMD Everywhere (SIMDe). The vvenc software is published under the Clear BSD License. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 4K - Video Preset: FasterDefaultOptimized Power Mode3691215SE +/- 0.081, N = 3SE +/- 0.072, N = 310.8369.0961. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: FastDefaultOptimized Power Mode510152025SE +/- 0.15, N = 3SE +/- 0.11, N = 319.9218.051. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.9Video Input: Bosphorus 1080p - Video Preset: FasterDefaultOptimized Power Mode714212835SE +/- 0.36, N = 3SE +/- 0.30, N = 432.0928.931. (CXX) g++ options: -O3 -flto=auto -fno-fat-lto-objects

Xmrig

Xmrig is an open-source cross-platform CPU/GPU miner for RandomX, KawPow, CryptoNight and AstroBWT. This test profile is setup to measure the Xmrig CPU mining performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: KawPow - Hash Count: 1MDefaultOptimized Power Mode15K30K45K60K75KSE +/- 82.14, N = 4SE +/- 943.50, N = 370383.269196.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Wownero - Hash Count: 1MDefaultOptimized Power Mode16K32K48K64K80KSE +/- 677.05, N = 4SE +/- 24.14, N = 475002.375701.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MDefaultOptimized Power Mode4K8K12K16K20KSE +/- 67.39, N = 3SE +/- 22.03, N = 316522.513832.41. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: Monero - Hash Count: 1MDefaultOptimized Power Mode15K30K45K60K75KSE +/- 27.69, N = 4SE +/- 41.44, N = 370469.870298.81. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1MDefaultOptimized Power Mode306090120150126.16131.15

OpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1MDefaultOptimized Power Mode306090120150123.55130.14

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Heavy - Hash Count: 1MDefaultOptimized Power Mode15K30K45K60K75KSE +/- 49.63, N = 4SE +/- 96.69, N = 370573.070338.61. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: CryptoNight-Femto UPX2 - Hash Count: 1MDefaultOptimized Power Mode15K30K45K60K75KSE +/- 844.15, N = 4SE +/- 443.65, N = 369677.869847.91. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Intel Open Image Denoise

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyDefaultOptimized Power Mode0.00230.00460.00690.00920.01150.010.01

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 2.1Run: RT.ldr_alb_nrm.3840x2160 - Device: CPU-OnlyDefaultOptimized Power Mode1.0622.1243.1864.2485.31SE +/- 0.01, N = 6SE +/- 0.01, N = 64.534.72

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode306090120150SE +/- 0.21, N = 3SE +/- 0.12, N = 3137.34138.01

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode10002000300040005000SE +/- 6.99, N = 3SE +/- 2.64, N = 34580.634590.34

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode400800120016002000SE +/- 3.42, N = 3SE +/- 6.86, N = 31778.591768.91

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode2K4K6K8K10KSE +/- 7.42, N = 3SE +/- 12.41, N = 311244.7910738.14

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode2004006008001000SE +/- 0.97, N = 3SE +/- 0.60, N = 3834.18834.27

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode4080120160200SE +/- 1.36, N = 3SE +/- 0.33, N = 3160.41162.59

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode400800120016002000SE +/- 7.80, N = 3SE +/- 3.31, N = 31791.271776.53

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode2004006008001000SE +/- 0.30, N = 3SE +/- 0.10, N = 3862.14863.35

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode30060090012001500SE +/- 1.85, N = 3SE +/- 2.51, N = 31235.411237.03

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode4080120160200SE +/- 0.43, N = 3SE +/- 0.02, N = 3182.16183.71

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode400800120016002000SE +/- 1.67, N = 3SE +/- 0.88, N = 31899.221883.66

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode306090120150SE +/- 0.09, N = 3SE +/- 0.30, N = 3137.35138.15

Zstd Compression

OpenBenchmarking.orgMB/s Per Watt, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Decompression SpeedDefaultOptimized Power Mode2468104.5166.105

OpenBenchmarking.orgMB/s Per Watt, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedDefaultOptimized Power Mode1.19682.39363.59044.78725.9843.9535.319

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Compression SpeedDefaultOptimized Power Mode70140210280350SE +/- 3.46, N = 3SE +/- 2.98, N = 5333.6272.21. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 12 - Decompression SpeedDefaultOptimized Power Mode30060090012001500SE +/- 1.98, N = 3SE +/- 1.74, N = 51422.71282.71. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression SpeedDefaultOptimized Power Mode510152025SE +/- 0.06, N = 3SE +/- 0.19, N = 319.116.21. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression SpeedDefaultOptimized Power Mode30060090012001500SE +/- 1.19, N = 3SE +/- 2.93, N = 31173.51044.61. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s Per Watt, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedDefaultOptimized Power Mode1.30192.60383.90575.20766.50954.1215.786

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression SpeedDefaultOptimized Power Mode3691215SE +/- 0.02, N = 3SE +/- 0.01, N = 39.908.561. (CC) gcc options: -O3 -pthread -lz -llzma

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression SpeedDefaultOptimized Power Mode30060090012001500SE +/- 16.60, N = 3SE +/- 2.17, N = 31183.81094.21. (CC) gcc options: -O3 -pthread -lz -llzma

QuantLib

MinAvgMaxDefault80026843904Optimized Power Mode80027353906OpenBenchmarking.orgMegahertz, More Is BetterQuantLib 1.32CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80036653905Optimized Power Mode80037833903OpenBenchmarking.orgMegahertz, More Is BetterQuantLib 1.32CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

QMCPACK

MinAvgMaxDefault80027603909Optimized Power Mode80027393907OpenBenchmarking.orgMegahertz, More Is BetterQMCPACK 3.17.1CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenFOAM

MinAvgMaxDefault80035753908Optimized Power Mode388939003908OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80030673910Optimized Power Mode280031213907OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenRadioss

MinAvgMaxDefault80029453911Optimized Power Mode80029303906OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80031383908Optimized Power Mode80031533907OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80031803905Optimized Power Mode80032403906OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80029243915Optimized Power Mode80029523907OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80029943905Optimized Power Mode80029753906OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80029933905Optimized Power Mode80030243907OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

easyWave

MinAvgMaxDefault80034693908Optimized Power Mode80034503907OpenBenchmarking.orgMegahertz, More Is BettereasyWave r34CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenBenchmarking.orgMegahertz, More Is BettereasyWave r34CPU Peak Freq (Highest CPU Core Frequency) MonitorDefaultOptimized Power Mode7001400210028003500Min: 800 / Avg: 3436.05 / Max: 3906Min: 800 / Avg: 3485.76 / Max: 3906

7-Zip Compression

MinAvgMaxDefault80029403908Optimized Power Mode80030063909OpenBenchmarking.orgMegahertz, More Is Better7-Zip Compression 22.01CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Timed GCC Compilation

OpenBenchmarking.orgMegahertz, More Is BetterTimed GCC Compilation 13.2CPU Peak Freq (Highest CPU Core Frequency) MonitorDefaultOptimized Power Mode7001400210028003500Min: 800 / Avg: 3844.27 / Max: 3932Min: 800 / Avg: 3848.62 / Max: 3914

Timed Linux Kernel Compilation

MinAvgMaxDefault80034543911Optimized Power Mode80034913908OpenBenchmarking.orgMegahertz, More Is BetterTimed Linux Kernel Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80030663911Optimized Power Mode80030663911OpenBenchmarking.orgMegahertz, More Is BetterTimed Linux Kernel Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Timed LLVM Compilation

MinAvgMaxDefault249133243908Optimized Power Mode80033183908OpenBenchmarking.orgMegahertz, More Is BetterTimed LLVM Compilation 16.0CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80037013918Optimized Power Mode80037093912OpenBenchmarking.orgMegahertz, More Is BetterTimed LLVM Compilation 16.0CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Y-Cruncher

MinAvgMaxDefault80031363912Optimized Power Mode80032353905OpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.2CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Liquid-DSP

MinAvgMaxDefault80037593905Optimized Power Mode80038603906OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80036073906Optimized Power Mode80037763906OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80036863907Optimized Power Mode80037453905OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80038433905Optimized Power Mode80038093907OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80028973906Optimized Power Mode80029313903OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80029563904Optimized Power Mode80028633903OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80028243908Optimized Power Mode80029443905OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80025893900Optimized Power Mode80029313904OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80037743908Optimized Power Mode80038413911OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80037323907Optimized Power Mode80037973906OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80029053905Optimized Power Mode80029143906OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80026103904Optimized Power Mode80027483907OpenBenchmarking.orgMegahertz, More Is BetterLiquid-DSP 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Apache Spark TPC-H

MinAvgMaxDefault80038375474Optimized Power Mode80038344663OpenBenchmarking.orgMegahertz, More Is BetterApache Spark TPC-H 3.5CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Memcached

MinAvgMaxDefault80029083906Optimized Power Mode80029253905OpenBenchmarking.orgMegahertz, More Is BetterMemcached 1.6.19CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80028913910Optimized Power Mode80029083905OpenBenchmarking.orgMegahertz, More Is BetterMemcached 1.6.19CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Redis

MinAvgMaxDefault80037063905Optimized Power Mode80037563906OpenBenchmarking.orgMegahertz, More Is BetterRedis 7.0.4CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80035543904Optimized Power Mode80036253904OpenBenchmarking.orgMegahertz, More Is BetterRedis 7.0.4CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80032493907Optimized Power Mode80033323903OpenBenchmarking.orgMegahertz, More Is BetterRedis 7.0.4CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80033493905Optimized Power Mode80032053905OpenBenchmarking.orgMegahertz, More Is BetterRedis 7.0.4CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

DuckDB

MinAvgMaxDefault80038733927Optimized Power Mode80038633920OpenBenchmarking.orgMegahertz, More Is BetterDuckDB 0.9.1CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80038773921Optimized Power Mode80038813918OpenBenchmarking.orgMegahertz, More Is BetterDuckDB 0.9.1CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

PostgreSQL

OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 16CPU Peak Freq (Highest CPU Core Frequency) MonitorDefaultOptimized Power Mode7001400210028003500Min: 800 / Avg: 3000.4 / Max: 3925Min: 800 / Avg: 2988.27 / Max: 3921

MinAvgMaxDefault80029813910Optimized Power Mode80029963906OpenBenchmarking.orgMegahertz, More Is BetterPostgreSQL 16CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Neural Magic DeepSparse

MinAvgMaxDefault80026163905Optimized Power Mode80026823914OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80030153909Optimized Power Mode80029943907OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80028353928Xeon Platinun 8592+80027613910Optimized Power Mode80028403914OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80028513905Optimized Power Mode80028713907OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80024553905Optimized Power Mode80025373904OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80031503907Optimized Power Mode80032443908OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80024443904Optimized Power Mode80024953907OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80026303909Optimized Power Mode80028793908OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80028753907Optimized Power Mode80028443907OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80029493905Optimized Power Mode80029543926OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80025933909Optimized Power Mode80026523911OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Blender

MinAvgMaxDefault80028183905Optimized Power Mode80029573909OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80027283905Optimized Power Mode80026963906OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorDefaultOptimized Power Mode7001400210028003500Min: 500 / Avg: 2658.65 / Max: 3908Min: 800 / Avg: 2769.56 / Max: 3909

OpenVINO

MinAvgMaxDefault80026013905Optimized Power Mode80028643906OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80027063904Optimized Power Mode80027923907OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80024383911Optimized Power Mode80024083907OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80024553908Optimized Power Mode80025043910OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80025283908Optimized Power Mode80025553906OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80026963904Optimized Power Mode80029533906OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80023403905Optimized Power Mode80024073907OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80024923908Optimized Power Mode80025623921OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80029423912Optimized Power Mode80029573906OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80031683907Optimized Power Mode80032583905OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Apache Hadoop

MinAvgMaxDefault80035723911Optimized Power Mode80034803907OpenBenchmarking.orgMegahertz, More Is BetterApache Hadoop 3.3.6CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

nginx

MinAvgMaxDefault80029033904Optimized Power Mode80029253905OpenBenchmarking.orgMegahertz, More Is Betternginx 1.23.2CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80028693905Optimized Power Mode80029663907OpenBenchmarking.orgMegahertz, More Is Betternginx 1.23.2CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

Apache HTTP Server

MinAvgMaxDefault80028903905Optimized Power Mode80028893907OpenBenchmarking.orgMegahertz, More Is BetterApache HTTP Server 2.4.56CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

MinAvgMaxDefault80029533906Optimized Power Mode80028633903OpenBenchmarking.orgMegahertz, More Is BetterApache HTTP Server 2.4.56CPU Peak Freq (Highest CPU Core Frequency) Monitor10002000300040005000

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedDefaultOptimized Power Mode80K160K240K320K400KSE +/- 127.57, N = 3SE +/- 52.43, N = 3388447.2391468.41. (CXX) g++ options: -O3 -march=native -fPIE -pie

OpenBenchmarking.orgMFLOPS Per Watt, More Is BetterQuantLib 1.32Configuration: Single-ThreadedDefaultOptimized Power Mode51015202518.0320.00

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Single-ThreadedDefaultOptimized Power Mode8001600240032004000SE +/- 1.44, N = 3SE +/- 2.92, N = 33650.53641.41. (CXX) g++ options: -O3 -march=native -fPIE -pie

7-Zip Compression

OpenBenchmarking.orgMIPS Per Watt, More Is Better7-Zip Compression 22.01Test: Decompression RatingDefaultOptimized Power Mode20040060080010001062.101145.35

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingDefaultOptimized Power Mode150K300K450K600K750KSE +/- 869.44, N = 3SE +/- 1440.87, N = 36895166544591. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingDefaultOptimized Power Mode140K280K420K560K700KSE +/- 4040.78, N = 3SE +/- 9574.07, N = 36373116381361. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Apache Hadoop

This is a benchmark of the Apache Hadoop making use of its built-in name-node throughput benchmark (NNThroughputBenchmark). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOps per sec, More Is BetterApache Hadoop 3.3.6Operation: Create - Threads: 100 - Files: 100000DefaultOptimized Power Mode12002400360048006000SE +/- 32.35, N = 3SE +/- 62.35, N = 354904814

Memcached

OpenBenchmarking.orgOps/sec Per Watt, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100DefaultOptimized Power Mode150030004500600075006692.766801.69

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:10DefaultOptimized Power Mode700K1400K2100K2800K3500KSE +/- 29533.59, N = 15SE +/- 43551.88, N = 153360511.122180648.211. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

OpenBenchmarking.orgOps/sec, More Is BetterMemcached 1.6.19Set To Get Ratio: 1:100DefaultOptimized Power Mode700K1400K2100K2800K3500KSE +/- 25091.90, N = 3SE +/- 42725.42, N = 33441439.713274425.321. (CXX) g++ options: -O2 -levent_openssl -levent -lcrypto -lssl -lpthread -lz -lpcre

Redis

OpenBenchmarking.orgRequests Per Second Per Watt, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 50DefaultOptimized Power Mode4K8K12K16K20K18984.6120690.41

OpenBenchmarking.orgRequests Per Second Per Watt, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 50DefaultOptimized Power Mode4K8K12K16K20K11959.0716432.18

OpenBenchmarking.orgRequests Per Second Per Watt, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500DefaultOptimized Power Mode2K4K6K8K10K9025.1710408.05

OpenBenchmarking.orgRequests Per Second Per Watt, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500DefaultOptimized Power Mode140028004200560070006160.266737.20

nginx

OpenBenchmarking.orgRequests Per Second Per Watt, More Is Betternginx 1.23.2Connections: 500DefaultOptimized Power Mode100200300400500449.51429.69

OpenBenchmarking.orgRequests Per Second Per Watt, More Is Betternginx 1.23.2Connections: 1000DefaultOptimized Power Mode90180270360450389.82395.64

Apache HTTP Server

OpenBenchmarking.orgRequests Per Second Per Watt, More Is BetterApache HTTP Server 2.4.56Concurrent Requests: 500DefaultOptimized Power Mode60120180240300216.64266.08

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 50DefaultOptimized Power Mode1000K2000K3000K4000K5000KSE +/- 8167.04, N = 4SE +/- 1281.58, N = 34744838.903811819.501. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

Apache HTTP Server

OpenBenchmarking.orgRequests Per Second Per Watt, More Is BetterApache HTTP Server 2.4.56Concurrent Requests: 1000DefaultOptimized Power Mode60120180240300208.91262.58

Redis

Redis is an open-source in-memory data structure store, used as a database, cache, and message broker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 50DefaultOptimized Power Mode700K1400K2100K2800K3500KSE +/- 12726.60, N = 3SE +/- 1584.15, N = 33060186.423050498.001. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: GET - Parallel Connections: 500DefaultOptimized Power Mode700K1400K2100K2800K3500KSE +/- 482.98, N = 3SE +/- 36270.68, N = 33240001.583152359.751. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

OpenBenchmarking.orgRequests Per Second, More Is BetterRedis 7.0.4Test: SET - Parallel Connections: 500DefaultOptimized Power Mode500K1000K1500K2000K2500KSE +/- 7546.74, N = 3SE +/- 19286.75, N = 152503177.672389636.671. (CXX) g++ options: -MM -MT -g3 -fvisibility=hidden -O3

nginx

This is a benchmark of the lightweight Nginx HTTP(S) web-server. This Nginx web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients/connections. HTTPS with a self-signed OpenSSL certificate is used by this test for local benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500DefaultOptimized Power Mode60K120K180K240K300KSE +/- 25.30, N = 3SE +/- 10.52, N = 3273684.71202507.421. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 1000DefaultOptimized Power Mode50K100K150K200K250KSE +/- 397.04, N = 3SE +/- 72.63, N = 2243384.19184861.991. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Apache HTTP Server

This is a test of the Apache HTTPD web server. This Apache HTTPD web server benchmark test profile makes use of the wrk program for facilitating the HTTP requests over a fixed period time with a configurable number of concurrent clients. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.56Concurrent Requests: 500DefaultOptimized Power Mode20K40K60K80K100KSE +/- 265.12, N = 3SE +/- 184.86, N = 390823.0680817.731. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenBenchmarking.orgRequests Per Second, More Is BetterApache HTTP Server 2.4.56Concurrent Requests: 1000DefaultOptimized Power Mode20K40K60K80K100K80826.7176315.651. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

Liquid-DSP

LiquidSDR's Liquid-DSP is a software-defined radio (SDR) digital signal processing library. This test profile runs a multi-threaded benchmark of this SDR/DSP library focused on embedded platform usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 32DefaultOptimized Power Mode300M600M900M1200M1500MSE +/- 1273228.62, N = 3SE +/- 1193035.34, N = 3121176666712045000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 57DefaultOptimized Power Mode300M600M900M1200M1500MSE +/- 9950041.88, N = 3SE +/- 16392511.84, N = 3142910000012933333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 32DefaultOptimized Power Mode1300M2600M3900M5200M6500MSE +/- 7150058.27, N = 3SE +/- 61606333.10, N = 6618560000063014833331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 57DefaultOptimized Power Mode1200M2400M3600M4800M6000MSE +/- 11767044.38, N = 3SE +/- 19835069.95, N = 3583550000056566000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 32 - Buffer Length: 256 - Filter Length: 512DefaultOptimized Power Mode110M220M330M440M550MSE +/- 5123258.57, N = 6SE +/- 3588947.54, N = 35082450004914266671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 512DefaultOptimized Power Mode200M400M600M800M1000MSE +/- 10474795.68, N = 3SE +/- 5205466.14, N = 310123366679996633331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32DefaultOptimized Power Mode1.1M2.2M3.3M4.4M5.5M4283633.395140098.56

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 32DefaultOptimized Power Mode500M1000M1500M2000M2500MSE +/- 6835284.27, N = 3SE +/- 13974301.81, N = 3247603333324608666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 32DefaultOptimized Power Mode800M1600M2400M3200M4000MSE +/- 1386041.53, N = 3SE +/- 3883440.63, N = 3361186666737452333331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 57DefaultOptimized Power Mode900M1800M2700M3600M4500MSE +/- 11478143.48, N = 3SE +/- 34188302.09, N = 3432986666741250000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s Per Watt, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57DefaultOptimized Power Mode1000K2000K3000K4000K5000K4449269.384774859.27

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 128 - Buffer Length: 256 - Filter Length: 512DefaultOptimized Power Mode300M600M900M1200M1500MSE +/- 4762352.36, N = 3SE +/- 13505101.92, N = 3147390000015134666671. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 256 - Buffer Length: 256 - Filter Length: 512DefaultOptimized Power Mode500M1000M1500M2000M2500MSE +/- 2968913.01, N = 3SE +/- 1101514.11, N = 3214456666721410000001. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

OpenBenchmarking.orgsamples/s, More Is BetterLiquid-DSP 1.6Threads: 64 - Buffer Length: 256 - Filter Length: 57DefaultOptimized Power Mode600M1200M1800M2400M3000MSE +/- 24169149.30, N = 3SE +/- 20734086.19, N = 15281016666725565733331. (CC) gcc options: -O3 -pthread -lm -lc -lliquid

PostgreSQL

This is a benchmark of PostgreSQL using the integrated pgbench for facilitating the database benchmarks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read OnlyDefaultOptimized Power Mode200K400K600K800K1000KSE +/- 17460.42, N = 10SE +/- 11877.48, N = 128930898784681. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read WriteDefaultOptimized Power Mode14K28K42K56K70KSE +/- 70.87, N = 3SE +/- 214.64, N = 363962596951. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average LatencyDefaultOptimized Power Mode0.25670.51340.77011.02681.2835SE +/- 0.022, N = 10SE +/- 0.016, N = 121.1241.1411. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 16Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average LatencyDefaultOptimized Power Mode48121620SE +/- 0.02, N = 3SE +/- 0.06, N = 315.6316.751. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUDefaultOptimized Power Mode1020304050SE +/- 0.04, N = 3SE +/- 0.05, N = 342.7242.59MIN: 31.92 / MAX: 84.1MIN: 32.12 / MAX: 128.961. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUDefaultOptimized Power Mode50100150200250SE +/- 0.35, N = 3SE +/- 0.55, N = 3236.70237.36MIN: 157.14 / MAX: 268.19MIN: 160.6 / MAX: 286.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUDefaultOptimized Power Mode48121620SE +/- 0.01, N = 3SE +/- 0.01, N = 314.3214.30MIN: 12.39 / MAX: 39.16MIN: 12.18 / MAX: 47.31. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUDefaultOptimized Power Mode1.15882.31763.47644.63525.794SE +/- 0.01, N = 3SE +/- 0.00, N = 35.155.13MIN: 4.63 / MAX: 27.9MIN: 4.64 / MAX: 29.561. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUDefaultOptimized Power Mode1224364860SE +/- 0.08, N = 3SE +/- 0.16, N = 353.5153.45MIN: 43.94 / MAX: 101.68MIN: 45.01 / MAX: 111.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUDefaultOptimized Power Mode714212835SE +/- 0.23, N = 3SE +/- 0.08, N = 328.8528.99MIN: 21.11 / MAX: 222.12MIN: 22.06 / MAX: 222.831. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUDefaultOptimized Power Mode0.55131.10261.65392.20522.7565SE +/- 0.01, N = 3SE +/- 0.00, N = 32.452.42MIN: 2.03 / MAX: 23.83MIN: 1.96 / MAX: 28.31. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUDefaultOptimized Power Mode3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 312.5112.55MIN: 10.84 / MAX: 42.36MIN: 10.77 / MAX: 42.911. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUDefaultOptimized Power Mode918273645SE +/- 0.08, N = 3SE +/- 0.08, N = 338.4138.79MIN: 35.95 / MAX: 58.71MIN: 36.26 / MAX: 60.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUDefaultOptimized Power Mode0.09230.18460.27690.36920.4615SE +/- 0.00, N = 3SE +/- 0.01, N = 30.400.41MIN: 0.18 / MAX: 14.47MIN: 0.19 / MAX: 15.841. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode100200300400500SE +/- 0.27, N = 3SE +/- 0.42, N = 3463.09461.15

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode48121620SE +/- 0.02, N = 3SE +/- 0.01, N = 313.9513.91

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode816243240SE +/- 0.08, N = 3SE +/- 0.14, N = 335.9336.13

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode1.33622.67244.00865.34486.681SE +/- 0.0033, N = 3SE +/- 0.0065, N = 35.67325.9385

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode20406080100SE +/- 0.04, N = 3SE +/- 0.04, N = 376.5476.50

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode90180270360450SE +/- 3.53, N = 3SE +/- 0.71, N = 3397.77392.45

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode816243240SE +/- 0.16, N = 3SE +/- 0.07, N = 335.6735.96

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode1632486480SE +/- 0.05, N = 3SE +/- 0.03, N = 374.0773.99

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode1224364860SE +/- 0.05, N = 3SE +/- 0.07, N = 351.7051.62

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode80160240320400SE +/- 0.69, N = 3SE +/- 0.05, N = 3350.90346.74

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode816243240SE +/- 0.03, N = 3SE +/- 0.01, N = 333.6433.90

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamDefaultOptimized Power Mode100200300400500SE +/- 0.03, N = 3SE +/- 0.70, N = 3462.99460.69

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: motorBike - Execution TimeDefaultOptimized Power Mode1.23952.4793.71854.9586.19754.132885.508971. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeDefaultOptimized Power Mode71421283530.0427.711. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeDefaultOptimized Power Mode61218243023.4723.351. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper BeamDefaultOptimized Power Mode20406080100SE +/- 0.18, N = 3SE +/- 0.13, N = 384.7882.73

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MDefaultOptimized Power Mode20406080100SE +/- 0.14, N = 3SE +/- 0.17, N = 385.8286.30

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestDefaultOptimized Power Mode612182430SE +/- 0.14, N = 3SE +/- 0.12, N = 325.7425.37

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on WindshieldDefaultOptimized Power Mode306090120150SE +/- 0.65, N = 3SE +/- 0.28, N = 3111.23111.73

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal InstallationDefaultOptimized Power Mode20406080100SE +/- 0.03, N = 3SE +/- 0.13, N = 381.6989.37

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerDefaultOptimized Power Mode20406080100SE +/- 0.07, N = 3SE +/- 0.08, N = 397.8798.49

easyWave

The easyWave software allows simulating tsunami generation and propagation in the context of early warning systems. EasyWave supports making use of OpenMP for CPU multi-threading and there are also GPU ports available but not currently incorporated as part of this test profile. The easyWave tsunami generation software is run with one of the example/reference input files for measuring the CPU execution time. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 1200DefaultOptimized Power Mode1020304050SE +/- 0.28, N = 3SE +/- 0.41, N = 1536.5542.561. (CXX) g++ options: -O3 -fopenmp

OpenBenchmarking.orgSeconds, Fewer Is BettereasyWave r34Input: e2Asean Grid + BengkuluSept2007 Source - Time: 2400DefaultOptimized Power Mode20406080100SE +/- 1.41, N = 15SE +/- 1.07, N = 389.98102.931. (CXX) g++ options: -O3 -fopenmp

Timed GCC Compilation

This test times how long it takes to build the GNU Compiler Collection (GCC) open-source compiler. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed GCC Compilation 13.2Time To CompileDefaultOptimized Power Mode160320480640800SE +/- 2.37, N = 3SE +/- 4.73, N = 3706.26759.22

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigDefaultOptimized Power Mode612182430SE +/- 0.21, N = 8SE +/- 0.18, N = 1123.7624.48

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigDefaultOptimized Power Mode306090120150SE +/- 0.51, N = 3SE +/- 0.48, N = 3149.79151.28

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaDefaultOptimized Power Mode20406080100SE +/- 0.29, N = 3SE +/- 0.20, N = 396.5298.91

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix MakefilesDefaultOptimized Power Mode4080120160200SE +/- 0.30, N = 3SE +/- 0.58, N = 3177.43187.84

Y-Cruncher

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.2Pi Digits To Calculate: 1BDefaultOptimized Power Mode1.16982.33963.50944.67925.849SE +/- 0.018, N = 5SE +/- 0.009, N = 55.1994.697

Apache Spark TPC-H

This is a benchmark of Apache Spark using TPC-H data-set. Apache Spark is an open-source unified analytics engine for large-scale data processing and dealing with big data. This test profile benchmarks the Apache Spark in a single-system configuration using spark-submit. The test makes use of https://github.com/ssavvides/tpch-spark/ for facilitating the TPC-H benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterApache Spark TPC-H 3.5Scale Factor: 10 - Geometric Mean Of All QueriesDefaultOptimized Power Mode3691215SE +/- 0.07178690, N = 3SE +/- 0.09145601, N = 78.359196839.77304127MIN: 4.15 / MAX: 27.27MIN: 4.46 / MAX: 32.81

DuckDB

DuckDB is an in-progress SQL OLAP database management system optimized for analytics and features a vectorized and parallel engine. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterDuckDB 0.9.1Benchmark: IMDBDefaultOptimized Power Mode306090120150SE +/- 0.49, N = 3SE +/- 0.43, N = 3121.97139.331. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl

OpenBenchmarking.orgSeconds, Fewer Is BetterDuckDB 0.9.1Benchmark: TPC-H ParquetDefaultOptimized Power Mode306090120150SE +/- 0.31, N = 3SE +/- 0.38, N = 3148.55157.101. (CXX) g++ options: -O3 -rdynamic -lssl -lcrypto -ldl

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyDefaultOptimized Power Mode3691215SE +/- 0.03, N = 4SE +/- 0.04, N = 412.8912.67

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyDefaultOptimized Power Mode816243240SE +/- 0.33, N = 3SE +/- 0.07, N = 334.9433.40

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyDefaultOptimized Power Mode306090120150SE +/- 6.68, N = 9SE +/- 0.11, N = 3149.49129.94

QMCPACK

QMCPACK is a modern high-performance open-source Quantum Monte Carlo (QMC) simulation code making use of MPI for this benchmark of the H20 example code. QMCPACK is an open-source production level many-body ab initio Quantum Monte Carlo code for computing the electronic structure of atoms, molecules, and solids. QMCPACK is supported by the U.S. Department of Energy. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTotal Execution Time - Seconds, Fewer Is BetterQMCPACK 3.17.1Input: Li2_STO_aeDefaultOptimized Power Mode20406080100SE +/- 0.40, N = 3SE +/- 1.02, N = 594.3892.671. (CXX) g++ options: -fopenmp -foffload=disable -finline-limit=1000 -fstrict-aliasing -funroll-all-loops -ffast-math -march=native -O3 -lm -ldl

289 Results Shown

CPU Peak Freq (Highest CPU Core Frequency) Monitor:
  Phoronix Test Suite System Monitoring:
    Megahertz
    Watts
  CPU - 64 - ResNet-50:
    batches/sec Per Watt
  CPU - 256 - ResNet-50:
    batches/sec Per Watt
  CPU - 64 - ResNet-152:
    batches/sec Per Watt
PyTorch:
  CPU - 64 - ResNet-50
  CPU - 256 - ResNet-50
  CPU - 64 - ResNet-152
  CPU - 256 - ResNet-152
  CPU - 64 - Efficientnet_v2_l
  CPU - 256 - Efficientnet_v2_l
FFmpeg
FFmpeg:
  libx265 - Live
  libx265 - Upload
  libx265 - Platform
  libx265 - Video On Demand
OpenVINO:
  Person Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
  Machine Translation EN To DE FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Kvazaar:
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
  Bosphorus 4K - Ultra Fast
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Ultra Fast
  Preset 4 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 13 - Bosphorus 4K
  Preset 4 - Bosphorus 1080p
  Preset 8 - Bosphorus 1080p
  Preset 12 - Bosphorus 1080p
  Preset 13 - Bosphorus 1080p
  VMAF Optimized - Bosphorus 1080p
  PSNR/SSIM Optimized - Bosphorus 1080p
  Visual Quality Optimized - Bosphorus 1080p
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
Kvazaar:
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Super Fast
  Bosphorus 4K - Ultra Fast
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Super Fast
uvg266:
  Bosphorus 4K - Ultra Fast
  Bosphorus 1080p - Super Fast
SVT-AV1:
  Preset 13 - Bosphorus 4K
  Preset 4 - Bosphorus 1080p
  Preset 8 - Bosphorus 1080p
  Preset 12 - Bosphorus 1080p
  Preset 13 - Bosphorus 1080p
SVT-VP9
uvg266:
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Ultra Fast
  Bosphorus 4K - Fast
  Bosphorus 4K - Faster
  Bosphorus 1080p - Fast
SVT-VP9
uvg266
VVenC
VVenC
Kvazaar
SVT-AV1:
  Preset 4 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
SVT-VP9
uvg266:
  Bosphorus 4K - Slow
  Bosphorus 4K - Medium
  Bosphorus 1080p - Slow
  Bosphorus 1080p - Medium
  Bosphorus 4K - Very Fast
  Bosphorus 4K - Ultra Fast
  Bosphorus 1080p - Very Fast
  Bosphorus 1080p - Super Fast
  Bosphorus 1080p - Ultra Fast
VVenC:
  Bosphorus 4K - Faster
  Bosphorus 1080p - Fast
  Bosphorus 1080p - Faster
Xmrig:
  KawPow - 1M
  Wownero - 1M
  GhostRider - 1M
  Monero - 1M
Xmrig:
  CryptoNight-Heavy - 1M
  CryptoNight-Femto UPX2 - 1M
Xmrig:
  CryptoNight-Heavy - 1M
  CryptoNight-Femto UPX2 - 1M
Intel Open Image Denoise
Intel Open Image Denoise
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream
  ResNet-50, Baseline - Asynchronous Multi-Stream
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
Zstd Compression:
  12 - Decompression Speed
  19 - Decompression Speed
Zstd Compression:
  12 - Compression Speed
  12 - Decompression Speed
  19 - Compression Speed
  19 - Decompression Speed
Zstd Compression
Zstd Compression:
  19, Long Mode - Compression Speed
  19, Long Mode - Decompression Speed
QuantLib:
  CPU Peak Freq (Highest CPU Core Frequency) Monitor:
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
QuantLib
QuantLib
QuantLib
7-Zip Compression
7-Zip Compression:
  Compression Rating
  Decompression Rating
Apache Hadoop
Memcached
Memcached:
  1:10
  1:100
Redis:
  GET - 50
  SET - 50
  GET - 500
  SET - 500
  500
  1000
  500
Redis
Apache HTTP Server
Redis:
  SET - 50
  GET - 500
  SET - 500
nginx:
  500
  1000
Apache HTTP Server:
  500
  1000
Liquid-DSP:
  32 - 256 - 32
  32 - 256 - 57
  256 - 256 - 32
  256 - 256 - 57
  32 - 256 - 512
  64 - 256 - 512
Liquid-DSP
Liquid-DSP:
  64 - 256 - 32
  128 - 256 - 32
  128 - 256 - 57
Liquid-DSP
Liquid-DSP:
  128 - 256 - 512
  256 - 256 - 512
  64 - 256 - 57
PostgreSQL:
  100 - 1000 - Read Only
  100 - 1000 - Read Write
  100 - 1000 - Read Only - Average Latency
  100 - 1000 - Read Write - Average Latency
OpenVINO:
  Person Detection FP16 - CPU
  Face Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
  Machine Translation EN To DE FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
Neural Magic DeepSparse:
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream
  ResNet-50, Baseline - Asynchronous Multi-Stream
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
OpenFOAM:
  motorBike - Execution Time
  drivaerFastback, Small Mesh Size - Mesh Time
  drivaerFastback, Small Mesh Size - Execution Time
OpenRadioss:
  Bumper Beam
  Chrysler Neon 1M
  Cell Phone Drop Test
  Bird Strike on Windshield
  Rubber O-Ring Seal Installation
  INIVOL and Fluid Structure Interaction Drop Container
easyWave:
  e2Asean Grid + BengkuluSept2007 Source - 1200
  e2Asean Grid + BengkuluSept2007 Source - 2400
Timed GCC Compilation
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed LLVM Compilation:
  Ninja
  Unix Makefiles
Y-Cruncher
Apache Spark TPC-H
DuckDB:
  IMDB
  TPC-H Parquet
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Barbershop - CPU-Only
QMCPACK