AMD P-State Linux 6.3 Testing

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2302279-NE-AMDPSTATE10&rdt&grr.

AMD P-State Linux 6.3 TestingProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen Resolutionamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2 x AMD EPYC 7773X 64-Core @ 3.53GHz (128 Cores / 256 Threads)AMD DAYTONA_X (RYM1009B BIOS)AMD Starship/Matisse512GB800GB INTEL SSDPF21Q800GBASPEEDVE2282 x Mellanox MT27710Ubuntu 22.046.2.0-phx (x86_64)GNOME Shell 42.5X Server 1.21.1.31.3.224GCC 11.3.0 + LLVM 14.0.0ext41920x10802 x AMD EPYC 7773X 64-Core @ 2.20GHz (128 Cores / 256 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- amd_pstate_epp powersave balance_performance: Scaling Governor: amd_pstate_epp powersave (EPP: balance_performance) - CPU Microcode: 0xa001229- amd_pstate_epp performance balance_performance: Scaling Governor: amd_pstate_epp performance (EPP: performance) - CPU Microcode: 0xa001229- amd_pstate_epp powersave power: Scaling Governor: amd_pstate_epp powersave (EPP: power) - CPU Microcode: 0xa001229- amd_pstate_epp performance performance: Scaling Governor: amd_pstate_epp performance (EPP: performance) - CPU Microcode: 0xa001229- amd_pstate schedutil: Scaling Governor: amd-pstate schedutil (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate performance: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate powersave: Scaling Governor: amd-pstate powersave (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate ondemand: Scaling Governor: amd-pstate ondemand (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq schedutil: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq ondemand: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq performance: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001229Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD P-State Linux 6.3 Testingtensorflow: CPU - 256 - GoogLeNetopenvkl: vklBenchmark Scalaropenvkl: vklBenchmark ISPCtensorflow: CPU - 256 - AlexNetbrl-cad: VGR Performance Metricpgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 500 - Read Writeclickhouse: 100M Rows Hits Dataset, Third Runclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, First Run / Cold Cachepgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 800 - Read Writecockroach: KV, 95% Reads - 512pgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 500 - Read Onlyincompact3d: X3D-benchmarking input.i3dbuild-gem5: Time To Compilevpxenc: Speed 5 - Bosphorus 4Kbuild-linux-kernel: allmodconfigvvenc: Bosphorus 4K - Fastpgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 800 - Read Onlystargate: 192000 - 1024pgbench: 100 - 1000 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writeopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUpgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlyblender: Barbershop - CPU-Onlycockroach: KV, 10% Reads - 512build-nodejs: Time To Compileospray-studio: 3 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 32 - Path Traceropenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUvvenc: Bosphorus 4K - Fasterbuild-linux-kernel: defconfigopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timecockroach: MoVR - 512nginx: 500openvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamcompress-zstd: 19, Long Mode - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speeddeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamcompress-7zip: Decompression Ratingcompress-7zip: Compression Ratingdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamcompress-zstd: 19 - Decompression Speedcompress-zstd: 19 - Compression Speeddeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUbuild-godot: Time To Compilesvt-av1: Preset 4 - Bosphorus 4Kblender: Pabellon Barcelona - CPU-Onlygromacs: MPI CPU - water_GMX50_bareopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUblender: Classroom - CPU-Onlyphpbench: PHP Benchmark Suitesvt-av1: Preset 12 - Bosphorus 4Kdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamx265: Bosphorus 4Kpybench: Total For Average Test Timesuvg266: Bosphorus 4K - Mediumembree: Pathtracer ISPC - Asian Dragonkvazaar: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastkvazaar: Bosphorus 4K - Mediumuvg266: Bosphorus 4K - Super Fastblender: Fishy Cat - CPU-Onlynamd: ATPase Simulation - 327,506 Atomssvt-av1: Preset 13 - Bosphorus 4Kembree: Pathtracer ISPC - Crownamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance38.4136451487.75285398317.37228873372.98373.47355.1232.9612427575876.40.3901288550264.910481157.10211.63176.4953.3590.64112482662.05925945.509219783.5135205.470.8281207540141.7944725.5111.94941798130411013543817.493654.516.32625.521167.409116.05227641.8146738.1617.103738.04239.05267.15205.6828310.2961195.08.9168.9182926.20284030.0315.52587.7380108.1971716703500471869.215072.84511278.316.0868.075673.0239207.6114307.03851195.3553.0941.8983.45345.9911.07924.175291.4537.94687682175.455104.5730610.7001158.1292403.29176.9866830.096718.56100324.2892.206450.6747.9741.1329.4239.9619.170.22286170.265122.501440.1937451697.12290518114.63835610406.99409.86395.5329.8232683086214.80.3831306099264.590464149.76713.37172.8844.0220.64412417262.34807941.177242993.4535601.830.8271209033140.1850217.2105.52941650129911033557317.413670.787.39722.623170.71478114.86885761.0147764.2517.063748.17239.29266.96205.4179310.43301203.69.2868.7056929.78944015.9115.54587.8421108.1954726521522348868.871972.94971278.617.6867.927572.9379207.4377307.64201195.6053.0737.3214.15845.7211.17924.165294.9737.68697478186.048104.7553609.6137157.5501404.953476.9790830.013120.5599827.0194.784156.1454.6947.2531.9946.2618.800.22270194.103123.145831.6434647765.63286395117.48628682353.17349.30339.6833.1292417374380.00.3871292798263.300232173.2017.95184.4702.4710.64212459141.80123846.474215223.3236975.340.8151226429143.0443287.2120.48341532130311023524317.533645.604.76930.833169.24992116.28282570.5145614.7617.143730.66238.16268.24205.6999309.37881186.08.7268.5591931.60054033.6315.50587.7795108.1498661420459617868.924672.79521269.815.2867.019973.0501207.3328307.71291199.8752.9147.9352.44346.7311.13124.245277.0238.35671207155.770104.6604609.8987158.0751403.586077.0202829.603515.33100817.3393.727941.8345.5633.7620.6633.7919.740.22450145.323121.297040.3938551296.73298071915.52932286394.98407.73392.9529.0002759686477.30.3891286042264.824544148.50312.83172.8574.0230.64512404062.34644738.341260853.3836507.110.8151226743140.3649015.5105.82541686130211013521017.373679.317.35222.530167.81864116.19384763.4152654.8617.073744.85239.70266.56205.3031310.74481203.39.2668.5813931.58214005.0315.55587.6097108.1144733882514443868.261673.05611276.217.5866.981873.1372207.1853307.89201203.5252.7937.0114.18145.7511.07424.175291.0037.57700287173.314104.6233610.3155157.7002404.546476.9051830.324120.63101027.0693.501255.8554.7746.0832.3046.3118.950.22021188.423122.872926.6332746836.50283650427.74419298251.84254.40252.7966.3871239772179.60.796636088267.536092156.9453.06182.7683.1361.1467049290.81141881.192126133.5533751.581.411714980147.4641485.5113.13143705137611663697632.422062.046.23025.392182.43689127.85527195.9138510.0046.491416.77240.82265.31212.6277299.56801191.59.2071.1617897.63754262.2914.63605.6728104.8933699228394982895.127270.74991261.817.1893.428271.0074214.4729297.13871260.4950.3541.9403.32248.498.48225.435029.0540.0471112590.277108.6614587.4762164.2008388.639278.8686809.904816.3698712.2588.802226.5426.2121.6514.3925.4320.260.2342072.221116.753040.8937453497.50281535615.25732858406.41404.95394.3228.7152788082071.40.3811311837265.312622146.64413.32173.6364.0210.63012686882.36307040.155249043.3936428.760.8121230841140.3549340.4104.93441588130010983518617.373678.917.30622.519168.799116.10875766.8151325.0117.053749.69239.02267.30205.4057310.30041171.29.3168.6499930.49324030.7915.52586.8584108.4041746376530689867.899372.90791188.117.6866.959573.2692207.6741307.26691195.2353.0337.0534.18445.7711.05324.175292.0837.73701215182.358104.7278609.9637157.7992404.295076.9068830.851920.74101026.8993.605055.2753.7745.4632.0045.4118.890.22464191.046123.02488.747210216.5440561475.984668676.6675.8666.81146.572546516811.81.571318480540.5448811100.3631.861094.3740.5682.5223173600.301450201.101497324.555175.963.203312245933.4111461.4752.9863329506854867000291743315.26202.831.157156.783773.03283773.96684126.827774.70107.17596.041229.8651.521124.304656.6582140.11.06295.4918215.516724236.972.543485.212918.20481042871009704864.702812.9683146.11.974868.105713.00281143.055555.22457565.218.38258.8730.558297.672.167153.78830.31254.467957036.647577.7688109.7693884.291370.8684431.9597147.68804.3787753.9724.79177.727.436.884.836.77124.481.4098232.26519.668537.0336351475.69286374216.43632486310.66306.46297.7741.9881905675334.70.4901037703262.403117153.9038.47177.0633.6760.8159977421.35854955.954178753.4035501.211.069955977141.9145780.3109.81341897132211183544035.391915.376.64624.520167.90491119.63471574.8122126.5636.351960.30228.75279.33206.1379309.59581178.09.1368.5979931.20324103.6415.24589.6910107.4707739016485387876.496172.51951280.517.2876.332172.4101208.0910306.39941210.7652.4840.8123.86546.199.55024.485224.8337.85705341171.877105.1513607.3304158.9464401.731376.5661834.463819.29100424.5892.800452.6052.1741.9030.3241.5719.180.22289161.778121.857639.2437653179.36302117117.90928016352.85362.27351.2133.7232374379962.20.3891291471263.625285149.22214.36172.6063.7670.63612580662.34611244.364225673.4136248.380.8081237871140.5547827.0106.46642130130611033550517.443663.487.34722.610166.47566116.43538438.2146083.1617.093741.06239.94266.14205.4931310.09401203.29.2968.5451932.00274054.3015.41587.7789108.1330748549475861868.815773.10261270.917.4866.622373.0290207.2711307.71651195.7653.0637.5764.01345.9511.17324.175292.4237.61698785167.611104.7469609.7624157.8251404.273077.0980828.896620.6799921.2193.761552.9352.3240.8222.9740.7118.900.22025144.342122.705540.0035752494.62281426917.19429347357.94357.63351.3934.0592349381782.30.4451124224264.797139152.99010.72174.9463.9740.74510745002.32677044.891222793.4435666.690.9241082794141.9849459.9107.14342264132211203562817.653621.587.37323.440168.99869120.10383698.0149876.5217.333689.97241.17264.82206.4473308.67651203.29.2168.7068929.79104041.3115.44588.6134107.8991740039507039872.891272.77291264.717.5872.065072.7821207.8753306.68221203.4252.7638.3654.09045.9210.85324.365250.1537.92708218180.332105.0236608.3023158.0475403.280677.0107829.174519.90100627.2092.953755.5854.7844.5032.3645.1919.000.22290180.343120.799840.4236752495.71292157215.18333019401.81410.46393.1529.5372709386045.20.3891285905263.627543147.00214.17173.6344.0500.64812348692.36707439.602252523.7232979.740.8321202637140.4549731.9105.54141859130611043540617.483655.417.32022.652164.04046115.75608765.2147285.7817.093741.35238.32268.04205.2817310.61451209.19.1268.7650928.53814032.1015.49587.3828108.1608742955528289869.187273.15921272.817.5867.829673.2510207.5798307.16581195.1453.1237.3844.18245.8511.12524.175291.8137.71699816180.860104.8041609.0422157.8814404.130477.0588828.816120.96100226.9391.372455.9255.0346.4532.0946.0719.010.22441189.131123.0519OpenBenchmarking.org

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance918273645SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 338.4140.1931.6440.3926.6340.898.7437.0339.2440.0040.42

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark Scalaramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance80160240320400SE +/- 6.08, N = 6SE +/- 3.82, N = 5SE +/- 2.19, N = 3SE +/- 1.20, N = 3SE +/- 2.31, N = 3SE +/- 3.95, N = 9SE +/- 0.33, N = 3SE +/- 3.76, N = 3SE +/- 4.33, N = 3SE +/- 1.76, N = 3SE +/- 4.13, N = 936437434638532737472363376357367MIN: 71 / MAX: 1707MIN: 75 / MAX: 1552MIN: 62 / MAX: 1800MIN: 75 / MAX: 1589MIN: 72 / MAX: 1129MIN: 74 / MAX: 1559MIN: 11 / MAX: 516MIN: 73 / MAX: 1686MIN: 75 / MAX: 1829MIN: 75 / MAX: 1532MIN: 73 / MAX: 1729

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance120240360480600SE +/- 4.72, N = 7SE +/- 1.76, N = 3SE +/- 2.08, N = 3SE +/- 4.37, N = 3SE +/- 5.51, N = 3SE +/- 6.51, N = 4SE +/- 1.20, N = 3SE +/- 3.61, N = 3SE +/- 6.96, N = 3SE +/- 4.59, N = 8SE +/- 1.76, N = 3514516477512468534102514531524524MIN: 148 / MAX: 1583MIN: 150 / MAX: 1507MIN: 107 / MAX: 1723MIN: 151 / MAX: 1504MIN: 146 / MAX: 1159MIN: 153 / MAX: 1522MIN: 24 / MAX: 400MIN: 149 / MAX: 1600MIN: 153 / MAX: 1787MIN: 148 / MAX: 1602MIN: 149 / MAX: 1516

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.63, N = 6SE +/- 0.28, N = 3SE +/- 0.31, N = 3SE +/- 0.36, N = 3SE +/- 0.01, N = 3SE +/- 0.66, N = 3SE +/- 1.99, N = 9SE +/- 0.82, N = 9SE +/- 0.99, N = 387.7597.1265.6396.7336.5097.5016.5475.6979.3694.6295.71

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance Metricamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance600K1200K1800K2400K3000K28539832905181286395129807192836504281535640561428637423021171281426929215721. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.28, N = 12SE +/- 0.71, N = 12SE +/- 0.28, N = 12SE +/- 0.24, N = 12SE +/- 2.25, N = 12SE +/- 0.22, N = 12SE +/- 2.49, N = 12SE +/- 1.31, N = 12SE +/- 0.30, N = 12SE +/- 0.46, N = 12SE +/- 0.23, N = 1217.3714.6417.4915.5327.7415.2675.9816.4417.9117.1915.181. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Writeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance8K16K24K32K40KSE +/- 508.85, N = 12SE +/- 2742.94, N = 12SE +/- 497.87, N = 12SE +/- 524.88, N = 12SE +/- 1491.09, N = 12SE +/- 539.21, N = 12SE +/- 295.83, N = 12SE +/- 2388.98, N = 12SE +/- 523.79, N = 12SE +/- 904.79, N = 12SE +/- 531.49, N = 122887335610286823228619298328586686324862801629347330191. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Runamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 3.70, N = 3SE +/- 1.36, N = 3SE +/- 2.43, N = 3SE +/- 3.27, N = 3SE +/- 2.60, N = 3SE +/- 2.49, N = 3SE +/- 0.60, N = 3SE +/- 0.84, N = 3SE +/- 1.95, N = 3SE +/- 2.12, N = 3SE +/- 1.10, N = 3372.98406.99353.17394.98251.84406.4176.66310.66352.85357.94401.81MIN: 54.1 / MAX: 4285.71MIN: 53.29 / MAX: 3333.33MIN: 44.91 / MAX: 3000MIN: 57.97 / MAX: 3529.41MIN: 48.15 / MAX: 3157.89MIN: 52.77 / MAX: 3529.41MIN: 8.52 / MAX: 588.24MIN: 51.28 / MAX: 2222.22MIN: 50.59 / MAX: 3529.41MIN: 56.71 / MAX: 2857.14MIN: 56.71 / MAX: 3333.33

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Runamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 3.92, N = 3SE +/- 4.88, N = 3SE +/- 1.73, N = 3SE +/- 1.07, N = 3SE +/- 3.86, N = 3SE +/- 4.90, N = 3SE +/- 0.06, N = 3SE +/- 2.11, N = 3SE +/- 0.20, N = 3SE +/- 2.51, N = 3SE +/- 3.72, N = 3373.47409.86349.30407.73254.40404.9575.86306.46362.27357.63410.46MIN: 52.86 / MAX: 3750MIN: 57.64 / MAX: 4285.71MIN: 45.25 / MAX: 4000MIN: 56.66 / MAX: 4285.71MIN: 47.85 / MAX: 4285.71MIN: 54.05 / MAX: 4285.71MIN: 50.98 / MAX: 2222.22MIN: 50.98 / MAX: 4615.38MIN: 57.8 / MAX: 3529.41MIN: 58.42 / MAX: 4615.38

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cacheamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 1.39, N = 3SE +/- 4.76, N = 3SE +/- 0.77, N = 3SE +/- 2.11, N = 3SE +/- 2.12, N = 3SE +/- 0.63, N = 3SE +/- 0.36, N = 3SE +/- 0.46, N = 3SE +/- 1.22, N = 3SE +/- 3.45, N = 3SE +/- 3.06, N = 3355.12395.53339.68392.95252.79394.3266.81297.77351.21351.39393.15MIN: 43.45 / MAX: 4000MIN: 48.98 / MAX: 4000MIN: 39.27 / MAX: 3157.89MIN: 51.28 / MAX: 3750MIN: 43.29 / MAX: 4000MIN: 48.47 / MAX: 3750MIN: 44.15 / MAX: 2068.97MIN: 49.63 / MAX: 4000MIN: 47.54 / MAX: 2857.14MIN: 50.63 / MAX: 3750

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.29, N = 3SE +/- 0.30, N = 3SE +/- 0.32, N = 12SE +/- 0.32, N = 4SE +/- 3.77, N = 9SE +/- 0.24, N = 12SE +/- 1.56, N = 12SE +/- 0.33, N = 3SE +/- 0.30, N = 12SE +/- 0.34, N = 3SE +/- 0.37, N = 332.9629.8233.1329.0066.3928.72146.5741.9933.7234.0629.541. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Writeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance6K12K18K24K30KSE +/- 216.59, N = 3SE +/- 272.14, N = 3SE +/- 233.05, N = 12SE +/- 307.60, N = 4SE +/- 766.72, N = 9SE +/- 225.23, N = 12SE +/- 60.47, N = 12SE +/- 148.91, N = 3SE +/- 213.86, N = 12SE +/- 234.54, N = 3SE +/- 343.31, N = 32427526830241732759612397278805465190562374323493270931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

CockroachDB

Workload: KV, 95% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 512amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20K40K60K80K100KSE +/- 1522.12, N = 15SE +/- 262.84, N = 3SE +/- 99.42, N = 3SE +/- 465.83, N = 3SE +/- 1298.96, N = 15SE +/- 1631.30, N = 15SE +/- 36.89, N = 3SE +/- 1169.53, N = 15SE +/- 1766.85, N = 15SE +/- 1583.45, N = 15SE +/- 373.82, N = 375876.486214.874380.086477.372179.682071.416811.875334.779962.281782.386045.2

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.35350.7071.06051.4141.7675SE +/- 0.010, N = 11SE +/- 0.003, N = 3SE +/- 0.005, N = 3SE +/- 0.003, N = 3SE +/- 0.025, N = 12SE +/- 0.001, N = 3SE +/- 0.016, N = 6SE +/- 0.020, N = 12SE +/- 0.009, N = 12SE +/- 0.006, N = 3SE +/- 0.005, N = 40.3900.3830.3870.3890.7960.3811.5710.4900.3890.4450.3891. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance300K600K900K1200K1500KSE +/- 28243.17, N = 11SE +/- 10261.05, N = 3SE +/- 16514.38, N = 3SE +/- 10272.10, N = 3SE +/- 23969.59, N = 12SE +/- 2192.30, N = 3SE +/- 3162.32, N = 6SE +/- 38153.01, N = 12SE +/- 24805.29, N = 12SE +/- 16168.04, N = 3SE +/- 16034.65, N = 41288550130609912927981286042636088131183731848010377031291471112422412859051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Xcompact3d Incompact3d

Input: X3D-benchmarking input.i3d

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3damd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance120240360480600SE +/- 0.99, N = 3SE +/- 1.22, N = 3SE +/- 0.28, N = 3SE +/- 0.44, N = 3SE +/- 0.30, N = 3SE +/- 0.86, N = 3SE +/- 0.43, N = 3SE +/- 0.67, N = 3SE +/- 0.32, N = 3SE +/- 0.74, N = 3SE +/- 0.25, N = 3264.91264.59263.30264.82267.54265.31540.54262.40263.63264.80263.631. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compileamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 1.30, N = 3SE +/- 1.78, N = 3SE +/- 1.51, N = 8SE +/- 0.95, N = 3SE +/- 1.72, N = 3SE +/- 0.56, N = 3SE +/- 13.66, N = 3SE +/- 1.36, N = 3SE +/- 1.73, N = 3SE +/- 1.68, N = 4SE +/- 0.41, N = 3157.10149.77173.20148.50156.95146.641100.36153.90149.22152.99147.00

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance48121620SE +/- 0.12, N = 3SE +/- 0.27, N = 15SE +/- 0.14, N = 15SE +/- 0.41, N = 12SE +/- 0.04, N = 12SE +/- 0.26, N = 15SE +/- 0.01, N = 3SE +/- 0.10, N = 12SE +/- 0.01, N = 3SE +/- 0.12, N = 15SE +/- 0.20, N = 311.6313.377.9512.833.0613.321.868.4714.3610.7214.171. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.78, N = 3SE +/- 0.74, N = 3SE +/- 0.62, N = 3SE +/- 0.76, N = 3SE +/- 1.59, N = 3SE +/- 0.72, N = 3SE +/- 2.74, N = 3SE +/- 1.27, N = 3SE +/- 0.77, N = 3SE +/- 0.85, N = 3SE +/- 0.71, N = 3176.50172.88184.47172.86182.77173.641094.37177.06172.61174.95173.63

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.91131.82262.73393.64524.5565SE +/- 0.023, N = 3SE +/- 0.011, N = 3SE +/- 0.011, N = 3SE +/- 0.018, N = 3SE +/- 0.009, N = 3SE +/- 0.021, N = 3SE +/- 0.002, N = 3SE +/- 0.009, N = 3SE +/- 0.007, N = 3SE +/- 0.014, N = 3SE +/- 0.005, N = 33.3594.0222.4714.0233.1364.0210.5683.6763.7673.9744.0501. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.56751.1351.70252.272.8375SE +/- 0.004, N = 3SE +/- 0.008, N = 3SE +/- 0.001, N = 3SE +/- 0.004, N = 3SE +/- 0.033, N = 12SE +/- 0.005, N = 3SE +/- 0.022, N = 8SE +/- 0.033, N = 12SE +/- 0.001, N = 3SE +/- 0.008, N = 4SE +/- 0.004, N = 30.6410.6440.6420.6451.1460.6302.5220.8150.6360.7450.6481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance300K600K900K1200K1500KSE +/- 8403.56, N = 3SE +/- 15062.87, N = 3SE +/- 2388.78, N = 3SE +/- 7684.39, N = 3SE +/- 21438.85, N = 12SE +/- 9347.57, N = 3SE +/- 2702.31, N = 8SE +/- 36540.35, N = 12SE +/- 716.94, N = 3SE +/- 11695.71, N = 4SE +/- 8479.39, N = 3124826612417261245914124040670492912686883173609977421258066107450012348691. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.53261.06521.59782.13042.663SE +/- 0.017556, N = 15SE +/- 0.005634, N = 3SE +/- 0.042633, N = 12SE +/- 0.031447, N = 3SE +/- 0.011706, N = 12SE +/- 0.008972, N = 3SE +/- 0.000425, N = 3SE +/- 0.009049, N = 3SE +/- 0.001977, N = 3SE +/- 0.003977, N = 3SE +/- 0.015239, N = 32.0592592.3480791.8012382.3464470.8114182.3630700.3014501.3585492.3461122.3267702.3670741. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance4080120160200SE +/- 0.45, N = 3SE +/- 0.30, N = 12SE +/- 0.48, N = 3SE +/- 0.31, N = 3SE +/- 4.17, N = 9SE +/- 0.10, N = 3SE +/- 1.19, N = 3SE +/- 0.57, N = 3SE +/- 0.45, N = 12SE +/- 0.32, N = 3SE +/- 0.11, N = 345.5141.1846.4738.3481.1940.16201.1055.9544.3644.8939.601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Writeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance6K12K18K24K30KSE +/- 214.70, N = 3SE +/- 174.68, N = 12SE +/- 224.57, N = 3SE +/- 207.97, N = 3SE +/- 734.11, N = 9SE +/- 63.64, N = 3SE +/- 29.56, N = 3SE +/- 179.41, N = 3SE +/- 232.73, N = 12SE +/- 157.83, N = 3SE +/- 72.30, N = 32197824299215222608512613249044973178752256722279252521. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance612182430SE +/- 0.10, N = 15SE +/- 0.07, N = 12SE +/- 0.09, N = 15SE +/- 0.10, N = 15SE +/- 0.11, N = 12SE +/- 0.12, N = 12SE +/- 0.07, N = 3SE +/- 0.10, N = 12SE +/- 0.11, N = 15SE +/- 0.10, N = 15SE +/- 0.04, N = 53.513.453.323.383.553.3924.553.403.413.443.72MIN: 5.27 / MAX: 260.671. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance8K16K24K32K40KSE +/- 1060.84, N = 15SE +/- 724.32, N = 12SE +/- 894.45, N = 15SE +/- 1139.15, N = 15SE +/- 909.70, N = 12SE +/- 1205.35, N = 12SE +/- 15.51, N = 3SE +/- 946.71, N = 12SE +/- 1216.09, N = 15SE +/- 1008.62, N = 15SE +/- 342.83, N = 535205.4735601.8336975.3436507.1133751.5836428.765175.9635501.2136248.3835666.6932979.741. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.72071.44142.16212.88283.6035SE +/- 0.004, N = 3SE +/- 0.005, N = 3SE +/- 0.002, N = 3SE +/- 0.004, N = 3SE +/- 0.040, N = 12SE +/- 0.009, N = 3SE +/- 0.018, N = 3SE +/- 0.048, N = 12SE +/- 0.004, N = 3SE +/- 0.003, N = 3SE +/- 0.006, N = 30.8280.8270.8150.8151.4110.8123.2031.0690.8080.9240.8321. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance300K600K900K1200K1500KSE +/- 5837.45, N = 3SE +/- 7063.00, N = 3SE +/- 3162.21, N = 3SE +/- 6415.45, N = 3SE +/- 20475.53, N = 12SE +/- 13365.19, N = 3SE +/- 1792.34, N = 3SE +/- 40789.54, N = 12SE +/- 5317.94, N = 3SE +/- 3711.22, N = 3SE +/- 9650.25, N = 3120754012090331226429122674371498012308413122459559771237871108279412026371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.33, N = 3SE +/- 0.20, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.78, N = 3SE +/- 0.24, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3141.79140.18143.04140.36147.46140.35933.41141.91140.55141.98140.45

CockroachDB

Workload: KV, 10% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance11K22K33K44K55KSE +/- 451.19, N = 3SE +/- 504.99, N = 3SE +/- 530.33, N = 4SE +/- 207.31, N = 3SE +/- 410.53, N = 15SE +/- 526.94, N = 3SE +/- 162.55, N = 3SE +/- 457.69, N = 6SE +/- 524.19, N = 15SE +/- 590.54, N = 4SE +/- 577.32, N = 344725.550217.243287.249015.541485.549340.411461.445780.347827.049459.949731.9

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To Compileamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance160320480640800SE +/- 0.68, N = 3SE +/- 0.15, N = 3SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.88, N = 3SE +/- 0.13, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3111.95105.53120.48105.83113.13104.93752.99109.81106.47107.14105.54

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Traceramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance70K140K210K280K350KSE +/- 62.74, N = 3SE +/- 58.85, N = 3SE +/- 90.34, N = 3SE +/- 36.04, N = 3SE +/- 7.42, N = 3SE +/- 83.21, N = 3SE +/- 671.47, N = 3SE +/- 85.87, N = 3SE +/- 70.48, N = 3SE +/- 28.29, N = 3SE +/- 98.82, N = 3417984165041532416864370541588332950418974213042264418591. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Traceramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance15K30K45K60K75KSE +/- 0.58, N = 3SE +/- 2.03, N = 3SE +/- 0.88, N = 3SE +/- 2.08, N = 3SE +/- 1.15, N = 3SE +/- 1.45, N = 3SE +/- 831.01, N = 12SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 2.19, N = 3SE +/- 1.45, N = 31304129913031302137613006854813221306132213061. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Traceramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance14K28K42K56K70KSE +/- 1.20, N = 3SE +/- 1.33, N = 3SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 1.15, N = 3SE +/- 875.42, N = 12SE +/- 2.03, N = 3SE +/- 2.85, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 31101110311021101116610986700011181103112011041. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Traceramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60K120K180K240K300KSE +/- 29.34, N = 3SE +/- 76.22, N = 3SE +/- 69.50, N = 3SE +/- 31.26, N = 3SE +/- 66.07, N = 3SE +/- 23.07, N = 3SE +/- 829.19, N = 3SE +/- 52.33, N = 3SE +/- 88.76, N = 3SE +/- 25.51, N = 3SE +/- 117.33, N = 3354383557335243352103697635186291743354403550535628354061. (CXX) g++ options: -O3 -lm -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance70140210280350SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 1.86, N = 15SE +/- 0.02, N = 3SE +/- 2.16, N = 15SE +/- 2.27, N = 12SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 317.4917.4117.5317.3732.4217.37315.2635.3917.4417.6517.48MIN: 86.78 / MAX: 701.541. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance8001600240032004000SE +/- 3.07, N = 3SE +/- 6.01, N = 3SE +/- 8.08, N = 3SE +/- 3.54, N = 3SE +/- 113.70, N = 15SE +/- 4.65, N = 3SE +/- 1.43, N = 15SE +/- 155.56, N = 12SE +/- 6.58, N = 3SE +/- 13.56, N = 3SE +/- 4.78, N = 33654.513670.783645.603679.312062.043678.91202.831915.373663.483621.583655.411. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fasteramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance246810SE +/- 0.045, N = 3SE +/- 0.075, N = 3SE +/- 0.018, N = 3SE +/- 0.083, N = 4SE +/- 0.049, N = 3SE +/- 0.084, N = 4SE +/- 0.008, N = 3SE +/- 0.030, N = 3SE +/- 0.068, N = 3SE +/- 0.043, N = 3SE +/- 0.075, N = 36.3267.3974.7697.3526.2307.3061.1576.6467.3477.3737.3201. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.16, N = 13SE +/- 0.15, N = 13SE +/- 0.24, N = 13SE +/- 0.14, N = 15SE +/- 0.23, N = 14SE +/- 0.18, N = 10SE +/- 1.30, N = 9SE +/- 0.21, N = 15SE +/- 0.14, N = 13SE +/- 0.17, N = 14SE +/- 0.14, N = 1325.5222.6230.8322.5325.3922.52156.7824.5222.6123.4422.65

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution Timeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance170340510680850167.41170.71169.25167.82182.44168.80773.03167.90166.48169.00164.041. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh Timeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance170340510680850116.05114.87116.28116.19127.86116.11773.97119.63116.44120.10115.761. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

CockroachDB

Workload: MoVR - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance170340510680850SE +/- 2.27, N = 3SE +/- 1.59, N = 3SE +/- 1.71, N = 3SE +/- 2.65, N = 3SE +/- 2.51, N = 15SE +/- 1.79, N = 3SE +/- 0.42, N = 3SE +/- 4.45, N = 3SE +/- 0.92, N = 3SE +/- 3.24, N = 3SE +/- 3.30, N = 3641.8761.0570.5763.4195.9766.8126.8574.8438.2698.0765.2

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance30K60K90K120K150KSE +/- 1575.56, N = 5SE +/- 1361.88, N = 3SE +/- 1620.42, N = 5SE +/- 2024.19, N = 3SE +/- 115.95, N = 3SE +/- 684.93, N = 3SE +/- 131.35, N = 3SE +/- 208.90, N = 3SE +/- 1781.93, N = 4SE +/- 977.04, N = 3SE +/- 693.20, N = 3146738.16147764.25145614.76152654.86138510.00151325.0127774.70122126.56146083.16149876.52147285.781. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 2.29, N = 12SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 3.03, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 317.1017.0617.1417.0746.4917.05107.1736.3517.0917.3317.09MIN: 9.33 / MAX: 84.63MIN: 9.02 / MAX: 83.41MIN: 9.37 / MAX: 88.86MIN: 8.56 / MAX: 80.26MIN: 8.5 / MAX: 147.24MIN: 9.39 / MAX: 80.76MIN: 59.84 / MAX: 344.36MIN: 7.98 / MAX: 137.61MIN: 9.24 / MAX: 81.88MIN: 9.07 / MAX: 83.28MIN: 9.82 / MAX: 80.611. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance8001600240032004000SE +/- 1.15, N = 3SE +/- 0.22, N = 3SE +/- 0.85, N = 3SE +/- 0.90, N = 3SE +/- 78.31, N = 12SE +/- 1.03, N = 3SE +/- 0.14, N = 3SE +/- 176.75, N = 15SE +/- 1.38, N = 3SE +/- 1.17, N = 3SE +/- 0.08, N = 33738.043748.173730.663744.851416.773749.69596.041960.303741.063689.973741.351. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance30060090012001500SE +/- 0.82, N = 3SE +/- 1.09, N = 3SE +/- 0.51, N = 3SE +/- 2.12, N = 3SE +/- 0.48, N = 3SE +/- 0.54, N = 3SE +/- 7.94, N = 15SE +/- 0.15, N = 3SE +/- 1.21, N = 3SE +/- 1.01, N = 3SE +/- 0.97, N = 3239.05239.29238.16239.70240.82239.021229.86228.75239.94241.17238.32MIN: 599.82 / MAX: 5117.071. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 1.00, N = 3SE +/- 1.18, N = 3SE +/- 0.60, N = 3SE +/- 2.34, N = 3SE +/- 0.47, N = 3SE +/- 0.60, N = 3SE +/- 0.34, N = 15SE +/- 0.14, N = 3SE +/- 1.35, N = 3SE +/- 1.08, N = 3SE +/- 1.06, N = 3267.15266.96268.24266.56265.31267.3051.52279.33266.14264.82268.041. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 1.11, N = 3SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 0.17, N = 3205.68205.42205.70205.30212.63205.411124.30206.14205.49206.45205.28

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance70140210280350SE +/- 0.30, N = 3SE +/- 0.12, N = 3SE +/- 0.37, N = 3SE +/- 0.15, N = 3SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.48, N = 3SE +/- 0.24, N = 3SE +/- 0.62, N = 3SE +/- 0.30, N = 3310.30310.43309.38310.74299.57310.3056.66309.60310.09308.68310.61

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression Speedamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance30060090012001500SE +/- 1.23, N = 3SE +/- 7.42, N = 3SE +/- 20.88, N = 3SE +/- 5.97, N = 3SE +/- 1.07, N = 3SE +/- 18.37, N = 3SE +/- 0.15, N = 3SE +/- 11.54, N = 3SE +/- 9.03, N = 3SE +/- 11.09, N = 3SE +/- 7.61, N = 31195.01203.61186.01203.31191.51171.2140.11178.01203.21203.21209.11. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression Speedamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance3691215SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 38.919.288.729.269.209.311.069.139.299.219.121. (CC) gcc options: -O3 -pthread -lz -llzma

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 0.28, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 368.9268.7168.5668.5871.1668.65295.4968.6068.5568.7168.77

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 3.90, N = 3SE +/- 2.48, N = 3SE +/- 0.75, N = 3SE +/- 1.42, N = 3SE +/- 0.59, N = 3SE +/- 1.11, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.68, N = 3SE +/- 1.23, N = 3SE +/- 1.66, N = 3926.20929.79931.60931.58897.64930.49215.52931.20932.00929.79928.54

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance5K10K15K20K25KSE +/- 4.72, N = 3SE +/- 8.61, N = 3SE +/- 6.67, N = 3SE +/- 9.11, N = 3SE +/- 8.81, N = 3SE +/- 4.79, N = 3SE +/- 217.31, N = 3SE +/- 15.80, N = 3SE +/- 5.84, N = 3SE +/- 2.84, N = 3SE +/- 4.16, N = 34030.034015.914033.634005.034262.294030.7924236.974103.644054.304041.314032.10MIN: 18903.29 / MAX: 30172.21. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance48121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 315.5215.5415.5015.5514.6315.522.5415.2415.4115.4415.491. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance7001400210028003500SE +/- 0.37, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.38, N = 3SE +/- 0.41, N = 3SE +/- 0.92, N = 3SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.20, N = 3SE +/- 0.22, N = 3587.74587.84587.78587.61605.67586.863485.21589.69587.78588.61587.38

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.20, N = 3SE +/- 0.00, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3108.20108.20108.15108.11104.89108.4018.20107.47108.13107.90108.16

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance160K320K480K640K800KSE +/- 858.55, N = 3SE +/- 18690.79, N = 3SE +/- 5960.12, N = 3SE +/- 10875.45, N = 4SE +/- 2716.47, N = 7SE +/- 2158.20, N = 3SE +/- 136.02, N = 3SE +/- 1773.36, N = 3SE +/- 156.12, N = 3SE +/- 1725.95, N = 3SE +/- 2437.88, N = 67167037265216614207338826992287463761042877390167485497400397429551. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance110K220K330K440K550KSE +/- 480.40, N = 3SE +/- 5053.05, N = 3SE +/- 3758.30, N = 3SE +/- 5870.22, N = 4SE +/- 3670.50, N = 7SE +/- 6313.35, N = 3SE +/- 1055.88, N = 3SE +/- 2092.51, N = 3SE +/- 3716.48, N = 3SE +/- 6757.49, N = 3SE +/- 5372.93, N = 65004715223484596175144433949825306891009704853874758615070395282891. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance10002000300040005000SE +/- 0.37, N = 3SE +/- 0.32, N = 3SE +/- 0.34, N = 3SE +/- 0.36, N = 3SE +/- 0.52, N = 3SE +/- 0.55, N = 3SE +/- 3.96, N = 3SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.34, N = 3869.22868.87868.92868.26895.13867.904864.70876.50868.82872.89869.19

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1632486480SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 372.8572.9572.8073.0670.7572.9112.9772.5273.1072.7773.16

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression Speedamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance30060090012001500SE +/- 3.84, N = 5SE +/- 4.93, N = 3SE +/- 2.19, N = 3SE +/- 6.13, N = 3SE +/- 1.88, N = 3SE +/- 28.63, N = 3SE +/- 0.03, N = 3SE +/- 5.25, N = 3SE +/- 2.01, N = 3SE +/- 1.32, N = 3SE +/- 0.97, N = 31278.31278.61269.81276.21261.81188.1146.11280.51270.91264.71272.81. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression Speedamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance48121620SE +/- 0.16, N = 5SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 316.0017.6015.2017.5017.1017.601.9717.2017.4017.5017.501. (CC) gcc options: -O3 -pthread -lz -llzma

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance10002000300040005000SE +/- 0.33, N = 3SE +/- 0.23, N = 3SE +/- 0.24, N = 3SE +/- 0.76, N = 3SE +/- 0.79, N = 3SE +/- 0.10, N = 3SE +/- 2.96, N = 3SE +/- 0.56, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.69, N = 3868.08867.93867.02866.98893.43866.964868.11876.33866.62872.07867.83

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1632486480SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 373.0272.9473.0573.1471.0173.2713.0072.4173.0372.7873.25

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.29, N = 3SE +/- 0.48, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.54, N = 3SE +/- 0.30, N = 3SE +/- 0.96, N = 3SE +/- 0.15, N = 3SE +/- 0.52, N = 3SE +/- 0.26, N = 3SE +/- 0.28, N = 3207.61207.44207.33207.19214.47207.671143.06208.09207.27207.88207.58

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance70140210280350SE +/- 0.63, N = 3SE +/- 0.82, N = 3SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.78, N = 3SE +/- 0.44, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.63, N = 3SE +/- 0.60, N = 3SE +/- 0.69, N = 3307.04307.64307.71307.89297.14307.2755.22306.40307.72306.68307.17

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance16003200480064008000SE +/- 0.15, N = 3SE +/- 0.45, N = 3SE +/- 0.05, N = 3SE +/- 8.32, N = 3SE +/- 0.52, N = 3SE +/- 0.68, N = 3SE +/- 16.67, N = 3SE +/- 0.24, N = 3SE +/- 1.11, N = 3SE +/- 0.25, N = 3SE +/- 0.38, N = 31195.351195.601199.871203.521260.491195.237565.211210.761195.761203.421195.14MIN: 7058.85 / MAX: 8272.071. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1224364860SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.35, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 353.0953.0752.9152.7950.3553.038.3852.4853.0652.7653.121. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To Compileamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 0.44, N = 3SE +/- 0.05, N = 3SE +/- 0.43, N = 3SE +/- 0.27, N = 3SE +/- 0.30, N = 15SE +/- 0.46, N = 3SE +/- 1.50, N = 3SE +/- 0.12, N = 3SE +/- 0.36, N = 3SE +/- 0.38, N = 3SE +/- 0.23, N = 341.9037.3247.9437.0141.9437.05258.8740.8137.5838.3737.38

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.94141.88282.82423.76564.707SE +/- 0.013, N = 3SE +/- 0.008, N = 3SE +/- 0.007, N = 3SE +/- 0.016, N = 3SE +/- 0.022, N = 3SE +/- 0.005, N = 3SE +/- 0.001, N = 3SE +/- 0.020, N = 3SE +/- 0.003, N = 3SE +/- 0.025, N = 3SE +/- 0.002, N = 33.4534.1582.4434.1813.3224.1840.5583.8654.0134.0904.1821. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 0.20, N = 3SE +/- 0.08, N = 3SE +/- 0.42, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.71, N = 3SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 345.9945.7246.7345.7548.4945.77297.6746.1945.9545.9245.85

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_bareamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance3691215SE +/- 0.032, N = 3SE +/- 0.057, N = 3SE +/- 0.019, N = 3SE +/- 0.065, N = 3SE +/- 0.601, N = 12SE +/- 0.036, N = 3SE +/- 0.004, N = 3SE +/- 0.448, N = 15SE +/- 0.046, N = 3SE +/- 0.125, N = 15SE +/- 0.018, N = 311.07911.17911.13111.0748.48211.0532.1679.55011.17310.85311.1251. (CXX) g++ options: -O3

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 324.1724.1624.2424.1725.4324.17153.7824.4824.1724.3624.17MIN: 78.56 / MAX: 301.881. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance11002200330044005500SE +/- 0.95, N = 3SE +/- 1.37, N = 3SE +/- 1.46, N = 3SE +/- 0.41, N = 3SE +/- 0.59, N = 3SE +/- 2.23, N = 3SE +/- 0.10, N = 3SE +/- 1.03, N = 3SE +/- 0.71, N = 3SE +/- 0.47, N = 3SE +/- 0.80, N = 35291.455294.975277.025291.005029.055292.08830.315224.835292.425250.155291.811. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 337.9437.6838.3537.5740.0437.73254.4637.8537.6137.9237.71

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark Suiteamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance150K300K450K600K750KSE +/- 2423.31, N = 3SE +/- 5808.55, N = 12SE +/- 981.48, N = 3SE +/- 4455.74, N = 3SE +/- 5021.57, N = 3SE +/- 3225.60, N = 3SE +/- 423.55, N = 3SE +/- 5843.40, N = 3SE +/- 2191.80, N = 3SE +/- 5594.67, N = 3SE +/- 4034.04, N = 368768269747867120770028771112570121579570705341698785708218699816

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance4080120160200SE +/- 2.85, N = 15SE +/- 3.08, N = 15SE +/- 1.61, N = 15SE +/- 2.85, N = 15SE +/- 1.29, N = 15SE +/- 3.27, N = 15SE +/- 0.49, N = 12SE +/- 2.56, N = 15SE +/- 2.84, N = 15SE +/- 3.33, N = 15SE +/- 3.08, N = 15175.46186.05155.77173.3190.28182.3636.65171.88167.61180.33180.861. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance120240360480600SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 0.31, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3104.57104.76104.66104.62108.66104.73577.77105.15104.75105.02104.80

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance130260390520650SE +/- 0.85, N = 3SE +/- 0.26, N = 3SE +/- 0.24, N = 3SE +/- 0.35, N = 3SE +/- 1.22, N = 3SE +/- 0.82, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 1.19, N = 3SE +/- 0.14, N = 3SE +/- 0.68, N = 3610.70609.61609.90610.32587.48609.96109.77607.33609.76608.30609.04

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 3SE +/- 0.12, N = 3SE +/- 1.48, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3158.13157.55158.08157.70164.20157.80884.29158.95157.83158.05157.88

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.49, N = 3SE +/- 0.37, N = 3SE +/- 0.15, N = 3SE +/- 0.34, N = 3SE +/- 0.60, N = 3SE +/- 0.36, N = 3SE +/- 0.15, N = 3403.29404.95403.59404.55388.64404.3070.87401.73404.27403.28404.13

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 376.9976.9877.0276.9178.8776.91431.9676.5777.1077.0177.06

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 1.36, N = 3SE +/- 1.68, N = 3SE +/- 1.08, N = 3SE +/- 1.26, N = 3SE +/- 0.84, N = 3SE +/- 1.41, N = 3SE +/- 0.17, N = 3SE +/- 1.55, N = 3SE +/- 0.64, N = 3SE +/- 1.55, N = 3SE +/- 0.63, N = 3830.10830.01829.60830.32809.90830.85147.69834.46828.90829.17828.82

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance510152025SE +/- 0.08, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.23, N = 318.5620.5515.3320.6316.3620.744.3719.2920.6719.9020.961. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test Timesamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2K4K6K8K10KSE +/- 0.88, N = 3SE +/- 6.01, N = 3SE +/- 7.22, N = 3SE +/- 4.04, N = 3SE +/- 2.85, N = 3SE +/- 3.28, N = 3SE +/- 41.93, N = 3SE +/- 5.81, N = 3SE +/- 7.81, N = 3SE +/- 9.13, N = 3SE +/- 5.81, N = 310039981008101098710108775100499910061002

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Mediumamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance612182430SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 324.2827.0117.3327.0612.2526.893.9724.5821.2127.2026.93

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: Asian Dragonamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.79, N = 15SE +/- 0.87, N = 15SE +/- 0.91, N = 15SE +/- 0.93, N = 15SE +/- 0.79, N = 15SE +/- 0.98, N = 15SE +/- 0.02, N = 3SE +/- 1.15, N = 15SE +/- 0.79, N = 6SE +/- 0.85, N = 6SE +/- 0.72, N = 1592.2194.7893.7393.5088.8093.6124.7992.8093.7692.9591.37MIN: 87.15 / MAX: 100.61MIN: 86.18 / MAX: 101.48MIN: 86.21 / MAX: 102.02MIN: 87.15 / MAX: 102.17MIN: 82.24 / MAX: 97.26MIN: 86.72 / MAX: 102.65MIN: 24.19 / MAX: 25.44MIN: 85.44 / MAX: 101.26MIN: 88.79 / MAX: 100.41MIN: 88.86 / MAX: 98.52MIN: 86.16 / MAX: 99.08

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1326395265SE +/- 0.70, N = 15SE +/- 0.40, N = 5SE +/- 1.47, N = 15SE +/- 0.46, N = 5SE +/- 0.10, N = 3SE +/- 0.11, N = 5SE +/- 0.07, N = 3SE +/- 0.50, N = 4SE +/- 0.44, N = 5SE +/- 0.48, N = 5SE +/- 0.48, N = 550.6756.1441.8355.8526.5455.277.7252.6052.9355.5855.921. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1224364860SE +/- 0.60, N = 15SE +/- 0.60, N = 5SE +/- 1.49, N = 15SE +/- 0.44, N = 5SE +/- 0.13, N = 3SE +/- 0.51, N = 5SE +/- 0.08, N = 3SE +/- 0.26, N = 4SE +/- 0.20, N = 4SE +/- 0.50, N = 5SE +/- 0.52, N = 547.9754.6945.5654.7726.2153.777.4352.1752.3254.7855.031. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1122334455SE +/- 0.43, N = 4SE +/- 0.33, N = 4SE +/- 0.67, N = 15SE +/- 0.28, N = 4SE +/- 0.08, N = 3SE +/- 0.49, N = 5SE +/- 0.04, N = 3SE +/- 0.19, N = 4SE +/- 0.18, N = 4SE +/- 0.30, N = 4SE +/- 0.21, N = 441.1347.2533.7646.0821.6545.466.8841.9040.8244.5046.45

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Mediumamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance816243240SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.13, N = 329.4231.9920.6632.3014.3932.004.8330.3222.9732.3632.091. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1122334455SE +/- 0.28, N = 4SE +/- 0.22, N = 4SE +/- 0.58, N = 15SE +/- 0.28, N = 4SE +/- 0.09, N = 3SE +/- 0.18, N = 4SE +/- 0.01, N = 3SE +/- 0.33, N = 4SE +/- 0.25, N = 4SE +/- 0.30, N = 4SE +/- 0.16, N = 439.9646.2633.7946.3125.4345.416.7741.5740.7145.1946.07

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 319.1718.8019.7418.9520.2618.89124.4819.1818.9019.0019.01

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 Atomsamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.31720.63440.95161.26881.586SE +/- 0.00272, N = 3SE +/- 0.00158, N = 4SE +/- 0.00042, N = 3SE +/- 0.00124, N = 4SE +/- 0.00054, N = 3SE +/- 0.00077, N = 4SE +/- 0.00490, N = 3SE +/- 0.00244, N = 3SE +/- 0.00170, N = 3SE +/- 0.00142, N = 3SE +/- 0.00089, N = 40.222860.222700.224500.220210.234200.224641.409820.222890.220250.222900.22441

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance4080120160200SE +/- 1.23, N = 12SE +/- 1.60, N = 7SE +/- 1.22, N = 6SE +/- 2.12, N = 15SE +/- 0.85, N = 15SE +/- 1.88, N = 15SE +/- 0.14, N = 3SE +/- 1.52, N = 7SE +/- 1.54, N = 15SE +/- 1.37, N = 10SE +/- 2.47, N = 15170.27194.10145.32188.4272.22191.0532.27161.78144.34180.34189.131. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: Crownamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.25, N = 7SE +/- 0.11, N = 7SE +/- 0.21, N = 6SE +/- 0.18, N = 7SE +/- 0.22, N = 7SE +/- 0.14, N = 7SE +/- 0.02, N = 3SE +/- 0.24, N = 7SE +/- 0.15, N = 7SE +/- 0.33, N = 7SE +/- 0.13, N = 7122.50123.15121.30122.87116.75123.0219.67121.86122.71120.80123.05MIN: 118.44 / MAX: 132.08MIN: 120.42 / MAX: 134.1MIN: 107.62 / MAX: 132.2MIN: 119.52 / MAX: 133.96MIN: 112.31 / MAX: 126.6MIN: 120.25 / MAX: 132.77MIN: 117.58 / MAX: 131.5MIN: 119.75 / MAX: 131.8MIN: 116.78 / MAX: 132.34MIN: 119.92 / MAX: 135.17


Phoronix Test Suite v10.8.5