AMD P-State Linux 6.3 Testing

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2302279-NE-AMDPSTATE10&gru&sro.

AMD P-State Linux 6.3 TestingProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen Resolutionamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2 x AMD EPYC 7773X 64-Core @ 3.53GHz (128 Cores / 256 Threads)AMD DAYTONA_X (RYM1009B BIOS)AMD Starship/Matisse512GB800GB INTEL SSDPF21Q800GBASPEEDVE2282 x Mellanox MT27710Ubuntu 22.046.2.0-phx (x86_64)GNOME Shell 42.5X Server 1.21.1.31.3.224GCC 11.3.0 + LLVM 14.0.0ext41920x10802 x AMD EPYC 7773X 64-Core @ 2.20GHz (128 Cores / 256 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- amd_pstate_epp powersave balance_performance: Scaling Governor: amd_pstate_epp powersave (EPP: balance_performance) - CPU Microcode: 0xa001229- amd_pstate_epp performance balance_performance: Scaling Governor: amd_pstate_epp performance (EPP: performance) - CPU Microcode: 0xa001229- amd_pstate_epp powersave power: Scaling Governor: amd_pstate_epp powersave (EPP: power) - CPU Microcode: 0xa001229- amd_pstate_epp performance performance: Scaling Governor: amd_pstate_epp performance (EPP: performance) - CPU Microcode: 0xa001229- amd_pstate schedutil: Scaling Governor: amd-pstate schedutil (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate performance: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate powersave: Scaling Governor: amd-pstate powersave (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate ondemand: Scaling Governor: amd-pstate ondemand (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq schedutil: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq ondemand: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq performance: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001229Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD P-State Linux 6.3 Testingopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUembree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastvpxenc: Speed 5 - Bosphorus 4Kvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fasterx265: Bosphorus 4Ktensorflow: CPU - 256 - AlexNettensorflow: CPU - 256 - GoogLeNetopenvkl: vklBenchmark ISPCopenvkl: vklBenchmark Scalardeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamcompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedcompress-zstd: 19, Long Mode - Decompression Speedcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratinggromacs: MPI CPU - water_GMX50_barecockroach: MoVR - 512cockroach: KV, 10% Reads - 512cockroach: KV, 95% Reads - 512clickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runstargate: 192000 - 1024nginx: 500phpbench: PHP Benchmark Suitepgbench: 100 - 500 - Read Onlypgbench: 100 - 800 - Read Onlypgbench: 100 - 1000 - Read Onlypgbench: 100 - 500 - Read Writepgbench: 100 - 800 - Read Writepgbench: 100 - 1000 - Read Writebrl-cad: VGR Performance Metricnamd: ATPase Simulation - 327,506 Atomspybench: Total For Average Test Timesospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracerpgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 1000 - Read Write - Average Latencyopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamincompact3d: X3D-benchmarking input.i3dopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timebuild-gem5: Time To Compilebuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-nodejs: Time To Compileblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance15.5253.093738.04267.155291.453654.5135205.47122.501492.206429.4247.9750.673.453175.455170.26524.2839.9641.1311.633.3596.32618.5687.7538.4151436472.8451926.2028310.296403.291830.0967610.7001108.1971307.038573.023916.01278.38.911195.050047171670311.079641.844725.575876.4355.12373.47372.982.059259146738.1668768212885501248266120754028873242752197828539830.2228610031101130435438417980.3900.6410.82817.37232.96145.5094030.031195.3517.10239.0524.1717.493.51869.215068.9182205.6828158.129276.9866104.5730587.7380207.6114868.0756264.910481116.05227167.409157.10241.89825.521176.495111.94937.9419.17141.7945.9915.5453.073748.17266.965294.973670.7835601.83123.145894.784131.9954.6956.144.158186.048194.10327.0146.2647.2513.374.0227.39720.5597.1240.1951637472.9497929.7894310.4330404.9534830.0131609.6137108.1954307.642072.937917.61278.69.281203.652234872652111.179761.050217.286214.8395.53409.86406.992.348079147764.2569747813060991241726120903335610268302429929051810.222709981103129935573416500.3830.6440.82714.63829.82341.1774015.911195.6017.06239.2924.1617.413.45868.871968.7056205.4179157.550176.9790104.7553587.8421207.4377867.9275264.590464114.86885170.71478149.76737.32122.623172.884105.52937.6818.80140.1845.7215.5052.913730.66268.245277.023645.6036975.34121.297093.727920.6645.5641.832.443155.770145.32317.3333.7933.767.952.4714.76915.3365.6331.6447734672.7952931.6005309.3788403.5860829.6035609.8987108.1498307.712973.050115.21269.88.721186.045961766142011.131570.543287.274380.0339.68349.30353.171.801238145614.7667120712927981245914122642928682241732152228639510.2245010081102130335243415320.3870.6420.81517.48633.12946.4744033.631199.8717.14238.1624.2417.533.32868.924668.5591205.6999158.075177.0202104.6604587.7795207.3328867.0199263.300232116.28282169.24992173.20147.93530.833184.470120.48338.3519.74143.0446.7315.5552.793744.85266.565291.003679.3136507.11122.872993.501232.3054.7755.854.181173.314188.42327.0646.3146.0812.834.0237.35220.6396.7340.3951238573.0561931.5821310.7448404.5464830.3241610.3155108.1144307.892073.137217.51276.29.261203.351444373388211.074763.449015.586477.3392.95407.73394.982.346447152654.8670028712860421240406122674332286275962608529807190.2202110101101130235210416860.3890.6450.81515.52929.00038.3414005.031203.5217.07239.7024.1717.373.38868.261668.5813205.3031157.700276.9051104.6233587.6097207.1853866.9818264.824544116.19384167.81864148.50337.01122.530172.857105.82537.5718.95140.3645.7514.6350.351416.77265.315029.052062.0433751.58116.753088.802214.3926.2126.543.32290.27772.22112.2525.4321.653.063.1366.23016.3636.5026.6346832770.7499897.6375299.5680388.6392809.9048587.4762104.8933297.138771.007417.11261.89.201191.53949826992288.482195.941485.572179.6252.79254.40251.840.811418138510.0071112563608870492971498019298123971261328365040.234209871166137636976437050.7961.1461.41127.74466.38781.1924262.291260.4946.49240.8225.4332.423.55895.127271.1617212.6277164.200878.8686108.6614605.6728214.4729893.4282267.536092127.85527182.43689156.94541.94025.392182.768113.13140.0420.26147.4648.4915.5253.033749.69267.305292.083678.9136428.76123.024893.605032.0053.7755.274.184182.358191.04626.8945.4145.4613.324.0217.30620.7497.5040.8953437472.9079930.4932310.3004404.2950830.8519609.9637108.4041307.266973.269217.61188.19.311171.253068974637611.053766.849340.482071.4394.32404.95406.412.363070151325.0170121513118371268688123084132858278802490428153560.2246410101098130035186415880.3810.6300.81215.25728.71540.1554030.791195.2317.05239.0224.1717.373.39867.899368.6499205.4057157.799276.9068104.7278586.8584207.6741866.9595265.312622116.10875168.799146.64437.05322.519173.636104.93437.7318.89140.3545.772.548.38596.0451.52830.31202.835175.9619.668524.79174.837.437.720.55836.64732.2653.976.776.881.860.5681.1574.3716.548.741027212.9683215.516756.658270.8684147.6880109.769318.204855.224513.00281.97146.11.06140.11009701042872.167126.811461.416811.866.8175.8676.660.30145027774.70795703184803173603122456686546549734056141.40982877567000685482917433329501.5712.5223.20375.984146.572201.10124236.977565.21107.171229.86153.78315.2624.554864.7028295.49181124.3046884.2913431.9597577.76883485.21291143.05554868.1057540.544881773.96684773.032831100.363258.873156.7831094.374752.986254.46124.48933.41297.6715.2452.481960.30279.335224.831915.3735501.21121.857692.800430.3252.1752.603.865171.877161.77824.5841.5741.908.473.6766.64619.2975.6937.0351436372.5195931.2032309.5958401.7313834.4638607.3304107.4707306.399472.410117.21280.59.131178.04853877390169.550574.845780.375334.7297.77306.46310.661.358549122126.56705341103770399774295597732486190561787528637420.2228910041118132235440418970.4900.8151.06916.43641.98855.9544103.641210.7636.35228.7524.4835.393.40876.496168.5979206.1379158.946476.5661105.1513589.6910208.0910876.3321262.403117119.63471167.90491153.90340.81224.520177.063109.81337.8519.18141.9146.1915.4153.063741.06266.145292.423663.4836248.38122.705593.761522.9752.3252.934.013167.611144.34221.2140.7140.8214.363.7677.34720.6779.3639.2453137673.1026932.0027310.0940404.2730828.8966609.7624108.1330307.716573.029017.41270.99.291203.247586174854911.173438.247827.079962.2351.21362.27352.852.346112146083.1669878512914711258066123787128016237432256730211710.220259991103130635505421300.3890.6360.80817.90933.72344.3644054.301195.7617.09239.9424.1717.443.41868.815768.5451205.4931157.825177.0980104.7469587.7789207.2711866.6223263.625285116.43538166.47566149.22237.57622.610172.606106.46637.6118.90140.5545.9515.4452.763689.97264.825250.153621.5835666.69120.799892.953732.3654.7855.584.090180.332180.34327.2045.1944.5010.723.9747.37319.9094.6240.0052435772.7729929.7910308.6765403.2806829.1745608.3023107.8991306.682272.782117.51264.79.211203.250703974003910.853698.049459.981782.3351.39357.63357.942.326770149876.5270821811242241074500108279429347234932227928142690.2229010061120132235628422640.4450.7450.92417.19434.05944.8914041.311203.4217.33241.1724.3617.653.44872.891268.7068206.4473158.047577.0107105.0236588.6134207.8753872.0650264.797139120.10383168.99869152.99038.36523.440174.946107.14337.9219.00141.9845.9215.4953.123741.35268.045291.813655.4132979.74123.051991.372432.0955.0355.924.182180.860189.13126.9346.0746.4514.174.0507.32020.9695.7140.4252436773.1592928.5381310.6145404.1304828.8161609.0422108.1608307.165873.251017.51272.89.121209.152828974295511.125765.249731.986045.2393.15410.46401.812.367074147285.7869981612859051234869120263733019270932525229215720.2244110021104130635406418590.3890.6480.83215.18329.53739.6024032.101195.1417.09238.3224.1717.483.72869.187268.7650205.2817157.881477.0588104.8041587.3828207.5798867.8296263.627543115.75608164.04046147.00237.38422.652173.634105.54137.7119.01140.4545.85OpenBenchmarking.org

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power48121620SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 315.4415.4915.4115.2415.522.5414.6315.5415.5515.5215.501. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1224364860SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.35, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 352.7653.1253.0652.4853.038.3850.3553.0752.7953.0952.911. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power8001600240032004000SE +/- 1.17, N = 3SE +/- 0.08, N = 3SE +/- 1.38, N = 3SE +/- 176.75, N = 15SE +/- 1.03, N = 3SE +/- 0.14, N = 3SE +/- 78.31, N = 12SE +/- 0.22, N = 3SE +/- 0.90, N = 3SE +/- 1.15, N = 3SE +/- 0.85, N = 33689.973741.353741.061960.303749.69596.041416.773748.173744.853738.043730.661. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 1.08, N = 3SE +/- 1.06, N = 3SE +/- 1.35, N = 3SE +/- 0.14, N = 3SE +/- 0.60, N = 3SE +/- 0.34, N = 15SE +/- 0.47, N = 3SE +/- 1.18, N = 3SE +/- 2.34, N = 3SE +/- 1.00, N = 3SE +/- 0.60, N = 3264.82268.04266.14279.33267.3051.52265.31266.96266.56267.15268.241. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power11002200330044005500SE +/- 0.47, N = 3SE +/- 0.80, N = 3SE +/- 0.71, N = 3SE +/- 1.03, N = 3SE +/- 2.23, N = 3SE +/- 0.10, N = 3SE +/- 0.59, N = 3SE +/- 1.37, N = 3SE +/- 0.41, N = 3SE +/- 0.95, N = 3SE +/- 1.46, N = 35250.155291.815292.425224.835292.08830.315029.055294.975291.005291.455277.021. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power8001600240032004000SE +/- 13.56, N = 3SE +/- 4.78, N = 3SE +/- 6.58, N = 3SE +/- 155.56, N = 12SE +/- 4.65, N = 3SE +/- 1.43, N = 15SE +/- 113.70, N = 15SE +/- 6.01, N = 3SE +/- 3.54, N = 3SE +/- 3.07, N = 3SE +/- 8.08, N = 33621.583655.413663.481915.373678.91202.832062.043670.783679.313654.513645.601. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power8K16K24K32K40KSE +/- 1008.62, N = 15SE +/- 342.83, N = 5SE +/- 1216.09, N = 15SE +/- 946.71, N = 12SE +/- 1205.35, N = 12SE +/- 15.51, N = 3SE +/- 909.70, N = 12SE +/- 724.32, N = 12SE +/- 1139.15, N = 15SE +/- 1060.84, N = 15SE +/- 894.45, N = 1535666.6932979.7436248.3835501.2136428.765175.9633751.5835601.8336507.1135205.4736975.341. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: Crownacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.33, N = 7SE +/- 0.13, N = 7SE +/- 0.15, N = 7SE +/- 0.24, N = 7SE +/- 0.14, N = 7SE +/- 0.02, N = 3SE +/- 0.22, N = 7SE +/- 0.11, N = 7SE +/- 0.18, N = 7SE +/- 0.25, N = 7SE +/- 0.21, N = 6120.80123.05122.71121.86123.0219.67116.75123.15122.87122.50121.30MIN: 116.78 / MAX: 132.34MIN: 119.92 / MAX: 135.17MIN: 119.75 / MAX: 131.8MIN: 117.58 / MAX: 131.5MIN: 120.25 / MAX: 132.77MIN: 112.31 / MAX: 126.6MIN: 120.42 / MAX: 134.1MIN: 119.52 / MAX: 133.96MIN: 118.44 / MAX: 132.08MIN: 107.62 / MAX: 132.2

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: Asian Dragonacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.85, N = 6SE +/- 0.72, N = 15SE +/- 0.79, N = 6SE +/- 1.15, N = 15SE +/- 0.98, N = 15SE +/- 0.02, N = 3SE +/- 0.79, N = 15SE +/- 0.87, N = 15SE +/- 0.93, N = 15SE +/- 0.79, N = 15SE +/- 0.91, N = 1592.9591.3793.7692.8093.6124.7988.8094.7893.5092.2193.73MIN: 88.86 / MAX: 98.52MIN: 86.16 / MAX: 99.08MIN: 88.79 / MAX: 100.41MIN: 85.44 / MAX: 101.26MIN: 86.72 / MAX: 102.65MIN: 24.19 / MAX: 25.44MIN: 82.24 / MAX: 97.26MIN: 86.18 / MAX: 101.48MIN: 87.15 / MAX: 102.17MIN: 87.15 / MAX: 100.61MIN: 86.21 / MAX: 102.02

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Mediumacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power816243240SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 332.3632.0922.9730.3232.004.8314.3931.9932.3029.4220.661. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1224364860SE +/- 0.50, N = 5SE +/- 0.52, N = 5SE +/- 0.20, N = 4SE +/- 0.26, N = 4SE +/- 0.51, N = 5SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.60, N = 5SE +/- 0.44, N = 5SE +/- 0.60, N = 15SE +/- 1.49, N = 1554.7855.0352.3252.1753.777.4326.2154.6954.7747.9745.561. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1326395265SE +/- 0.48, N = 5SE +/- 0.48, N = 5SE +/- 0.44, N = 5SE +/- 0.50, N = 4SE +/- 0.11, N = 5SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.40, N = 5SE +/- 0.46, N = 5SE +/- 0.70, N = 15SE +/- 1.47, N = 1555.5855.9252.9352.6055.277.7226.5456.1455.8550.6741.831. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.94141.88282.82423.76564.707SE +/- 0.025, N = 3SE +/- 0.002, N = 3SE +/- 0.003, N = 3SE +/- 0.020, N = 3SE +/- 0.005, N = 3SE +/- 0.001, N = 3SE +/- 0.022, N = 3SE +/- 0.008, N = 3SE +/- 0.016, N = 3SE +/- 0.013, N = 3SE +/- 0.007, N = 34.0904.1824.0133.8654.1840.5583.3224.1584.1813.4532.4431. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power4080120160200SE +/- 3.33, N = 15SE +/- 3.08, N = 15SE +/- 2.84, N = 15SE +/- 2.56, N = 15SE +/- 3.27, N = 15SE +/- 0.49, N = 12SE +/- 1.29, N = 15SE +/- 3.08, N = 15SE +/- 2.85, N = 15SE +/- 2.85, N = 15SE +/- 1.61, N = 15180.33180.86167.61171.88182.3636.6590.28186.05173.31175.46155.771. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power4080120160200SE +/- 1.37, N = 10SE +/- 2.47, N = 15SE +/- 1.54, N = 15SE +/- 1.52, N = 7SE +/- 1.88, N = 15SE +/- 0.14, N = 3SE +/- 0.85, N = 15SE +/- 1.60, N = 7SE +/- 2.12, N = 15SE +/- 1.23, N = 12SE +/- 1.22, N = 6180.34189.13144.34161.78191.0532.2772.22194.10188.42170.27145.321. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Mediumacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power612182430SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 327.2026.9321.2124.5826.893.9712.2527.0127.0624.2817.33

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1122334455SE +/- 0.30, N = 4SE +/- 0.16, N = 4SE +/- 0.25, N = 4SE +/- 0.33, N = 4SE +/- 0.18, N = 4SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.22, N = 4SE +/- 0.28, N = 4SE +/- 0.28, N = 4SE +/- 0.58, N = 1545.1946.0740.7141.5745.416.7725.4346.2646.3139.9633.79

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1122334455SE +/- 0.30, N = 4SE +/- 0.21, N = 4SE +/- 0.18, N = 4SE +/- 0.19, N = 4SE +/- 0.49, N = 5SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.33, N = 4SE +/- 0.28, N = 4SE +/- 0.43, N = 4SE +/- 0.67, N = 1544.5046.4540.8241.9045.466.8821.6547.2546.0841.1333.76

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power48121620SE +/- 0.12, N = 15SE +/- 0.20, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 12SE +/- 0.26, N = 15SE +/- 0.01, N = 3SE +/- 0.04, N = 12SE +/- 0.27, N = 15SE +/- 0.41, N = 12SE +/- 0.12, N = 3SE +/- 0.14, N = 1510.7214.1714.368.4713.321.863.0613.3712.8311.637.951. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.91131.82262.73393.64524.5565SE +/- 0.014, N = 3SE +/- 0.005, N = 3SE +/- 0.007, N = 3SE +/- 0.009, N = 3SE +/- 0.021, N = 3SE +/- 0.002, N = 3SE +/- 0.009, N = 3SE +/- 0.011, N = 3SE +/- 0.018, N = 3SE +/- 0.023, N = 3SE +/- 0.011, N = 33.9744.0503.7673.6764.0210.5683.1364.0224.0233.3592.4711. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fasteracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power246810SE +/- 0.043, N = 3SE +/- 0.075, N = 3SE +/- 0.068, N = 3SE +/- 0.030, N = 3SE +/- 0.084, N = 4SE +/- 0.008, N = 3SE +/- 0.049, N = 3SE +/- 0.075, N = 3SE +/- 0.083, N = 4SE +/- 0.045, N = 3SE +/- 0.018, N = 37.3737.3207.3476.6467.3061.1576.2307.3977.3526.3264.7691. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power510152025SE +/- 0.17, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 319.9020.9620.6719.2920.744.3716.3620.5520.6318.5615.331. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.82, N = 9SE +/- 0.99, N = 3SE +/- 1.99, N = 9SE +/- 0.66, N = 3SE +/- 0.36, N = 3SE +/- 0.01, N = 3SE +/- 0.31, N = 3SE +/- 0.07, N = 3SE +/- 0.28, N = 3SE +/- 0.04, N = 3SE +/- 0.63, N = 694.6295.7179.3675.6997.5016.5436.5097.1296.7387.7565.63

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power918273645SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 340.0040.4239.2437.0340.898.7426.6340.1940.3938.4131.64

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power120240360480600SE +/- 4.59, N = 8SE +/- 1.76, N = 3SE +/- 6.96, N = 3SE +/- 3.61, N = 3SE +/- 6.51, N = 4SE +/- 1.20, N = 3SE +/- 5.51, N = 3SE +/- 1.76, N = 3SE +/- 4.37, N = 3SE +/- 4.72, N = 7SE +/- 2.08, N = 3524524531514534102468516512514477MIN: 148 / MAX: 1602MIN: 149 / MAX: 1516MIN: 153 / MAX: 1787MIN: 149 / MAX: 1600MIN: 153 / MAX: 1522MIN: 24 / MAX: 400MIN: 146 / MAX: 1159MIN: 150 / MAX: 1507MIN: 151 / MAX: 1504MIN: 148 / MAX: 1583MIN: 107 / MAX: 1723

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark Scalaracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power80160240320400SE +/- 1.76, N = 3SE +/- 4.13, N = 9SE +/- 4.33, N = 3SE +/- 3.76, N = 3SE +/- 3.95, N = 9SE +/- 0.33, N = 3SE +/- 2.31, N = 3SE +/- 3.82, N = 5SE +/- 1.20, N = 3SE +/- 6.08, N = 6SE +/- 2.19, N = 335736737636337472327374385364346MIN: 75 / MAX: 1532MIN: 73 / MAX: 1729MIN: 75 / MAX: 1829MIN: 73 / MAX: 1686MIN: 74 / MAX: 1559MIN: 11 / MAX: 516MIN: 72 / MAX: 1129MIN: 75 / MAX: 1552MIN: 75 / MAX: 1589MIN: 71 / MAX: 1707MIN: 62 / MAX: 1800

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1632486480SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 372.7773.1673.1072.5272.9112.9770.7572.9573.0672.8572.80

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 1.23, N = 3SE +/- 1.66, N = 3SE +/- 0.68, N = 3SE +/- 0.27, N = 3SE +/- 1.11, N = 3SE +/- 0.06, N = 3SE +/- 0.59, N = 3SE +/- 2.48, N = 3SE +/- 1.42, N = 3SE +/- 3.90, N = 3SE +/- 0.75, N = 3929.79928.54932.00931.20930.49215.52897.64929.79931.58926.20931.60

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power70140210280350SE +/- 0.62, N = 3SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.48, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.30, N = 3SE +/- 0.37, N = 3308.68310.61310.09309.60310.3056.66299.57310.43310.74310.30309.38

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 0.36, N = 3SE +/- 0.15, N = 3SE +/- 0.60, N = 3SE +/- 0.34, N = 3SE +/- 0.37, N = 3SE +/- 0.15, N = 3SE +/- 0.49, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 3403.28404.13404.27401.73404.3070.87388.64404.95404.55403.29403.59

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 1.55, N = 3SE +/- 0.63, N = 3SE +/- 0.64, N = 3SE +/- 1.55, N = 3SE +/- 1.41, N = 3SE +/- 0.17, N = 3SE +/- 0.84, N = 3SE +/- 1.68, N = 3SE +/- 1.26, N = 3SE +/- 1.36, N = 3SE +/- 1.08, N = 3829.17828.82828.90834.46830.85147.69809.90830.01830.32830.10829.60

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power130260390520650SE +/- 0.14, N = 3SE +/- 0.68, N = 3SE +/- 1.19, N = 3SE +/- 0.13, N = 3SE +/- 0.82, N = 3SE +/- 0.09, N = 3SE +/- 1.22, N = 3SE +/- 0.26, N = 3SE +/- 0.35, N = 3SE +/- 0.85, N = 3SE +/- 0.24, N = 3608.30609.04609.76607.33609.96109.77587.48609.61610.32610.70609.90

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.20, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3107.90108.16108.13107.47108.4018.20104.89108.20108.11108.20108.15

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power70140210280350SE +/- 0.60, N = 3SE +/- 0.69, N = 3SE +/- 0.63, N = 3SE +/- 0.22, N = 3SE +/- 0.44, N = 3SE +/- 0.07, N = 3SE +/- 0.78, N = 3SE +/- 0.82, N = 3SE +/- 0.09, N = 3SE +/- 0.63, N = 3SE +/- 0.25, N = 3306.68307.17307.72306.40307.2755.22297.14307.64307.89307.04307.71

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1632486480SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 372.7873.2573.0372.4173.2713.0071.0172.9473.1473.0273.05

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression Speedacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power48121620SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.16, N = 5SE +/- 0.03, N = 317.5017.5017.4017.2017.601.9717.1017.6017.5016.0015.201. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression Speedacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power30060090012001500SE +/- 1.32, N = 3SE +/- 0.97, N = 3SE +/- 2.01, N = 3SE +/- 5.25, N = 3SE +/- 28.63, N = 3SE +/- 0.03, N = 3SE +/- 1.88, N = 3SE +/- 4.93, N = 3SE +/- 6.13, N = 3SE +/- 3.84, N = 5SE +/- 2.19, N = 31264.71272.81270.91280.51188.1146.11261.81278.61276.21278.31269.81. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression Speedacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power3691215SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 39.219.129.299.139.311.069.209.289.268.918.721. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression Speedacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power30060090012001500SE +/- 11.09, N = 3SE +/- 7.61, N = 3SE +/- 9.03, N = 3SE +/- 11.54, N = 3SE +/- 18.37, N = 3SE +/- 0.15, N = 3SE +/- 1.07, N = 3SE +/- 7.42, N = 3SE +/- 5.97, N = 3SE +/- 1.23, N = 3SE +/- 20.88, N = 31203.21209.11203.21178.01171.2140.11191.51203.61203.31195.01186.01. (CC) gcc options: -O3 -pthread -lz -llzma

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power110K220K330K440K550KSE +/- 6757.49, N = 3SE +/- 5372.93, N = 6SE +/- 3716.48, N = 3SE +/- 2092.51, N = 3SE +/- 6313.35, N = 3SE +/- 1055.88, N = 3SE +/- 3670.50, N = 7SE +/- 5053.05, N = 3SE +/- 5870.22, N = 4SE +/- 480.40, N = 3SE +/- 3758.30, N = 35070395282894758614853875306891009703949825223485144435004714596171. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power160K320K480K640K800KSE +/- 1725.95, N = 3SE +/- 2437.88, N = 6SE +/- 156.12, N = 3SE +/- 1773.36, N = 3SE +/- 2158.20, N = 3SE +/- 136.02, N = 3SE +/- 2716.47, N = 7SE +/- 18690.79, N = 3SE +/- 10875.45, N = 4SE +/- 858.55, N = 3SE +/- 5960.12, N = 37400397429557485497390167463761042876992287265217338827167036614201. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_bareacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power3691215SE +/- 0.125, N = 15SE +/- 0.018, N = 3SE +/- 0.046, N = 3SE +/- 0.448, N = 15SE +/- 0.036, N = 3SE +/- 0.004, N = 3SE +/- 0.601, N = 12SE +/- 0.057, N = 3SE +/- 0.065, N = 3SE +/- 0.032, N = 3SE +/- 0.019, N = 310.85311.12511.1739.55011.0532.1678.48211.17911.07411.07911.1311. (CXX) g++ options: -O3

CockroachDB

Workload: MoVR - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power170340510680850SE +/- 3.24, N = 3SE +/- 3.30, N = 3SE +/- 0.92, N = 3SE +/- 4.45, N = 3SE +/- 1.79, N = 3SE +/- 0.42, N = 3SE +/- 2.51, N = 15SE +/- 1.59, N = 3SE +/- 2.65, N = 3SE +/- 2.27, N = 3SE +/- 1.71, N = 3698.0765.2438.2574.8766.8126.8195.9761.0763.4641.8570.5

CockroachDB

Workload: KV, 10% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power11K22K33K44K55KSE +/- 590.54, N = 4SE +/- 577.32, N = 3SE +/- 524.19, N = 15SE +/- 457.69, N = 6SE +/- 526.94, N = 3SE +/- 162.55, N = 3SE +/- 410.53, N = 15SE +/- 504.99, N = 3SE +/- 207.31, N = 3SE +/- 451.19, N = 3SE +/- 530.33, N = 449459.949731.947827.045780.349340.411461.441485.550217.249015.544725.543287.2

CockroachDB

Workload: KV, 95% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 512acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20K40K60K80K100KSE +/- 1583.45, N = 15SE +/- 373.82, N = 3SE +/- 1766.85, N = 15SE +/- 1169.53, N = 15SE +/- 1631.30, N = 15SE +/- 36.89, N = 3SE +/- 1298.96, N = 15SE +/- 262.84, N = 3SE +/- 465.83, N = 3SE +/- 1522.12, N = 15SE +/- 99.42, N = 381782.386045.279962.275334.782071.416811.872179.686214.886477.375876.474380.0

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cacheacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 3.45, N = 3SE +/- 3.06, N = 3SE +/- 1.22, N = 3SE +/- 0.46, N = 3SE +/- 0.63, N = 3SE +/- 0.36, N = 3SE +/- 2.12, N = 3SE +/- 4.76, N = 3SE +/- 2.11, N = 3SE +/- 1.39, N = 3SE +/- 0.77, N = 3351.39393.15351.21297.77394.3266.81252.79395.53392.95355.12339.68MIN: 47.54 / MAX: 2857.14MIN: 50.63 / MAX: 3750MIN: 49.63 / MAX: 4000MIN: 44.15 / MAX: 2068.97MIN: 48.47 / MAX: 3750MIN: 43.29 / MAX: 4000MIN: 48.98 / MAX: 4000MIN: 51.28 / MAX: 3750MIN: 43.45 / MAX: 4000MIN: 39.27 / MAX: 3157.89

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Runacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 2.51, N = 3SE +/- 3.72, N = 3SE +/- 0.20, N = 3SE +/- 2.11, N = 3SE +/- 4.90, N = 3SE +/- 0.06, N = 3SE +/- 3.86, N = 3SE +/- 4.88, N = 3SE +/- 1.07, N = 3SE +/- 3.92, N = 3SE +/- 1.73, N = 3357.63410.46362.27306.46404.9575.86254.40409.86407.73373.47349.30MIN: 57.8 / MAX: 3529.41MIN: 58.42 / MAX: 4615.38MIN: 50.98 / MAX: 4615.38MIN: 50.98 / MAX: 2222.22MIN: 54.05 / MAX: 4285.71MIN: 47.85 / MAX: 4285.71MIN: 57.64 / MAX: 4285.71MIN: 56.66 / MAX: 4285.71MIN: 52.86 / MAX: 3750MIN: 45.25 / MAX: 4000

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Runacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 2.12, N = 3SE +/- 1.10, N = 3SE +/- 1.95, N = 3SE +/- 0.84, N = 3SE +/- 2.49, N = 3SE +/- 0.60, N = 3SE +/- 2.60, N = 3SE +/- 1.36, N = 3SE +/- 3.27, N = 3SE +/- 3.70, N = 3SE +/- 2.43, N = 3357.94401.81352.85310.66406.4176.66251.84406.99394.98372.98353.17MIN: 56.71 / MAX: 2857.14MIN: 56.71 / MAX: 3333.33MIN: 50.59 / MAX: 3529.41MIN: 51.28 / MAX: 2222.22MIN: 52.77 / MAX: 3529.41MIN: 8.52 / MAX: 588.24MIN: 48.15 / MAX: 3157.89MIN: 53.29 / MAX: 3333.33MIN: 57.97 / MAX: 3529.41MIN: 54.1 / MAX: 4285.71MIN: 44.91 / MAX: 3000

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.53261.06521.59782.13042.663SE +/- 0.003977, N = 3SE +/- 0.015239, N = 3SE +/- 0.001977, N = 3SE +/- 0.009049, N = 3SE +/- 0.008972, N = 3SE +/- 0.000425, N = 3SE +/- 0.011706, N = 12SE +/- 0.005634, N = 3SE +/- 0.031447, N = 3SE +/- 0.017556, N = 15SE +/- 0.042633, N = 122.3267702.3670742.3461121.3585492.3630700.3014500.8114182.3480792.3464472.0592591.8012381. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power30K60K90K120K150KSE +/- 977.04, N = 3SE +/- 693.20, N = 3SE +/- 1781.93, N = 4SE +/- 208.90, N = 3SE +/- 684.93, N = 3SE +/- 131.35, N = 3SE +/- 115.95, N = 3SE +/- 1361.88, N = 3SE +/- 2024.19, N = 3SE +/- 1575.56, N = 5SE +/- 1620.42, N = 5149876.52147285.78146083.16122126.56151325.0127774.70138510.00147764.25152654.86146738.16145614.761. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark Suiteacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power150K300K450K600K750KSE +/- 5594.67, N = 3SE +/- 4034.04, N = 3SE +/- 2191.80, N = 3SE +/- 5843.40, N = 3SE +/- 3225.60, N = 3SE +/- 423.55, N = 3SE +/- 5021.57, N = 3SE +/- 5808.55, N = 12SE +/- 4455.74, N = 3SE +/- 2423.31, N = 3SE +/- 981.48, N = 370821869981669878570534170121579570711125697478700287687682671207

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power300K600K900K1200K1500KSE +/- 16168.04, N = 3SE +/- 16034.65, N = 4SE +/- 24805.29, N = 12SE +/- 38153.01, N = 12SE +/- 2192.30, N = 3SE +/- 3162.32, N = 6SE +/- 23969.59, N = 12SE +/- 10261.05, N = 3SE +/- 10272.10, N = 3SE +/- 28243.17, N = 11SE +/- 16514.38, N = 31124224128590512914711037703131183731848063608813060991286042128855012927981. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power300K600K900K1200K1500KSE +/- 11695.71, N = 4SE +/- 8479.39, N = 3SE +/- 716.94, N = 3SE +/- 36540.35, N = 12SE +/- 9347.57, N = 3SE +/- 2702.31, N = 8SE +/- 21438.85, N = 12SE +/- 15062.87, N = 3SE +/- 7684.39, N = 3SE +/- 8403.56, N = 3SE +/- 2388.78, N = 3107450012348691258066997742126868831736070492912417261240406124826612459141. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power300K600K900K1200K1500KSE +/- 3711.22, N = 3SE +/- 9650.25, N = 3SE +/- 5317.94, N = 3SE +/- 40789.54, N = 12SE +/- 13365.19, N = 3SE +/- 1792.34, N = 3SE +/- 20475.53, N = 12SE +/- 7063.00, N = 3SE +/- 6415.45, N = 3SE +/- 5837.45, N = 3SE +/- 3162.21, N = 3108279412026371237871955977123084131224571498012090331226743120754012264291. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Writeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power8K16K24K32K40KSE +/- 904.79, N = 12SE +/- 531.49, N = 12SE +/- 523.79, N = 12SE +/- 2388.98, N = 12SE +/- 539.21, N = 12SE +/- 295.83, N = 12SE +/- 1491.09, N = 12SE +/- 2742.94, N = 12SE +/- 524.88, N = 12SE +/- 508.85, N = 12SE +/- 497.87, N = 122934733019280163248632858668619298356103228628873286821. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Writeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power6K12K18K24K30KSE +/- 234.54, N = 3SE +/- 343.31, N = 3SE +/- 213.86, N = 12SE +/- 148.91, N = 3SE +/- 225.23, N = 12SE +/- 60.47, N = 12SE +/- 766.72, N = 9SE +/- 272.14, N = 3SE +/- 307.60, N = 4SE +/- 216.59, N = 3SE +/- 233.05, N = 122349327093237431905627880546512397268302759624275241731. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Writeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power6K12K18K24K30KSE +/- 157.83, N = 3SE +/- 72.30, N = 3SE +/- 232.73, N = 12SE +/- 179.41, N = 3SE +/- 63.64, N = 3SE +/- 29.56, N = 3SE +/- 734.11, N = 9SE +/- 174.68, N = 12SE +/- 207.97, N = 3SE +/- 214.70, N = 3SE +/- 224.57, N = 32227925252225671787524904497312613242992608521978215221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance Metricacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power600K1200K1800K2400K3000K28142692921572302117128637422815356405614283650429051812980719285398328639511. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 Atomsacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.31720.63440.95161.26881.586SE +/- 0.00142, N = 3SE +/- 0.00089, N = 4SE +/- 0.00170, N = 3SE +/- 0.00244, N = 3SE +/- 0.00077, N = 4SE +/- 0.00490, N = 3SE +/- 0.00054, N = 3SE +/- 0.00158, N = 4SE +/- 0.00124, N = 4SE +/- 0.00272, N = 3SE +/- 0.00042, N = 30.222900.224410.220250.222890.224641.409820.234200.222700.220210.222860.22450

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test Timesacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2K4K6K8K10KSE +/- 9.13, N = 3SE +/- 5.81, N = 3SE +/- 7.81, N = 3SE +/- 5.81, N = 3SE +/- 3.28, N = 3SE +/- 41.93, N = 3SE +/- 2.85, N = 3SE +/- 6.01, N = 3SE +/- 4.04, N = 3SE +/- 0.88, N = 3SE +/- 7.22, N = 310061002999100410108775987998101010031008

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Traceracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power14K28K42K56K70KSE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 2.85, N = 3SE +/- 2.03, N = 3SE +/- 1.15, N = 3SE +/- 875.42, N = 12SE +/- 0.88, N = 3SE +/- 1.33, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 0.67, N = 31120110411031118109867000116611031101110111021. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Traceracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power15K30K45K60K75KSE +/- 2.19, N = 3SE +/- 1.45, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 1.45, N = 3SE +/- 831.01, N = 12SE +/- 1.15, N = 3SE +/- 2.03, N = 3SE +/- 2.08, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 31322130613061322130068548137612991302130413031. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Traceracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60K120K180K240K300KSE +/- 25.51, N = 3SE +/- 117.33, N = 3SE +/- 88.76, N = 3SE +/- 52.33, N = 3SE +/- 23.07, N = 3SE +/- 829.19, N = 3SE +/- 66.07, N = 3SE +/- 76.22, N = 3SE +/- 31.26, N = 3SE +/- 29.34, N = 3SE +/- 69.50, N = 3356283540635505354403518629174336976355733521035438352431. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Traceracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power70K140K210K280K350KSE +/- 28.29, N = 3SE +/- 98.82, N = 3SE +/- 70.48, N = 3SE +/- 85.87, N = 3SE +/- 83.21, N = 3SE +/- 671.47, N = 3SE +/- 7.42, N = 3SE +/- 58.85, N = 3SE +/- 36.04, N = 3SE +/- 62.74, N = 3SE +/- 90.34, N = 3422644185942130418974158833295043705416504168641798415321. (CXX) g++ options: -O3 -lm -ldl

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.35350.7071.06051.4141.7675SE +/- 0.006, N = 3SE +/- 0.005, N = 4SE +/- 0.009, N = 12SE +/- 0.020, N = 12SE +/- 0.001, N = 3SE +/- 0.016, N = 6SE +/- 0.025, N = 12SE +/- 0.003, N = 3SE +/- 0.003, N = 3SE +/- 0.010, N = 11SE +/- 0.005, N = 30.4450.3890.3890.4900.3811.5710.7960.3830.3890.3900.3871. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.56751.1351.70252.272.8375SE +/- 0.008, N = 4SE +/- 0.004, N = 3SE +/- 0.001, N = 3SE +/- 0.033, N = 12SE +/- 0.005, N = 3SE +/- 0.022, N = 8SE +/- 0.033, N = 12SE +/- 0.008, N = 3SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.001, N = 30.7450.6480.6360.8150.6302.5221.1460.6440.6450.6410.6421. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.72071.44142.16212.88283.6035SE +/- 0.003, N = 3SE +/- 0.006, N = 3SE +/- 0.004, N = 3SE +/- 0.048, N = 12SE +/- 0.009, N = 3SE +/- 0.018, N = 3SE +/- 0.040, N = 12SE +/- 0.005, N = 3SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.002, N = 30.9240.8320.8081.0690.8123.2031.4110.8270.8150.8280.8151. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.46, N = 12SE +/- 0.23, N = 12SE +/- 0.30, N = 12SE +/- 1.31, N = 12SE +/- 0.22, N = 12SE +/- 2.49, N = 12SE +/- 2.25, N = 12SE +/- 0.71, N = 12SE +/- 0.24, N = 12SE +/- 0.28, N = 12SE +/- 0.28, N = 1217.1915.1817.9116.4415.2675.9827.7414.6415.5317.3717.491. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.34, N = 3SE +/- 0.37, N = 3SE +/- 0.30, N = 12SE +/- 0.33, N = 3SE +/- 0.24, N = 12SE +/- 1.56, N = 12SE +/- 3.77, N = 9SE +/- 0.30, N = 3SE +/- 0.32, N = 4SE +/- 0.29, N = 3SE +/- 0.32, N = 1234.0629.5433.7241.9928.72146.5766.3929.8229.0032.9633.131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power4080120160200SE +/- 0.32, N = 3SE +/- 0.11, N = 3SE +/- 0.45, N = 12SE +/- 0.57, N = 3SE +/- 0.10, N = 3SE +/- 1.19, N = 3SE +/- 4.17, N = 9SE +/- 0.30, N = 12SE +/- 0.31, N = 3SE +/- 0.45, N = 3SE +/- 0.48, N = 344.8939.6044.3655.9540.16201.1081.1941.1838.3445.5146.471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power5K10K15K20K25KSE +/- 2.84, N = 3SE +/- 4.16, N = 3SE +/- 5.84, N = 3SE +/- 15.80, N = 3SE +/- 4.79, N = 3SE +/- 217.31, N = 3SE +/- 8.81, N = 3SE +/- 8.61, N = 3SE +/- 9.11, N = 3SE +/- 4.72, N = 3SE +/- 6.67, N = 34041.314032.104054.304103.644030.7924236.974262.294015.914005.034030.034033.63MIN: 18903.29 / MAX: 30172.21. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power16003200480064008000SE +/- 0.25, N = 3SE +/- 0.38, N = 3SE +/- 1.11, N = 3SE +/- 0.24, N = 3SE +/- 0.68, N = 3SE +/- 16.67, N = 3SE +/- 0.52, N = 3SE +/- 0.45, N = 3SE +/- 8.32, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 31203.421195.141195.761210.761195.237565.211260.491195.601203.521195.351199.87MIN: 7058.85 / MAX: 8272.071. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 3.03, N = 15SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 2.29, N = 12SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 317.3317.0917.0936.3517.05107.1746.4917.0617.0717.1017.14MIN: 9.07 / MAX: 83.28MIN: 9.82 / MAX: 80.61MIN: 9.24 / MAX: 81.88MIN: 7.98 / MAX: 137.61MIN: 9.39 / MAX: 80.76MIN: 59.84 / MAX: 344.36MIN: 8.5 / MAX: 147.24MIN: 9.02 / MAX: 83.41MIN: 8.56 / MAX: 80.26MIN: 9.33 / MAX: 84.63MIN: 9.37 / MAX: 88.861. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power30060090012001500SE +/- 1.01, N = 3SE +/- 0.97, N = 3SE +/- 1.21, N = 3SE +/- 0.15, N = 3SE +/- 0.54, N = 3SE +/- 7.94, N = 15SE +/- 0.48, N = 3SE +/- 1.09, N = 3SE +/- 2.12, N = 3SE +/- 0.82, N = 3SE +/- 0.51, N = 3241.17238.32239.94228.75239.021229.86240.82239.29239.70239.05238.16MIN: 599.82 / MAX: 5117.071. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 324.3624.1724.1724.4824.17153.7825.4324.1624.1724.1724.24MIN: 78.56 / MAX: 301.881. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power70140210280350SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 2.27, N = 12SE +/- 0.02, N = 3SE +/- 2.16, N = 15SE +/- 1.86, N = 15SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 317.6517.4817.4435.3917.37315.2632.4217.4117.3717.4917.53MIN: 86.78 / MAX: 701.541. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power612182430SE +/- 0.10, N = 15SE +/- 0.04, N = 5SE +/- 0.11, N = 15SE +/- 0.10, N = 12SE +/- 0.12, N = 12SE +/- 0.07, N = 3SE +/- 0.11, N = 12SE +/- 0.07, N = 12SE +/- 0.10, N = 15SE +/- 0.10, N = 15SE +/- 0.09, N = 153.443.723.413.403.3924.553.553.453.383.513.32MIN: 5.27 / MAX: 260.671. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power10002000300040005000SE +/- 0.08, N = 3SE +/- 0.34, N = 3SE +/- 0.13, N = 3SE +/- 0.23, N = 3SE +/- 0.55, N = 3SE +/- 3.96, N = 3SE +/- 0.52, N = 3SE +/- 0.32, N = 3SE +/- 0.36, N = 3SE +/- 0.37, N = 3SE +/- 0.34, N = 3872.89869.19868.82876.50867.904864.70895.13868.87868.26869.22868.92

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.28, N = 3SE +/- 0.05, N = 368.7168.7768.5568.6068.65295.4971.1668.7168.5868.9268.56

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.31, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.01, N = 3SE +/- 1.11, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 3206.45205.28205.49206.14205.411124.30212.63205.42205.30205.68205.70

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 1.48, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3158.05157.88157.83158.95157.80884.29164.20157.55157.70158.13158.08

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 377.0177.0677.1076.5776.91431.9678.8776.9876.9176.9977.02

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power120240360480600SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.31, N = 3SE +/- 0.25, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3105.02104.80104.75105.15104.73577.77108.66104.76104.62104.57104.66

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power7001400210028003500SE +/- 0.20, N = 3SE +/- 0.22, N = 3SE +/- 0.24, N = 3SE +/- 0.30, N = 3SE +/- 0.41, N = 3SE +/- 0.92, N = 3SE +/- 0.38, N = 3SE +/- 0.13, N = 3SE +/- 0.23, N = 3SE +/- 0.37, N = 3SE +/- 0.15, N = 3588.61587.38587.78589.69586.863485.21605.67587.84587.61587.74587.78

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.26, N = 3SE +/- 0.28, N = 3SE +/- 0.52, N = 3SE +/- 0.15, N = 3SE +/- 0.30, N = 3SE +/- 0.96, N = 3SE +/- 0.54, N = 3SE +/- 0.48, N = 3SE +/- 0.11, N = 3SE +/- 0.29, N = 3SE +/- 0.11, N = 3207.88207.58207.27208.09207.671143.06214.47207.44207.19207.61207.33

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power10002000300040005000SE +/- 0.15, N = 3SE +/- 0.69, N = 3SE +/- 0.11, N = 3SE +/- 0.56, N = 3SE +/- 0.10, N = 3SE +/- 2.96, N = 3SE +/- 0.79, N = 3SE +/- 0.23, N = 3SE +/- 0.76, N = 3SE +/- 0.33, N = 3SE +/- 0.24, N = 3872.07867.83866.62876.33866.964868.11893.43867.93866.98868.08867.02

Xcompact3d Incompact3d

Input: X3D-benchmarking input.i3d

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power120240360480600SE +/- 0.74, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.67, N = 3SE +/- 0.86, N = 3SE +/- 0.43, N = 3SE +/- 0.30, N = 3SE +/- 1.22, N = 3SE +/- 0.44, N = 3SE +/- 0.99, N = 3SE +/- 0.28, N = 3264.80263.63263.63262.40265.31540.54267.54264.59264.82264.91263.301. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh Timeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power170340510680850120.10115.76116.44119.63116.11773.97127.86114.87116.19116.05116.281. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution Timeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power170340510680850169.00164.04166.48167.90168.80773.03182.44170.71167.82167.41169.251. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compileacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 1.68, N = 4SE +/- 0.41, N = 3SE +/- 1.73, N = 3SE +/- 1.36, N = 3SE +/- 0.56, N = 3SE +/- 13.66, N = 3SE +/- 1.72, N = 3SE +/- 1.78, N = 3SE +/- 0.95, N = 3SE +/- 1.30, N = 3SE +/- 1.51, N = 8152.99147.00149.22153.90146.641100.36156.95149.77148.50157.10173.20

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To Compileacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 0.38, N = 3SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.12, N = 3SE +/- 0.46, N = 3SE +/- 1.50, N = 3SE +/- 0.30, N = 15SE +/- 0.05, N = 3SE +/- 0.27, N = 3SE +/- 0.44, N = 3SE +/- 0.43, N = 338.3737.3837.5840.8137.05258.8741.9437.3237.0141.9047.94

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.17, N = 14SE +/- 0.14, N = 13SE +/- 0.14, N = 13SE +/- 0.21, N = 15SE +/- 0.18, N = 10SE +/- 1.30, N = 9SE +/- 0.23, N = 14SE +/- 0.15, N = 13SE +/- 0.14, N = 15SE +/- 0.16, N = 13SE +/- 0.24, N = 1323.4422.6522.6124.5222.52156.7825.3922.6222.5325.5230.83

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.85, N = 3SE +/- 0.71, N = 3SE +/- 0.77, N = 3SE +/- 1.27, N = 3SE +/- 0.72, N = 3SE +/- 2.74, N = 3SE +/- 1.59, N = 3SE +/- 0.74, N = 3SE +/- 0.76, N = 3SE +/- 0.78, N = 3SE +/- 0.62, N = 3174.95173.63172.61177.06173.641094.37182.77172.88172.86176.50184.47

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To Compileacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power160320480640800SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.88, N = 3SE +/- 0.24, N = 3SE +/- 0.15, N = 3SE +/- 0.19, N = 3SE +/- 0.68, N = 3SE +/- 0.22, N = 3107.14105.54106.47109.81104.93752.99113.13105.53105.83111.95120.48

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 337.9237.7137.6137.8537.73254.4640.0437.6837.5737.9438.35

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 319.0019.0118.9019.1818.89124.4820.2618.8018.9519.1719.74

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.28, N = 3SE +/- 0.24, N = 3SE +/- 0.10, N = 3SE +/- 0.78, N = 3SE +/- 0.32, N = 3SE +/- 0.14, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 3SE +/- 0.33, N = 3141.98140.45140.55141.91140.35933.41147.46140.18140.36141.79143.04

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 3SE +/- 0.71, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.42, N = 345.9245.8545.9546.1945.77297.6748.4945.7245.7545.9946.73

Phoronix Test Suite v10.8.5