AMD P-State Linux 6.3 Testing

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2302279-NE-AMDPSTATE10.

AMD P-State Linux 6.3 TestingProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen Resolutionamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2 x AMD EPYC 7773X 64-Core @ 3.53GHz (128 Cores / 256 Threads)AMD DAYTONA_X (RYM1009B BIOS)AMD Starship/Matisse512GB800GB INTEL SSDPF21Q800GBASPEEDVE2282 x Mellanox MT27710Ubuntu 22.046.2.0-phx (x86_64)GNOME Shell 42.5X Server 1.21.1.31.3.224GCC 11.3.0 + LLVM 14.0.0ext41920x10802 x AMD EPYC 7773X 64-Core @ 2.20GHz (128 Cores / 256 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- amd_pstate_epp powersave balance_performance: Scaling Governor: amd_pstate_epp powersave (EPP: balance_performance) - CPU Microcode: 0xa001229- amd_pstate_epp performance balance_performance: Scaling Governor: amd_pstate_epp performance (EPP: performance) - CPU Microcode: 0xa001229- amd_pstate_epp powersave power: Scaling Governor: amd_pstate_epp powersave (EPP: power) - CPU Microcode: 0xa001229- amd_pstate_epp performance performance: Scaling Governor: amd_pstate_epp performance (EPP: performance) - CPU Microcode: 0xa001229- amd_pstate schedutil: Scaling Governor: amd-pstate schedutil (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate performance: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate powersave: Scaling Governor: amd-pstate powersave (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate ondemand: Scaling Governor: amd-pstate ondemand (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq schedutil: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq ondemand: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq performance: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001229Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD P-State Linux 6.3 Testingnamd: ATPase Simulation - 327,506 Atomsincompact3d: X3D-benchmarking input.i3dopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timecompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedcompress-zstd: 19, Long Mode - Decompression Speedembree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastvpxenc: Speed 5 - Bosphorus 4Kvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fasterx265: Bosphorus 4Kopenvkl: vklBenchmark ISPCopenvkl: vklBenchmark Scalarcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingstargate: 192000 - 1024build-gem5: Time To Compilebuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-nodejs: Time To Compileospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracerclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runcockroach: MoVR - 512cockroach: KV, 10% Reads - 512cockroach: KV, 95% Reads - 512gromacs: MPI CPU - water_GMX50_barepgbench: 100 - 500 - Read Onlypgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 800 - Read Onlypgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlypgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 500 - Read Writepgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 800 - Read Writepgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Write - Average Latencytensorflow: CPU - 256 - AlexNettensorflow: CPU - 256 - GoogLeNetdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUpybench: Total For Average Test Timesnginx: 500phpbench: PHP Benchmark Suitebrl-cad: VGR Performance Metricamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.22286264.910481116.05227167.40916.01278.38.911195.0122.501492.206429.4247.9750.673.453175.455170.26524.2839.9641.1311.633.3596.32618.565143645004717167032.059259157.10241.89825.521176.495111.949110113043543841798355.12373.47372.98641.844725.575876.411.07912885500.39012482660.64112075400.8282887317.3722427532.9612197845.50987.7538.4172.8451869.2150926.202868.9182310.296205.6828403.291158.1292830.096776.9866610.7001104.5730108.1971587.7380307.0385207.611473.0239868.075637.9419.17141.7945.9915.524030.0353.091195.353738.0417.10267.15239.055291.4524.173654.5117.4935205.473.511003146738.1668768228539830.22270264.590464114.86885170.7147817.61278.69.281203.6123.145894.784131.9954.6956.144.158186.048194.10327.0146.2647.2513.374.0227.39720.555163745223487265212.348079149.76737.32122.623172.884105.529110312993557341650395.53409.86406.99761.050217.286214.811.17913060990.38312417260.64412090330.8273561014.6382683029.8232429941.17797.1240.1972.9497868.8719929.789468.7056310.4330205.4179404.9534157.5501830.013176.9790609.6137104.7553108.1954587.8421307.6420207.437772.9379867.927537.6818.80140.1845.7215.544015.9153.071195.603748.1717.06266.96239.295294.9724.163670.7817.4135601.833.45998147764.2569747829051810.22450263.300232116.28282169.2499215.21269.88.721186.0121.297093.727920.6645.5641.832.443155.770145.32317.3333.7933.767.952.4714.76915.334773464596176614201.801238173.20147.93530.833184.470120.483110213033524341532339.68349.30353.17570.543287.274380.011.13112927980.38712459140.64212264290.8152868217.4862417333.1292152246.47465.6331.6472.7952868.9246931.600568.5591309.3788205.6999403.5860158.0751829.603577.0202609.8987104.6604108.1498587.7795307.7129207.332873.0501867.019938.3519.74143.0446.7315.504033.6352.911199.873730.6617.14268.24238.165277.0224.243645.6017.5336975.343.321008145614.7667120728639510.22021264.824544116.19384167.8186417.51276.29.261203.3122.872993.501232.3054.7755.854.181173.314188.42327.0646.3146.0812.834.0237.35220.635123855144437338822.346447148.50337.01122.530172.857105.825110113023521041686392.95407.73394.98763.449015.586477.311.07412860420.38912404060.64512267430.8153228615.5292759629.0002608538.34196.7340.3973.0561868.2616931.582168.5813310.7448205.3031404.5464157.7002830.324176.9051610.3155104.6233108.1144587.6097307.8920207.185373.1372866.981837.5718.95140.3645.7515.554005.0352.791203.523744.8517.07266.56239.705291.0024.173679.3117.3736507.113.381010152654.8670028729807190.23420267.536092127.85527182.4368917.11261.89.201191.5116.753088.802214.3926.2126.543.32290.27772.22112.2525.4321.653.063.1366.23016.364683273949826992280.811418156.94541.94025.392182.768113.131116613763697643705252.79254.40251.84195.941485.572179.68.4826360880.7967049291.1467149801.4111929827.7441239766.3871261381.19236.5026.6370.7499895.1272897.637571.1617299.5680212.6277388.6392164.2008809.904878.8686587.4762108.6614104.8933605.6728297.1387214.472971.0074893.428240.0420.26147.4648.4914.634262.2950.351260.491416.7746.49265.31240.825029.0525.432062.0432.4233751.583.55987138510.0071112528365040.22464265.312622116.10875168.79917.61188.19.311171.2123.024893.605032.0053.7755.274.184182.358191.04626.8945.4145.4613.324.0217.30620.745343745306897463762.363070146.64437.05322.519173.636104.934109813003518641588394.32404.95406.41766.849340.482071.411.05313118370.38112686880.63012308410.8123285815.2572788028.7152490440.15597.5040.8972.9079867.8993930.493268.6499310.3004205.4057404.2950157.7992830.851976.9068609.9637104.7278108.4041586.8584307.2669207.674173.2692866.959537.7318.89140.3545.7715.524030.7953.031195.233749.6917.05267.30239.025292.0824.173678.9117.3736428.763.391010151325.0170121528153561.40982540.544881773.96684773.032831.97146.11.06140.119.668524.79174.837.437.720.55836.64732.2653.976.776.881.860.5681.1574.37102721009701042870.3014501100.363258.873156.7831094.374752.986670006854829174333295066.8175.8676.66126.811461.416811.82.1673184801.5713173602.5223122453.203668675.9845465146.5724973201.10116.548.7412.96834864.7028215.5167295.491856.65821124.304670.8684884.2913147.6880431.9597109.7693577.768818.20483485.212955.22451143.055513.00284868.1057254.46124.48933.41297.672.5424236.978.387565.21596.04107.1751.521229.86830.31153.78202.83315.265175.9624.55877527774.70795704056140.22289262.403117119.63471167.9049117.21280.59.131178.0121.857692.800430.3252.1752.603.865171.877161.77824.5841.5741.908.473.6766.64619.295143634853877390161.358549153.90340.81224.520177.063109.813111813223544041897297.77306.46310.66574.845780.375334.79.55010377030.4909977420.8159559771.0693248616.4361905641.9881787555.95475.6937.0372.5195876.4961931.203268.5979309.5958206.1379401.7313158.9464834.463876.5661607.3304105.1513107.4707589.6910306.3994208.091072.4101876.332137.8519.18141.9146.1915.244103.6452.481210.761960.3036.35279.33228.755224.8324.481915.3735.3935501.213.401004122126.5670534128637420.22025263.625285116.43538166.4756617.41270.99.291203.2122.705593.761522.9752.3252.934.013167.611144.34221.2140.7140.8214.363.7677.34720.675313764758617485492.346112149.22237.57622.610172.606106.466110313063550542130351.21362.27352.85438.247827.079962.211.17312914710.38912580660.63612378710.8082801617.9092374333.7232256744.36479.3639.2473.1026868.8157932.002768.5451310.0940205.4931404.2730157.8251828.896677.0980609.7624104.7469108.1330587.7789307.7165207.271173.0290866.622337.6118.90140.5545.9515.414054.3053.061195.763741.0617.09266.14239.945292.4224.173663.4817.4436248.383.41999146083.1669878530211710.22290264.797139120.10383168.9986917.51264.79.211203.2120.799892.953732.3654.7855.584.090180.332180.34327.2045.1944.5010.723.9747.37319.905243575070397400392.326770152.99038.36523.440174.946107.143112013223562842264351.39357.63357.94698.049459.981782.310.85311242240.44510745000.74510827940.9242934717.1942349334.0592227944.89194.6240.0072.7729872.8912929.791068.7068308.6765206.4473403.2806158.0475829.174577.0107608.3023105.0236107.8991588.6134306.6822207.875372.7821872.065037.9219.00141.9845.9215.444041.3152.761203.423689.9717.33264.82241.175250.1524.363621.5817.6535666.693.441006149876.5270821828142690.22441263.627543115.75608164.0404617.51272.89.121209.1123.051991.372432.0955.0355.924.182180.860189.13126.9346.0746.4514.174.0507.32020.965243675282897429552.367074147.00237.38422.652173.634105.541110413063540641859393.15410.46401.81765.249731.986045.211.12512859050.38912348690.64812026370.8323301915.1832709329.5372525239.60295.7140.4273.1592869.1872928.538168.7650310.6145205.2817404.1304157.8814828.816177.0588609.0422104.8041108.1608587.3828307.1658207.579873.2510867.829637.7119.01140.4545.8515.494032.1053.121195.143741.3517.09268.04238.325291.8124.173655.4117.4832979.743.721002147285.786998162921572OpenBenchmarking.org

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 Atomsamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.31720.63440.95161.26881.586SE +/- 0.00272, N = 3SE +/- 0.00158, N = 4SE +/- 0.00042, N = 3SE +/- 0.00124, N = 4SE +/- 0.00054, N = 3SE +/- 0.00077, N = 4SE +/- 0.00490, N = 3SE +/- 0.00244, N = 3SE +/- 0.00170, N = 3SE +/- 0.00142, N = 3SE +/- 0.00089, N = 40.222860.222700.224500.220210.234200.224641.409820.222890.220250.222900.22441

Xcompact3d Incompact3d

Input: X3D-benchmarking input.i3d

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3damd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance120240360480600SE +/- 0.99, N = 3SE +/- 1.22, N = 3SE +/- 0.28, N = 3SE +/- 0.44, N = 3SE +/- 0.30, N = 3SE +/- 0.86, N = 3SE +/- 0.43, N = 3SE +/- 0.67, N = 3SE +/- 0.32, N = 3SE +/- 0.74, N = 3SE +/- 0.25, N = 3264.91264.59263.30264.82267.54265.31540.54262.40263.63264.80263.631. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh Timeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance170340510680850116.05114.87116.28116.19127.86116.11773.97119.63116.44120.10115.761. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution Timeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance170340510680850167.41170.71169.25167.82182.44168.80773.03167.90166.48169.00164.041. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression Speedamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance48121620SE +/- 0.16, N = 5SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.07, N = 316.0017.6015.2017.5017.1017.601.9717.2017.4017.5017.501. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression Speedamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance30060090012001500SE +/- 3.84, N = 5SE +/- 4.93, N = 3SE +/- 2.19, N = 3SE +/- 6.13, N = 3SE +/- 1.88, N = 3SE +/- 28.63, N = 3SE +/- 0.03, N = 3SE +/- 5.25, N = 3SE +/- 2.01, N = 3SE +/- 1.32, N = 3SE +/- 0.97, N = 31278.31278.61269.81276.21261.81188.1146.11280.51270.91264.71272.81. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression Speedamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance3691215SE +/- 0.06, N = 3SE +/- 0.01, N = 3SE +/- 0.12, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.11, N = 3SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 38.919.288.729.269.209.311.069.139.299.219.121. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression Speedamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance30060090012001500SE +/- 1.23, N = 3SE +/- 7.42, N = 3SE +/- 20.88, N = 3SE +/- 5.97, N = 3SE +/- 1.07, N = 3SE +/- 18.37, N = 3SE +/- 0.15, N = 3SE +/- 11.54, N = 3SE +/- 9.03, N = 3SE +/- 11.09, N = 3SE +/- 7.61, N = 31195.01203.61186.01203.31191.51171.2140.11178.01203.21203.21209.11. (CC) gcc options: -O3 -pthread -lz -llzma

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: Crownamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.25, N = 7SE +/- 0.11, N = 7SE +/- 0.21, N = 6SE +/- 0.18, N = 7SE +/- 0.22, N = 7SE +/- 0.14, N = 7SE +/- 0.02, N = 3SE +/- 0.24, N = 7SE +/- 0.15, N = 7SE +/- 0.33, N = 7SE +/- 0.13, N = 7122.50123.15121.30122.87116.75123.0219.67121.86122.71120.80123.05MIN: 118.44 / MAX: 132.08MIN: 120.42 / MAX: 134.1MIN: 107.62 / MAX: 132.2MIN: 119.52 / MAX: 133.96MIN: 112.31 / MAX: 126.6MIN: 120.25 / MAX: 132.77MIN: 117.58 / MAX: 131.5MIN: 119.75 / MAX: 131.8MIN: 116.78 / MAX: 132.34MIN: 119.92 / MAX: 135.17

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: Asian Dragonamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.79, N = 15SE +/- 0.87, N = 15SE +/- 0.91, N = 15SE +/- 0.93, N = 15SE +/- 0.79, N = 15SE +/- 0.98, N = 15SE +/- 0.02, N = 3SE +/- 1.15, N = 15SE +/- 0.79, N = 6SE +/- 0.85, N = 6SE +/- 0.72, N = 1592.2194.7893.7393.5088.8093.6124.7992.8093.7692.9591.37MIN: 87.15 / MAX: 100.61MIN: 86.18 / MAX: 101.48MIN: 86.21 / MAX: 102.02MIN: 87.15 / MAX: 102.17MIN: 82.24 / MAX: 97.26MIN: 86.72 / MAX: 102.65MIN: 24.19 / MAX: 25.44MIN: 85.44 / MAX: 101.26MIN: 88.79 / MAX: 100.41MIN: 88.86 / MAX: 98.52MIN: 86.16 / MAX: 99.08

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Mediumamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance816243240SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.07, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.14, N = 3SE +/- 0.13, N = 329.4231.9920.6632.3014.3932.004.8330.3222.9732.3632.091. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1224364860SE +/- 0.60, N = 15SE +/- 0.60, N = 5SE +/- 1.49, N = 15SE +/- 0.44, N = 5SE +/- 0.13, N = 3SE +/- 0.51, N = 5SE +/- 0.08, N = 3SE +/- 0.26, N = 4SE +/- 0.20, N = 4SE +/- 0.50, N = 5SE +/- 0.52, N = 547.9754.6945.5654.7726.2153.777.4352.1752.3254.7855.031. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1326395265SE +/- 0.70, N = 15SE +/- 0.40, N = 5SE +/- 1.47, N = 15SE +/- 0.46, N = 5SE +/- 0.10, N = 3SE +/- 0.11, N = 5SE +/- 0.07, N = 3SE +/- 0.50, N = 4SE +/- 0.44, N = 5SE +/- 0.48, N = 5SE +/- 0.48, N = 550.6756.1441.8355.8526.5455.277.7252.6052.9355.5855.921. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.94141.88282.82423.76564.707SE +/- 0.013, N = 3SE +/- 0.008, N = 3SE +/- 0.007, N = 3SE +/- 0.016, N = 3SE +/- 0.022, N = 3SE +/- 0.005, N = 3SE +/- 0.001, N = 3SE +/- 0.020, N = 3SE +/- 0.003, N = 3SE +/- 0.025, N = 3SE +/- 0.002, N = 33.4534.1582.4434.1813.3224.1840.5583.8654.0134.0904.1821. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance4080120160200SE +/- 2.85, N = 15SE +/- 3.08, N = 15SE +/- 1.61, N = 15SE +/- 2.85, N = 15SE +/- 1.29, N = 15SE +/- 3.27, N = 15SE +/- 0.49, N = 12SE +/- 2.56, N = 15SE +/- 2.84, N = 15SE +/- 3.33, N = 15SE +/- 3.08, N = 15175.46186.05155.77173.3190.28182.3636.65171.88167.61180.33180.861. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance4080120160200SE +/- 1.23, N = 12SE +/- 1.60, N = 7SE +/- 1.22, N = 6SE +/- 2.12, N = 15SE +/- 0.85, N = 15SE +/- 1.88, N = 15SE +/- 0.14, N = 3SE +/- 1.52, N = 7SE +/- 1.54, N = 15SE +/- 1.37, N = 10SE +/- 2.47, N = 15170.27194.10145.32188.4272.22191.0532.27161.78144.34180.34189.131. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Mediumamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance612182430SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.02, N = 3SE +/- 0.05, N = 324.2827.0117.3327.0612.2526.893.9724.5821.2127.2026.93

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1122334455SE +/- 0.28, N = 4SE +/- 0.22, N = 4SE +/- 0.58, N = 15SE +/- 0.28, N = 4SE +/- 0.09, N = 3SE +/- 0.18, N = 4SE +/- 0.01, N = 3SE +/- 0.33, N = 4SE +/- 0.25, N = 4SE +/- 0.30, N = 4SE +/- 0.16, N = 439.9646.2633.7946.3125.4345.416.7741.5740.7145.1946.07

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1122334455SE +/- 0.43, N = 4SE +/- 0.33, N = 4SE +/- 0.67, N = 15SE +/- 0.28, N = 4SE +/- 0.08, N = 3SE +/- 0.49, N = 5SE +/- 0.04, N = 3SE +/- 0.19, N = 4SE +/- 0.18, N = 4SE +/- 0.30, N = 4SE +/- 0.21, N = 441.1347.2533.7646.0821.6545.466.8841.9040.8244.5046.45

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance48121620SE +/- 0.12, N = 3SE +/- 0.27, N = 15SE +/- 0.14, N = 15SE +/- 0.41, N = 12SE +/- 0.04, N = 12SE +/- 0.26, N = 15SE +/- 0.01, N = 3SE +/- 0.10, N = 12SE +/- 0.01, N = 3SE +/- 0.12, N = 15SE +/- 0.20, N = 311.6313.377.9512.833.0613.321.868.4714.3610.7214.171. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fastamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.91131.82262.73393.64524.5565SE +/- 0.023, N = 3SE +/- 0.011, N = 3SE +/- 0.011, N = 3SE +/- 0.018, N = 3SE +/- 0.009, N = 3SE +/- 0.021, N = 3SE +/- 0.002, N = 3SE +/- 0.009, N = 3SE +/- 0.007, N = 3SE +/- 0.014, N = 3SE +/- 0.005, N = 33.3594.0222.4714.0233.1364.0210.5683.6763.7673.9744.0501. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fasteramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance246810SE +/- 0.045, N = 3SE +/- 0.075, N = 3SE +/- 0.018, N = 3SE +/- 0.083, N = 4SE +/- 0.049, N = 3SE +/- 0.084, N = 4SE +/- 0.008, N = 3SE +/- 0.030, N = 3SE +/- 0.068, N = 3SE +/- 0.043, N = 3SE +/- 0.075, N = 36.3267.3974.7697.3526.2307.3061.1576.6467.3477.3737.3201. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4Kamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance510152025SE +/- 0.08, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.18, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.19, N = 3SE +/- 0.16, N = 3SE +/- 0.17, N = 3SE +/- 0.23, N = 318.5620.5515.3320.6316.3620.744.3719.2920.6719.9020.961. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance120240360480600SE +/- 4.72, N = 7SE +/- 1.76, N = 3SE +/- 2.08, N = 3SE +/- 4.37, N = 3SE +/- 5.51, N = 3SE +/- 6.51, N = 4SE +/- 1.20, N = 3SE +/- 3.61, N = 3SE +/- 6.96, N = 3SE +/- 4.59, N = 8SE +/- 1.76, N = 3514516477512468534102514531524524MIN: 148 / MAX: 1583MIN: 150 / MAX: 1507MIN: 107 / MAX: 1723MIN: 151 / MAX: 1504MIN: 146 / MAX: 1159MIN: 153 / MAX: 1522MIN: 24 / MAX: 400MIN: 149 / MAX: 1600MIN: 153 / MAX: 1787MIN: 148 / MAX: 1602MIN: 149 / MAX: 1516

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark Scalaramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance80160240320400SE +/- 6.08, N = 6SE +/- 3.82, N = 5SE +/- 2.19, N = 3SE +/- 1.20, N = 3SE +/- 2.31, N = 3SE +/- 3.95, N = 9SE +/- 0.33, N = 3SE +/- 3.76, N = 3SE +/- 4.33, N = 3SE +/- 1.76, N = 3SE +/- 4.13, N = 936437434638532737472363376357367MIN: 71 / MAX: 1707MIN: 75 / MAX: 1552MIN: 62 / MAX: 1800MIN: 75 / MAX: 1589MIN: 72 / MAX: 1129MIN: 74 / MAX: 1559MIN: 11 / MAX: 516MIN: 73 / MAX: 1686MIN: 75 / MAX: 1829MIN: 75 / MAX: 1532MIN: 73 / MAX: 1729

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance110K220K330K440K550KSE +/- 480.40, N = 3SE +/- 5053.05, N = 3SE +/- 3758.30, N = 3SE +/- 5870.22, N = 4SE +/- 3670.50, N = 7SE +/- 6313.35, N = 3SE +/- 1055.88, N = 3SE +/- 2092.51, N = 3SE +/- 3716.48, N = 3SE +/- 6757.49, N = 3SE +/- 5372.93, N = 65004715223484596175144433949825306891009704853874758615070395282891. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance160K320K480K640K800KSE +/- 858.55, N = 3SE +/- 18690.79, N = 3SE +/- 5960.12, N = 3SE +/- 10875.45, N = 4SE +/- 2716.47, N = 7SE +/- 2158.20, N = 3SE +/- 136.02, N = 3SE +/- 1773.36, N = 3SE +/- 156.12, N = 3SE +/- 1725.95, N = 3SE +/- 2437.88, N = 67167037265216614207338826992287463761042877390167485497400397429551. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.53261.06521.59782.13042.663SE +/- 0.017556, N = 15SE +/- 0.005634, N = 3SE +/- 0.042633, N = 12SE +/- 0.031447, N = 3SE +/- 0.011706, N = 12SE +/- 0.008972, N = 3SE +/- 0.000425, N = 3SE +/- 0.009049, N = 3SE +/- 0.001977, N = 3SE +/- 0.003977, N = 3SE +/- 0.015239, N = 32.0592592.3480791.8012382.3464470.8114182.3630700.3014501.3585492.3461122.3267702.3670741. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compileamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 1.30, N = 3SE +/- 1.78, N = 3SE +/- 1.51, N = 8SE +/- 0.95, N = 3SE +/- 1.72, N = 3SE +/- 0.56, N = 3SE +/- 13.66, N = 3SE +/- 1.36, N = 3SE +/- 1.73, N = 3SE +/- 1.68, N = 4SE +/- 0.41, N = 3157.10149.77173.20148.50156.95146.641100.36153.90149.22152.99147.00

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To Compileamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 0.44, N = 3SE +/- 0.05, N = 3SE +/- 0.43, N = 3SE +/- 0.27, N = 3SE +/- 0.30, N = 15SE +/- 0.46, N = 3SE +/- 1.50, N = 3SE +/- 0.12, N = 3SE +/- 0.36, N = 3SE +/- 0.38, N = 3SE +/- 0.23, N = 341.9037.3247.9437.0141.9437.05258.8740.8137.5838.3737.38

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.16, N = 13SE +/- 0.15, N = 13SE +/- 0.24, N = 13SE +/- 0.14, N = 15SE +/- 0.23, N = 14SE +/- 0.18, N = 10SE +/- 1.30, N = 9SE +/- 0.21, N = 15SE +/- 0.14, N = 13SE +/- 0.17, N = 14SE +/- 0.14, N = 1325.5222.6230.8322.5325.3922.52156.7824.5222.6123.4422.65

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.78, N = 3SE +/- 0.74, N = 3SE +/- 0.62, N = 3SE +/- 0.76, N = 3SE +/- 1.59, N = 3SE +/- 0.72, N = 3SE +/- 2.74, N = 3SE +/- 1.27, N = 3SE +/- 0.77, N = 3SE +/- 0.85, N = 3SE +/- 0.71, N = 3176.50172.88184.47172.86182.77173.641094.37177.06172.61174.95173.63

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To Compileamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance160320480640800SE +/- 0.68, N = 3SE +/- 0.15, N = 3SE +/- 0.22, N = 3SE +/- 0.19, N = 3SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.88, N = 3SE +/- 0.13, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.15, N = 3111.95105.53120.48105.83113.13104.93752.99109.81106.47107.14105.54

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Traceramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance14K28K42K56K70KSE +/- 1.20, N = 3SE +/- 1.33, N = 3SE +/- 0.67, N = 3SE +/- 0.88, N = 3SE +/- 0.88, N = 3SE +/- 1.15, N = 3SE +/- 875.42, N = 12SE +/- 2.03, N = 3SE +/- 2.85, N = 3SE +/- 1.20, N = 3SE +/- 1.00, N = 31101110311021101116610986700011181103112011041. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Traceramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance15K30K45K60K75KSE +/- 0.58, N = 3SE +/- 2.03, N = 3SE +/- 0.88, N = 3SE +/- 2.08, N = 3SE +/- 1.15, N = 3SE +/- 1.45, N = 3SE +/- 831.01, N = 12SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 2.19, N = 3SE +/- 1.45, N = 31304129913031302137613006854813221306132213061. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Traceramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60K120K180K240K300KSE +/- 29.34, N = 3SE +/- 76.22, N = 3SE +/- 69.50, N = 3SE +/- 31.26, N = 3SE +/- 66.07, N = 3SE +/- 23.07, N = 3SE +/- 829.19, N = 3SE +/- 52.33, N = 3SE +/- 88.76, N = 3SE +/- 25.51, N = 3SE +/- 117.33, N = 3354383557335243352103697635186291743354403550535628354061. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Traceramd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance70K140K210K280K350KSE +/- 62.74, N = 3SE +/- 58.85, N = 3SE +/- 90.34, N = 3SE +/- 36.04, N = 3SE +/- 7.42, N = 3SE +/- 83.21, N = 3SE +/- 671.47, N = 3SE +/- 85.87, N = 3SE +/- 70.48, N = 3SE +/- 28.29, N = 3SE +/- 98.82, N = 3417984165041532416864370541588332950418974213042264418591. (CXX) g++ options: -O3 -lm -ldl

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cacheamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 1.39, N = 3SE +/- 4.76, N = 3SE +/- 0.77, N = 3SE +/- 2.11, N = 3SE +/- 2.12, N = 3SE +/- 0.63, N = 3SE +/- 0.36, N = 3SE +/- 0.46, N = 3SE +/- 1.22, N = 3SE +/- 3.45, N = 3SE +/- 3.06, N = 3355.12395.53339.68392.95252.79394.3266.81297.77351.21351.39393.15MIN: 43.45 / MAX: 4000MIN: 48.98 / MAX: 4000MIN: 39.27 / MAX: 3157.89MIN: 51.28 / MAX: 3750MIN: 43.29 / MAX: 4000MIN: 48.47 / MAX: 3750MIN: 44.15 / MAX: 2068.97MIN: 49.63 / MAX: 4000MIN: 47.54 / MAX: 2857.14MIN: 50.63 / MAX: 3750

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Runamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 3.92, N = 3SE +/- 4.88, N = 3SE +/- 1.73, N = 3SE +/- 1.07, N = 3SE +/- 3.86, N = 3SE +/- 4.90, N = 3SE +/- 0.06, N = 3SE +/- 2.11, N = 3SE +/- 0.20, N = 3SE +/- 2.51, N = 3SE +/- 3.72, N = 3373.47409.86349.30407.73254.40404.9575.86306.46362.27357.63410.46MIN: 52.86 / MAX: 3750MIN: 57.64 / MAX: 4285.71MIN: 45.25 / MAX: 4000MIN: 56.66 / MAX: 4285.71MIN: 47.85 / MAX: 4285.71MIN: 54.05 / MAX: 4285.71MIN: 50.98 / MAX: 2222.22MIN: 50.98 / MAX: 4615.38MIN: 57.8 / MAX: 3529.41MIN: 58.42 / MAX: 4615.38

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Runamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 3.70, N = 3SE +/- 1.36, N = 3SE +/- 2.43, N = 3SE +/- 3.27, N = 3SE +/- 2.60, N = 3SE +/- 2.49, N = 3SE +/- 0.60, N = 3SE +/- 0.84, N = 3SE +/- 1.95, N = 3SE +/- 2.12, N = 3SE +/- 1.10, N = 3372.98406.99353.17394.98251.84406.4176.66310.66352.85357.94401.81MIN: 54.1 / MAX: 4285.71MIN: 53.29 / MAX: 3333.33MIN: 44.91 / MAX: 3000MIN: 57.97 / MAX: 3529.41MIN: 48.15 / MAX: 3157.89MIN: 52.77 / MAX: 3529.41MIN: 8.52 / MAX: 588.24MIN: 51.28 / MAX: 2222.22MIN: 50.59 / MAX: 3529.41MIN: 56.71 / MAX: 2857.14MIN: 56.71 / MAX: 3333.33

CockroachDB

Workload: MoVR - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance170340510680850SE +/- 2.27, N = 3SE +/- 1.59, N = 3SE +/- 1.71, N = 3SE +/- 2.65, N = 3SE +/- 2.51, N = 15SE +/- 1.79, N = 3SE +/- 0.42, N = 3SE +/- 4.45, N = 3SE +/- 0.92, N = 3SE +/- 3.24, N = 3SE +/- 3.30, N = 3641.8761.0570.5763.4195.9766.8126.8574.8438.2698.0765.2

CockroachDB

Workload: KV, 10% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance11K22K33K44K55KSE +/- 451.19, N = 3SE +/- 504.99, N = 3SE +/- 530.33, N = 4SE +/- 207.31, N = 3SE +/- 410.53, N = 15SE +/- 526.94, N = 3SE +/- 162.55, N = 3SE +/- 457.69, N = 6SE +/- 524.19, N = 15SE +/- 590.54, N = 4SE +/- 577.32, N = 344725.550217.243287.249015.541485.549340.411461.445780.347827.049459.949731.9

CockroachDB

Workload: KV, 95% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 512amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20K40K60K80K100KSE +/- 1522.12, N = 15SE +/- 262.84, N = 3SE +/- 99.42, N = 3SE +/- 465.83, N = 3SE +/- 1298.96, N = 15SE +/- 1631.30, N = 15SE +/- 36.89, N = 3SE +/- 1169.53, N = 15SE +/- 1766.85, N = 15SE +/- 1583.45, N = 15SE +/- 373.82, N = 375876.486214.874380.086477.372179.682071.416811.875334.779962.281782.386045.2

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_bareamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance3691215SE +/- 0.032, N = 3SE +/- 0.057, N = 3SE +/- 0.019, N = 3SE +/- 0.065, N = 3SE +/- 0.601, N = 12SE +/- 0.036, N = 3SE +/- 0.004, N = 3SE +/- 0.448, N = 15SE +/- 0.046, N = 3SE +/- 0.125, N = 15SE +/- 0.018, N = 311.07911.17911.13111.0748.48211.0532.1679.55011.17310.85311.1251. (CXX) g++ options: -O3

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance300K600K900K1200K1500KSE +/- 28243.17, N = 11SE +/- 10261.05, N = 3SE +/- 16514.38, N = 3SE +/- 10272.10, N = 3SE +/- 23969.59, N = 12SE +/- 2192.30, N = 3SE +/- 3162.32, N = 6SE +/- 38153.01, N = 12SE +/- 24805.29, N = 12SE +/- 16168.04, N = 3SE +/- 16034.65, N = 41288550130609912927981286042636088131183731848010377031291471112422412859051. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.35350.7071.06051.4141.7675SE +/- 0.010, N = 11SE +/- 0.003, N = 3SE +/- 0.005, N = 3SE +/- 0.003, N = 3SE +/- 0.025, N = 12SE +/- 0.001, N = 3SE +/- 0.016, N = 6SE +/- 0.020, N = 12SE +/- 0.009, N = 12SE +/- 0.006, N = 3SE +/- 0.005, N = 40.3900.3830.3870.3890.7960.3811.5710.4900.3890.4450.3891. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance300K600K900K1200K1500KSE +/- 8403.56, N = 3SE +/- 15062.87, N = 3SE +/- 2388.78, N = 3SE +/- 7684.39, N = 3SE +/- 21438.85, N = 12SE +/- 9347.57, N = 3SE +/- 2702.31, N = 8SE +/- 36540.35, N = 12SE +/- 716.94, N = 3SE +/- 11695.71, N = 4SE +/- 8479.39, N = 3124826612417261245914124040670492912686883173609977421258066107450012348691. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.56751.1351.70252.272.8375SE +/- 0.004, N = 3SE +/- 0.008, N = 3SE +/- 0.001, N = 3SE +/- 0.004, N = 3SE +/- 0.033, N = 12SE +/- 0.005, N = 3SE +/- 0.022, N = 8SE +/- 0.033, N = 12SE +/- 0.001, N = 3SE +/- 0.008, N = 4SE +/- 0.004, N = 30.6410.6440.6420.6451.1460.6302.5220.8150.6360.7450.6481. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance300K600K900K1200K1500KSE +/- 5837.45, N = 3SE +/- 7063.00, N = 3SE +/- 3162.21, N = 3SE +/- 6415.45, N = 3SE +/- 20475.53, N = 12SE +/- 13365.19, N = 3SE +/- 1792.34, N = 3SE +/- 40789.54, N = 12SE +/- 5317.94, N = 3SE +/- 3711.22, N = 3SE +/- 9650.25, N = 3120754012090331226429122674371498012308413122459559771237871108279412026371. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.72071.44142.16212.88283.6035SE +/- 0.004, N = 3SE +/- 0.005, N = 3SE +/- 0.002, N = 3SE +/- 0.004, N = 3SE +/- 0.040, N = 12SE +/- 0.009, N = 3SE +/- 0.018, N = 3SE +/- 0.048, N = 12SE +/- 0.004, N = 3SE +/- 0.003, N = 3SE +/- 0.006, N = 30.8280.8270.8150.8151.4110.8123.2031.0690.8080.9240.8321. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Writeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance8K16K24K32K40KSE +/- 508.85, N = 12SE +/- 2742.94, N = 12SE +/- 497.87, N = 12SE +/- 524.88, N = 12SE +/- 1491.09, N = 12SE +/- 539.21, N = 12SE +/- 295.83, N = 12SE +/- 2388.98, N = 12SE +/- 523.79, N = 12SE +/- 904.79, N = 12SE +/- 531.49, N = 122887335610286823228619298328586686324862801629347330191. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.28, N = 12SE +/- 0.71, N = 12SE +/- 0.28, N = 12SE +/- 0.24, N = 12SE +/- 2.25, N = 12SE +/- 0.22, N = 12SE +/- 2.49, N = 12SE +/- 1.31, N = 12SE +/- 0.30, N = 12SE +/- 0.46, N = 12SE +/- 0.23, N = 1217.3714.6417.4915.5327.7415.2675.9816.4417.9117.1915.181. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Writeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance6K12K18K24K30KSE +/- 216.59, N = 3SE +/- 272.14, N = 3SE +/- 233.05, N = 12SE +/- 307.60, N = 4SE +/- 766.72, N = 9SE +/- 225.23, N = 12SE +/- 60.47, N = 12SE +/- 148.91, N = 3SE +/- 213.86, N = 12SE +/- 234.54, N = 3SE +/- 343.31, N = 32427526830241732759612397278805465190562374323493270931. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.29, N = 3SE +/- 0.30, N = 3SE +/- 0.32, N = 12SE +/- 0.32, N = 4SE +/- 3.77, N = 9SE +/- 0.24, N = 12SE +/- 1.56, N = 12SE +/- 0.33, N = 3SE +/- 0.30, N = 12SE +/- 0.34, N = 3SE +/- 0.37, N = 332.9629.8233.1329.0066.3928.72146.5741.9933.7234.0629.541. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Writeamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance6K12K18K24K30KSE +/- 214.70, N = 3SE +/- 174.68, N = 12SE +/- 224.57, N = 3SE +/- 207.97, N = 3SE +/- 734.11, N = 9SE +/- 63.64, N = 3SE +/- 29.56, N = 3SE +/- 179.41, N = 3SE +/- 232.73, N = 12SE +/- 157.83, N = 3SE +/- 72.30, N = 32197824299215222608512613249044973178752256722279252521. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance4080120160200SE +/- 0.45, N = 3SE +/- 0.30, N = 12SE +/- 0.48, N = 3SE +/- 0.31, N = 3SE +/- 4.17, N = 9SE +/- 0.10, N = 3SE +/- 1.19, N = 3SE +/- 0.57, N = 3SE +/- 0.45, N = 12SE +/- 0.32, N = 3SE +/- 0.11, N = 345.5141.1846.4738.3481.1940.16201.1055.9544.3644.8939.601. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.04, N = 3SE +/- 0.07, N = 3SE +/- 0.63, N = 6SE +/- 0.28, N = 3SE +/- 0.31, N = 3SE +/- 0.36, N = 3SE +/- 0.01, N = 3SE +/- 0.66, N = 3SE +/- 1.99, N = 9SE +/- 0.82, N = 9SE +/- 0.99, N = 387.7597.1265.6396.7336.5097.5016.5475.6979.3694.6295.71

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance918273645SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.19, N = 3SE +/- 0.10, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.10, N = 338.4140.1931.6440.3926.6340.898.7437.0339.2440.0040.42

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1632486480SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.06, N = 372.8572.9572.8073.0670.7572.9112.9772.5273.1072.7773.16

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance10002000300040005000SE +/- 0.37, N = 3SE +/- 0.32, N = 3SE +/- 0.34, N = 3SE +/- 0.36, N = 3SE +/- 0.52, N = 3SE +/- 0.55, N = 3SE +/- 3.96, N = 3SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.34, N = 3869.22868.87868.92868.26895.13867.904864.70876.50868.82872.89869.19

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 3.90, N = 3SE +/- 2.48, N = 3SE +/- 0.75, N = 3SE +/- 1.42, N = 3SE +/- 0.59, N = 3SE +/- 1.11, N = 3SE +/- 0.06, N = 3SE +/- 0.27, N = 3SE +/- 0.68, N = 3SE +/- 1.23, N = 3SE +/- 1.66, N = 3926.20929.79931.60931.58897.64930.49215.52931.20932.00929.79928.54

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 0.28, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 3SE +/- 0.11, N = 368.9268.7168.5668.5871.1668.65295.4968.6068.5568.7168.77

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance70140210280350SE +/- 0.30, N = 3SE +/- 0.12, N = 3SE +/- 0.37, N = 3SE +/- 0.15, N = 3SE +/- 0.24, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.48, N = 3SE +/- 0.24, N = 3SE +/- 0.62, N = 3SE +/- 0.30, N = 3310.30310.43309.38310.74299.57310.3056.66309.60310.09308.68310.61

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.17, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.10, N = 3SE +/- 0.11, N = 3SE +/- 0.01, N = 3SE +/- 1.11, N = 3SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.31, N = 3SE +/- 0.17, N = 3205.68205.42205.70205.30212.63205.411124.30206.14205.49206.45205.28

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 0.20, N = 3SE +/- 0.15, N = 3SE +/- 0.10, N = 3SE +/- 0.32, N = 3SE +/- 0.49, N = 3SE +/- 0.37, N = 3SE +/- 0.15, N = 3SE +/- 0.34, N = 3SE +/- 0.60, N = 3SE +/- 0.36, N = 3SE +/- 0.15, N = 3403.29404.95403.59404.55388.64404.3070.87401.73404.27403.28404.13

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.17, N = 3SE +/- 0.17, N = 3SE +/- 0.12, N = 3SE +/- 1.48, N = 3SE +/- 0.14, N = 3SE +/- 0.18, N = 3SE +/- 0.15, N = 3SE +/- 0.09, N = 3158.13157.55158.08157.70164.20157.80884.29158.95157.83158.05157.88

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 1.36, N = 3SE +/- 1.68, N = 3SE +/- 1.08, N = 3SE +/- 1.26, N = 3SE +/- 0.84, N = 3SE +/- 1.41, N = 3SE +/- 0.17, N = 3SE +/- 1.55, N = 3SE +/- 0.64, N = 3SE +/- 1.55, N = 3SE +/- 0.63, N = 3830.10830.01829.60830.32809.90830.85147.69834.46828.90829.17828.82

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance90180270360450SE +/- 0.14, N = 3SE +/- 0.16, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.08, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.14, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.04, N = 376.9976.9877.0276.9178.8776.91431.9676.5777.1077.0177.06

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance130260390520650SE +/- 0.85, N = 3SE +/- 0.26, N = 3SE +/- 0.24, N = 3SE +/- 0.35, N = 3SE +/- 1.22, N = 3SE +/- 0.82, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 1.19, N = 3SE +/- 0.14, N = 3SE +/- 0.68, N = 3610.70609.61609.90610.32587.48609.96109.77607.33609.76608.30609.04

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance120240360480600SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.25, N = 3SE +/- 0.14, N = 3SE +/- 0.31, N = 3SE +/- 0.05, N = 3SE +/- 0.20, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3104.57104.76104.66104.62108.66104.73577.77105.15104.75105.02104.80

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.10, N = 3SE +/- 0.06, N = 3SE +/- 0.20, N = 3SE +/- 0.00, N = 3SE +/- 0.18, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3108.20108.20108.15108.11104.89108.4018.20107.47108.13107.90108.16

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance7001400210028003500SE +/- 0.37, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.38, N = 3SE +/- 0.41, N = 3SE +/- 0.92, N = 3SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.20, N = 3SE +/- 0.22, N = 3587.74587.84587.78587.61605.67586.863485.21589.69587.78588.61587.38

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance70140210280350SE +/- 0.63, N = 3SE +/- 0.82, N = 3SE +/- 0.25, N = 3SE +/- 0.09, N = 3SE +/- 0.78, N = 3SE +/- 0.44, N = 3SE +/- 0.07, N = 3SE +/- 0.22, N = 3SE +/- 0.63, N = 3SE +/- 0.60, N = 3SE +/- 0.69, N = 3307.04307.64307.71307.89297.14307.2755.22306.40307.72306.68307.17

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.29, N = 3SE +/- 0.48, N = 3SE +/- 0.11, N = 3SE +/- 0.11, N = 3SE +/- 0.54, N = 3SE +/- 0.30, N = 3SE +/- 0.96, N = 3SE +/- 0.15, N = 3SE +/- 0.52, N = 3SE +/- 0.26, N = 3SE +/- 0.28, N = 3207.61207.44207.33207.19214.47207.671143.06208.09207.27207.88207.58

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1632486480SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.10, N = 373.0272.9473.0573.1471.0173.2713.0072.4173.0372.7873.25

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance10002000300040005000SE +/- 0.33, N = 3SE +/- 0.23, N = 3SE +/- 0.24, N = 3SE +/- 0.76, N = 3SE +/- 0.79, N = 3SE +/- 0.10, N = 3SE +/- 2.96, N = 3SE +/- 0.56, N = 3SE +/- 0.11, N = 3SE +/- 0.15, N = 3SE +/- 0.69, N = 3868.08867.93867.02866.98893.43866.964868.11876.33866.62872.07867.83

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 0.06, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.09, N = 3SE +/- 0.10, N = 337.9437.6838.3537.5740.0437.73254.4637.8537.6137.9237.71

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.02, N = 3SE +/- 0.09, N = 3SE +/- 0.13, N = 3SE +/- 0.03, N = 3SE +/- 0.10, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 319.1718.8019.7418.9520.2618.89124.4819.1818.9019.0019.01

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2004006008001000SE +/- 0.14, N = 3SE +/- 0.14, N = 3SE +/- 0.33, N = 3SE +/- 0.20, N = 3SE +/- 0.32, N = 3SE +/- 0.10, N = 3SE +/- 0.78, N = 3SE +/- 0.24, N = 3SE +/- 0.28, N = 3SE +/- 0.15, N = 3SE +/- 0.03, N = 3141.79140.18143.04140.36147.46140.35933.41141.91140.55141.98140.45

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-Onlyamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 0.20, N = 3SE +/- 0.08, N = 3SE +/- 0.42, N = 3SE +/- 0.09, N = 3SE +/- 0.08, N = 3SE +/- 0.02, N = 3SE +/- 0.71, N = 3SE +/- 0.29, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.15, N = 345.9945.7246.7345.7548.4945.77297.6746.1945.9545.9245.85

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance48121620SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 315.5215.5415.5015.5514.6315.522.5415.2415.4115.4415.491. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance5K10K15K20K25KSE +/- 4.72, N = 3SE +/- 8.61, N = 3SE +/- 6.67, N = 3SE +/- 9.11, N = 3SE +/- 8.81, N = 3SE +/- 4.79, N = 3SE +/- 217.31, N = 3SE +/- 15.80, N = 3SE +/- 5.84, N = 3SE +/- 2.84, N = 3SE +/- 4.16, N = 34030.034015.914033.634005.034262.294030.7924236.974103.644054.304041.314032.10MIN: 18903.29 / MAX: 30172.21. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance1224364860SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.35, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 353.0953.0752.9152.7950.3553.038.3852.4853.0652.7653.121. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance16003200480064008000SE +/- 0.15, N = 3SE +/- 0.45, N = 3SE +/- 0.05, N = 3SE +/- 8.32, N = 3SE +/- 0.52, N = 3SE +/- 0.68, N = 3SE +/- 16.67, N = 3SE +/- 0.24, N = 3SE +/- 1.11, N = 3SE +/- 0.25, N = 3SE +/- 0.38, N = 31195.351195.601199.871203.521260.491195.237565.211210.761195.761203.421195.14MIN: 7058.85 / MAX: 8272.071. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance8001600240032004000SE +/- 1.15, N = 3SE +/- 0.22, N = 3SE +/- 0.85, N = 3SE +/- 0.90, N = 3SE +/- 78.31, N = 12SE +/- 1.03, N = 3SE +/- 0.14, N = 3SE +/- 176.75, N = 15SE +/- 1.38, N = 3SE +/- 1.17, N = 3SE +/- 0.08, N = 33738.043748.173730.663744.851416.773749.69596.041960.303741.063689.973741.351. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance20406080100SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 2.29, N = 12SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 3.03, N = 15SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 317.1017.0617.1417.0746.4917.05107.1736.3517.0917.3317.09MIN: 9.33 / MAX: 84.63MIN: 9.02 / MAX: 83.41MIN: 9.37 / MAX: 88.86MIN: 8.56 / MAX: 80.26MIN: 8.5 / MAX: 147.24MIN: 9.39 / MAX: 80.76MIN: 59.84 / MAX: 344.36MIN: 7.98 / MAX: 137.61MIN: 9.24 / MAX: 81.88MIN: 9.07 / MAX: 83.28MIN: 9.82 / MAX: 80.611. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance60120180240300SE +/- 1.00, N = 3SE +/- 1.18, N = 3SE +/- 0.60, N = 3SE +/- 2.34, N = 3SE +/- 0.47, N = 3SE +/- 0.60, N = 3SE +/- 0.34, N = 15SE +/- 0.14, N = 3SE +/- 1.35, N = 3SE +/- 1.08, N = 3SE +/- 1.06, N = 3267.15266.96268.24266.56265.31267.3051.52279.33266.14264.82268.041. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance30060090012001500SE +/- 0.82, N = 3SE +/- 1.09, N = 3SE +/- 0.51, N = 3SE +/- 2.12, N = 3SE +/- 0.48, N = 3SE +/- 0.54, N = 3SE +/- 7.94, N = 15SE +/- 0.15, N = 3SE +/- 1.21, N = 3SE +/- 1.01, N = 3SE +/- 0.97, N = 3239.05239.29238.16239.70240.82239.021229.86228.75239.94241.17238.32MIN: 599.82 / MAX: 5117.071. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance11002200330044005500SE +/- 0.95, N = 3SE +/- 1.37, N = 3SE +/- 1.46, N = 3SE +/- 0.41, N = 3SE +/- 0.59, N = 3SE +/- 2.23, N = 3SE +/- 0.10, N = 3SE +/- 1.03, N = 3SE +/- 0.71, N = 3SE +/- 0.47, N = 3SE +/- 0.80, N = 35291.455294.975277.025291.005029.055292.08830.315224.835292.425250.155291.811. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance306090120150SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 324.1724.1624.2424.1725.4324.17153.7824.4824.1724.3624.17MIN: 78.56 / MAX: 301.881. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance8001600240032004000SE +/- 3.07, N = 3SE +/- 6.01, N = 3SE +/- 8.08, N = 3SE +/- 3.54, N = 3SE +/- 113.70, N = 15SE +/- 4.65, N = 3SE +/- 1.43, N = 15SE +/- 155.56, N = 12SE +/- 6.58, N = 3SE +/- 13.56, N = 3SE +/- 4.78, N = 33654.513670.783645.603679.312062.043678.91202.831915.373663.483621.583655.411. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance70140210280350SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 1.86, N = 15SE +/- 0.02, N = 3SE +/- 2.16, N = 15SE +/- 2.27, N = 12SE +/- 0.03, N = 3SE +/- 0.07, N = 3SE +/- 0.02, N = 317.4917.4117.5317.3732.4217.37315.2635.3917.4417.6517.48MIN: 86.78 / MAX: 701.541. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance8K16K24K32K40KSE +/- 1060.84, N = 15SE +/- 724.32, N = 12SE +/- 894.45, N = 15SE +/- 1139.15, N = 15SE +/- 909.70, N = 12SE +/- 1205.35, N = 12SE +/- 15.51, N = 3SE +/- 946.71, N = 12SE +/- 1216.09, N = 15SE +/- 1008.62, N = 15SE +/- 342.83, N = 535205.4735601.8336975.3436507.1133751.5836428.765175.9635501.2136248.3835666.6932979.741. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance612182430SE +/- 0.10, N = 15SE +/- 0.07, N = 12SE +/- 0.09, N = 15SE +/- 0.10, N = 15SE +/- 0.11, N = 12SE +/- 0.12, N = 12SE +/- 0.07, N = 3SE +/- 0.10, N = 12SE +/- 0.11, N = 15SE +/- 0.10, N = 15SE +/- 0.04, N = 53.513.453.323.383.553.3924.553.403.413.443.72MIN: 5.27 / MAX: 260.671. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test Timesamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2K4K6K8K10KSE +/- 0.88, N = 3SE +/- 6.01, N = 3SE +/- 7.22, N = 3SE +/- 4.04, N = 3SE +/- 2.85, N = 3SE +/- 3.28, N = 3SE +/- 41.93, N = 3SE +/- 5.81, N = 3SE +/- 7.81, N = 3SE +/- 9.13, N = 3SE +/- 5.81, N = 310039981008101098710108775100499910061002

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500amd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance30K60K90K120K150KSE +/- 1575.56, N = 5SE +/- 1361.88, N = 3SE +/- 1620.42, N = 5SE +/- 2024.19, N = 3SE +/- 115.95, N = 3SE +/- 684.93, N = 3SE +/- 131.35, N = 3SE +/- 208.90, N = 3SE +/- 1781.93, N = 4SE +/- 977.04, N = 3SE +/- 693.20, N = 3146738.16147764.25145614.76152654.86138510.00151325.0127774.70122126.56146083.16149876.52147285.781. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark Suiteamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance150K300K450K600K750KSE +/- 2423.31, N = 3SE +/- 5808.55, N = 12SE +/- 981.48, N = 3SE +/- 4455.74, N = 3SE +/- 5021.57, N = 3SE +/- 3225.60, N = 3SE +/- 423.55, N = 3SE +/- 5843.40, N = 3SE +/- 2191.80, N = 3SE +/- 5594.67, N = 3SE +/- 4034.04, N = 368768269747867120770028771112570121579570705341698785708218699816

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance Metricamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance600K1200K1800K2400K3000K28539832905181286395129807192836504281535640561428637423021171281426929215721. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Phoronix Test Suite v10.8.4