AMD P-State Linux 6.3 Testing

Benchmarks by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2302279-NE-AMDPSTATE10&sro.

AMD P-State Linux 6.3 TestingProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen Resolutionamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance2 x AMD EPYC 7773X 64-Core @ 3.53GHz (128 Cores / 256 Threads)AMD DAYTONA_X (RYM1009B BIOS)AMD Starship/Matisse512GB800GB INTEL SSDPF21Q800GBASPEEDVE2282 x Mellanox MT27710Ubuntu 22.046.2.0-phx (x86_64)GNOME Shell 42.5X Server 1.21.1.31.3.224GCC 11.3.0 + LLVM 14.0.0ext41920x10802 x AMD EPYC 7773X 64-Core @ 2.20GHz (128 Cores / 256 Threads)OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-xKiWfi/gcc-11-11.3.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- amd_pstate_epp powersave balance_performance: Scaling Governor: amd_pstate_epp powersave (EPP: balance_performance) - CPU Microcode: 0xa001229- amd_pstate_epp performance balance_performance: Scaling Governor: amd_pstate_epp performance (EPP: performance) - CPU Microcode: 0xa001229- amd_pstate_epp powersave power: Scaling Governor: amd_pstate_epp powersave (EPP: power) - CPU Microcode: 0xa001229- amd_pstate_epp performance performance: Scaling Governor: amd_pstate_epp performance (EPP: performance) - CPU Microcode: 0xa001229- amd_pstate schedutil: Scaling Governor: amd-pstate schedutil (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate performance: Scaling Governor: amd-pstate performance (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate powersave: Scaling Governor: amd-pstate powersave (Boost: Enabled) - CPU Microcode: 0xa001229- amd_pstate ondemand: Scaling Governor: amd-pstate ondemand (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq schedutil: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq ondemand: Scaling Governor: acpi-cpufreq ondemand (Boost: Enabled) - CPU Microcode: 0xa001229- acpi_cpufreq performance: Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa001229Python Details- Python 3.10.6Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD P-State Linux 6.3 Testingnamd: ATPase Simulation - 327,506 Atomsincompact3d: X3D-benchmarking input.i3dopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timecompress-zstd: 19 - Compression Speedcompress-zstd: 19 - Decompression Speedcompress-zstd: 19, Long Mode - Compression Speedcompress-zstd: 19, Long Mode - Decompression Speedembree: Pathtracer ISPC - Crownembree: Pathtracer ISPC - Asian Dragonkvazaar: Bosphorus 4K - Mediumkvazaar: Bosphorus 4K - Super Fastkvazaar: Bosphorus 4K - Ultra Fastsvt-av1: Preset 4 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Kuvg266: Bosphorus 4K - Mediumuvg266: Bosphorus 4K - Super Fastuvg266: Bosphorus 4K - Ultra Fastvpxenc: Speed 5 - Bosphorus 4Kvvenc: Bosphorus 4K - Fastvvenc: Bosphorus 4K - Fasterx265: Bosphorus 4Kopenvkl: vklBenchmark ISPCopenvkl: vklBenchmark Scalarcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingstargate: 192000 - 1024build-gem5: Time To Compilebuild-godot: Time To Compilebuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-nodejs: Time To Compileospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 3 - 4K - 32 - Path Tracerclickhouse: 100M Rows Hits Dataset, First Run / Cold Cacheclickhouse: 100M Rows Hits Dataset, Second Runclickhouse: 100M Rows Hits Dataset, Third Runcockroach: MoVR - 512cockroach: KV, 10% Reads - 512cockroach: KV, 95% Reads - 512gromacs: MPI CPU - water_GMX50_barepgbench: 100 - 500 - Read Onlypgbench: 100 - 500 - Read Only - Average Latencypgbench: 100 - 800 - Read Onlypgbench: 100 - 800 - Read Only - Average Latencypgbench: 100 - 1000 - Read Onlypgbench: 100 - 1000 - Read Only - Average Latencypgbench: 100 - 500 - Read Writepgbench: 100 - 500 - Read Write - Average Latencypgbench: 100 - 800 - Read Writepgbench: 100 - 800 - Read Write - Average Latencypgbench: 100 - 1000 - Read Writepgbench: 100 - 1000 - Read Write - Average Latencytensorflow: CPU - 256 - AlexNettensorflow: CPU - 256 - GoogLeNetdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUpybench: Total For Average Test Timesnginx: 500phpbench: PHP Benchmark Suitebrl-cad: VGR Performance Metricamd_pstate_epp powersave balance_performanceamd_pstate_epp performance balance_performanceamd_pstate_epp powersave poweramd_pstate_epp performance performanceamd_pstate schedutilamd_pstate performanceamd_pstate powersaveamd_pstate ondemandacpi_cpufreq schedutilacpi_cpufreq ondemandacpi_cpufreq performance0.22286264.910481116.05227167.40916.01278.38.911195.0122.501492.206429.4247.9750.673.453175.455170.26524.2839.9641.1311.633.3596.32618.565143645004717167032.059259157.10241.89825.521176.495111.949110113043543841798355.12373.47372.98641.844725.575876.411.07912885500.39012482660.64112075400.8282887317.3722427532.9612197845.50987.7538.4172.8451869.2150926.202868.9182310.296205.6828403.291158.1292830.096776.9866610.7001104.5730108.1971587.7380307.0385207.611473.0239868.075637.9419.17141.7945.9915.524030.0353.091195.353738.0417.10267.15239.055291.4524.173654.5117.4935205.473.511003146738.1668768228539830.22270264.590464114.86885170.7147817.61278.69.281203.6123.145894.784131.9954.6956.144.158186.048194.10327.0146.2647.2513.374.0227.39720.555163745223487265212.348079149.76737.32122.623172.884105.529110312993557341650395.53409.86406.99761.050217.286214.811.17913060990.38312417260.64412090330.8273561014.6382683029.8232429941.17797.1240.1972.9497868.8719929.789468.7056310.4330205.4179404.9534157.5501830.013176.9790609.6137104.7553108.1954587.8421307.6420207.437772.9379867.927537.6818.80140.1845.7215.544015.9153.071195.603748.1717.06266.96239.295294.9724.163670.7817.4135601.833.45998147764.2569747829051810.22450263.300232116.28282169.2499215.21269.88.721186.0121.297093.727920.6645.5641.832.443155.770145.32317.3333.7933.767.952.4714.76915.334773464596176614201.801238173.20147.93530.833184.470120.483110213033524341532339.68349.30353.17570.543287.274380.011.13112927980.38712459140.64212264290.8152868217.4862417333.1292152246.47465.6331.6472.7952868.9246931.600568.5591309.3788205.6999403.5860158.0751829.603577.0202609.8987104.6604108.1498587.7795307.7129207.332873.0501867.019938.3519.74143.0446.7315.504033.6352.911199.873730.6617.14268.24238.165277.0224.243645.6017.5336975.343.321008145614.7667120728639510.22021264.824544116.19384167.8186417.51276.29.261203.3122.872993.501232.3054.7755.854.181173.314188.42327.0646.3146.0812.834.0237.35220.635123855144437338822.346447148.50337.01122.530172.857105.825110113023521041686392.95407.73394.98763.449015.586477.311.07412860420.38912404060.64512267430.8153228615.5292759629.0002608538.34196.7340.3973.0561868.2616931.582168.5813310.7448205.3031404.5464157.7002830.324176.9051610.3155104.6233108.1144587.6097307.8920207.185373.1372866.981837.5718.95140.3645.7515.554005.0352.791203.523744.8517.07266.56239.705291.0024.173679.3117.3736507.113.381010152654.8670028729807190.23420267.536092127.85527182.4368917.11261.89.201191.5116.753088.802214.3926.2126.543.32290.27772.22112.2525.4321.653.063.1366.23016.364683273949826992280.811418156.94541.94025.392182.768113.131116613763697643705252.79254.40251.84195.941485.572179.68.4826360880.7967049291.1467149801.4111929827.7441239766.3871261381.19236.5026.6370.7499895.1272897.637571.1617299.5680212.6277388.6392164.2008809.904878.8686587.4762108.6614104.8933605.6728297.1387214.472971.0074893.428240.0420.26147.4648.4914.634262.2950.351260.491416.7746.49265.31240.825029.0525.432062.0432.4233751.583.55987138510.0071112528365040.22464265.312622116.10875168.79917.61188.19.311171.2123.024893.605032.0053.7755.274.184182.358191.04626.8945.4145.4613.324.0217.30620.745343745306897463762.363070146.64437.05322.519173.636104.934109813003518641588394.32404.95406.41766.849340.482071.411.05313118370.38112686880.63012308410.8123285815.2572788028.7152490440.15597.5040.8972.9079867.8993930.493268.6499310.3004205.4057404.2950157.7992830.851976.9068609.9637104.7278108.4041586.8584307.2669207.674173.2692866.959537.7318.89140.3545.7715.524030.7953.031195.233749.6917.05267.30239.025292.0824.173678.9117.3736428.763.391010151325.0170121528153561.40982540.544881773.96684773.032831.97146.11.06140.119.668524.79174.837.437.720.55836.64732.2653.976.776.881.860.5681.1574.37102721009701042870.3014501100.363258.873156.7831094.374752.986670006854829174333295066.8175.8676.66126.811461.416811.82.1673184801.5713173602.5223122453.203668675.9845465146.5724973201.10116.548.7412.96834864.7028215.5167295.491856.65821124.304670.8684884.2913147.6880431.9597109.7693577.768818.20483485.212955.22451143.055513.00284868.1057254.46124.48933.41297.672.5424236.978.387565.21596.04107.1751.521229.86830.31153.78202.83315.265175.9624.55877527774.70795704056140.22289262.403117119.63471167.9049117.21280.59.131178.0121.857692.800430.3252.1752.603.865171.877161.77824.5841.5741.908.473.6766.64619.295143634853877390161.358549153.90340.81224.520177.063109.813111813223544041897297.77306.46310.66574.845780.375334.79.55010377030.4909977420.8159559771.0693248616.4361905641.9881787555.95475.6937.0372.5195876.4961931.203268.5979309.5958206.1379401.7313158.9464834.463876.5661607.3304105.1513107.4707589.6910306.3994208.091072.4101876.332137.8519.18141.9146.1915.244103.6452.481210.761960.3036.35279.33228.755224.8324.481915.3735.3935501.213.401004122126.5670534128637420.22025263.625285116.43538166.4756617.41270.99.291203.2122.705593.761522.9752.3252.934.013167.611144.34221.2140.7140.8214.363.7677.34720.675313764758617485492.346112149.22237.57622.610172.606106.466110313063550542130351.21362.27352.85438.247827.079962.211.17312914710.38912580660.63612378710.8082801617.9092374333.7232256744.36479.3639.2473.1026868.8157932.002768.5451310.0940205.4931404.2730157.8251828.896677.0980609.7624104.7469108.1330587.7789307.7165207.271173.0290866.622337.6118.90140.5545.9515.414054.3053.061195.763741.0617.09266.14239.945292.4224.173663.4817.4436248.383.41999146083.1669878530211710.22290264.797139120.10383168.9986917.51264.79.211203.2120.799892.953732.3654.7855.584.090180.332180.34327.2045.1944.5010.723.9747.37319.905243575070397400392.326770152.99038.36523.440174.946107.143112013223562842264351.39357.63357.94698.049459.981782.310.85311242240.44510745000.74510827940.9242934717.1942349334.0592227944.89194.6240.0072.7729872.8912929.791068.7068308.6765206.4473403.2806158.0475829.174577.0107608.3023105.0236107.8991588.6134306.6822207.875372.7821872.065037.9219.00141.9845.9215.444041.3152.761203.423689.9717.33264.82241.175250.1524.363621.5817.6535666.693.441006149876.5270821828142690.22441263.627543115.75608164.0404617.51272.89.121209.1123.051991.372432.0955.0355.924.182180.860189.13126.9346.0746.4514.174.0507.32020.965243675282897429552.367074147.00237.38422.652173.634105.541110413063540641859393.15410.46401.81765.249731.986045.211.12512859050.38912348690.64812026370.8323301915.1832709329.5372525239.60295.7140.4273.1592869.1872928.538168.7650310.6145205.2817404.1304157.8814828.816177.0588609.0422104.8041108.1608587.3828307.1658207.579873.2510867.829637.7119.01140.4545.8515.494032.1053.121195.143741.3517.09268.04238.325291.8124.173655.4117.4832979.743.721002147285.786998162921572OpenBenchmarking.org

NAMD

ATPase Simulation - 327,506 Atoms

OpenBenchmarking.orgdays/ns, Fewer Is BetterNAMD 2.14ATPase Simulation - 327,506 Atomsacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.31720.63440.95161.26881.586SE +/- 0.00142, N = 3SE +/- 0.00089, N = 4SE +/- 0.00170, N = 3SE +/- 0.00244, N = 3SE +/- 0.00077, N = 4SE +/- 0.00490, N = 3SE +/- 0.00054, N = 3SE +/- 0.00158, N = 4SE +/- 0.00124, N = 4SE +/- 0.00272, N = 3SE +/- 0.00042, N = 30.222900.224410.220250.222890.224641.409820.234200.222700.220210.222860.22450

Xcompact3d Incompact3d

Input: X3D-benchmarking input.i3d

OpenBenchmarking.orgSeconds, Fewer Is BetterXcompact3d Incompact3d 2021-03-11Input: X3D-benchmarking input.i3dacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power120240360480600SE +/- 0.74, N = 3SE +/- 0.25, N = 3SE +/- 0.32, N = 3SE +/- 0.67, N = 3SE +/- 0.86, N = 3SE +/- 0.43, N = 3SE +/- 0.30, N = 3SE +/- 1.22, N = 3SE +/- 0.44, N = 3SE +/- 0.99, N = 3SE +/- 0.28, N = 3264.80263.63263.63262.40265.31540.54267.54264.59264.82264.91263.301. (F9X) gfortran options: -cpp -O2 -funroll-loops -floop-optimize -fcray-pointer -fbacktrace -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh Timeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power170340510680850120.10115.76116.44119.63116.11773.97127.86114.87116.19116.05116.281. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution Timeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power170340510680850169.00164.04166.48167.90168.80773.03182.44170.71167.82167.41169.251. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Zstd Compression

Compression Level: 19 - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Compression Speedacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power48121620SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3SE +/- 0.16, N = 5SE +/- 0.03, N = 317.5017.5017.4017.2017.601.9717.1017.6017.5016.0015.201. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19 - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19 - Decompression Speedacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power30060090012001500SE +/- 1.32, N = 3SE +/- 0.97, N = 3SE +/- 2.01, N = 3SE +/- 5.25, N = 3SE +/- 28.63, N = 3SE +/- 0.03, N = 3SE +/- 1.88, N = 3SE +/- 4.93, N = 3SE +/- 6.13, N = 3SE +/- 3.84, N = 5SE +/- 2.19, N = 31264.71272.81270.91280.51188.1146.11261.81278.61276.21278.31269.81. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Compression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Compression Speedacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power3691215SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.00, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.06, N = 3SE +/- 0.12, N = 39.219.129.299.139.311.069.209.289.268.918.721. (CC) gcc options: -O3 -pthread -lz -llzma

Zstd Compression

Compression Level: 19, Long Mode - Decompression Speed

OpenBenchmarking.orgMB/s, More Is BetterZstd Compression 1.5.4Compression Level: 19, Long Mode - Decompression Speedacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power30060090012001500SE +/- 11.09, N = 3SE +/- 7.61, N = 3SE +/- 9.03, N = 3SE +/- 11.54, N = 3SE +/- 18.37, N = 3SE +/- 0.15, N = 3SE +/- 1.07, N = 3SE +/- 7.42, N = 3SE +/- 5.97, N = 3SE +/- 1.23, N = 3SE +/- 20.88, N = 31203.21209.11203.21178.01171.2140.11191.51203.61203.31195.01186.01. (CC) gcc options: -O3 -pthread -lz -llzma

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: Crownacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.33, N = 7SE +/- 0.13, N = 7SE +/- 0.15, N = 7SE +/- 0.24, N = 7SE +/- 0.14, N = 7SE +/- 0.02, N = 3SE +/- 0.22, N = 7SE +/- 0.11, N = 7SE +/- 0.18, N = 7SE +/- 0.25, N = 7SE +/- 0.21, N = 6120.80123.05122.71121.86123.0219.67116.75123.15122.87122.50121.30MIN: 116.78 / MAX: 132.34MIN: 119.92 / MAX: 135.17MIN: 119.75 / MAX: 131.8MIN: 117.58 / MAX: 131.5MIN: 120.25 / MAX: 132.77MIN: 112.31 / MAX: 126.6MIN: 120.42 / MAX: 134.1MIN: 119.52 / MAX: 133.96MIN: 118.44 / MAX: 132.08MIN: 107.62 / MAX: 132.2

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.0Binary: Pathtracer ISPC - Model: Asian Dragonacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.85, N = 6SE +/- 0.72, N = 15SE +/- 0.79, N = 6SE +/- 1.15, N = 15SE +/- 0.98, N = 15SE +/- 0.02, N = 3SE +/- 0.79, N = 15SE +/- 0.87, N = 15SE +/- 0.93, N = 15SE +/- 0.79, N = 15SE +/- 0.91, N = 1592.9591.3793.7692.8093.6124.7988.8094.7893.5092.2193.73MIN: 88.86 / MAX: 98.52MIN: 86.16 / MAX: 99.08MIN: 88.79 / MAX: 100.41MIN: 85.44 / MAX: 101.26MIN: 86.72 / MAX: 102.65MIN: 24.19 / MAX: 25.44MIN: 82.24 / MAX: 97.26MIN: 86.18 / MAX: 101.48MIN: 87.15 / MAX: 102.17MIN: 87.15 / MAX: 100.61MIN: 86.21 / MAX: 102.02

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Mediumacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power816243240SE +/- 0.14, N = 3SE +/- 0.13, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 332.3632.0922.9730.3232.004.8314.3931.9932.3029.4220.661. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Super Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1224364860SE +/- 0.50, N = 5SE +/- 0.52, N = 5SE +/- 0.20, N = 4SE +/- 0.26, N = 4SE +/- 0.51, N = 5SE +/- 0.08, N = 3SE +/- 0.13, N = 3SE +/- 0.60, N = 5SE +/- 0.44, N = 5SE +/- 0.60, N = 15SE +/- 1.49, N = 1554.7855.0352.3252.1753.777.4326.2154.6954.7747.9745.561. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

Kvazaar

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterKvazaar 2.2Video Input: Bosphorus 4K - Video Preset: Ultra Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1326395265SE +/- 0.48, N = 5SE +/- 0.48, N = 5SE +/- 0.44, N = 5SE +/- 0.50, N = 4SE +/- 0.11, N = 5SE +/- 0.07, N = 3SE +/- 0.10, N = 3SE +/- 0.40, N = 5SE +/- 0.46, N = 5SE +/- 0.70, N = 15SE +/- 1.47, N = 1555.5855.9252.9352.6055.277.7226.5456.1455.8550.6741.831. (CC) gcc options: -pthread -ftree-vectorize -fvisibility=hidden -O2 -lpthread -lm -lrt

SVT-AV1

Encoder Mode: Preset 4 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 4 - Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.94141.88282.82423.76564.707SE +/- 0.025, N = 3SE +/- 0.002, N = 3SE +/- 0.003, N = 3SE +/- 0.020, N = 3SE +/- 0.005, N = 3SE +/- 0.001, N = 3SE +/- 0.022, N = 3SE +/- 0.008, N = 3SE +/- 0.016, N = 3SE +/- 0.013, N = 3SE +/- 0.007, N = 34.0904.1824.0133.8654.1840.5583.3224.1584.1813.4532.4431. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power4080120160200SE +/- 3.33, N = 15SE +/- 3.08, N = 15SE +/- 2.84, N = 15SE +/- 2.56, N = 15SE +/- 3.27, N = 15SE +/- 0.49, N = 12SE +/- 1.29, N = 15SE +/- 3.08, N = 15SE +/- 2.85, N = 15SE +/- 2.85, N = 15SE +/- 1.61, N = 15180.33180.86167.61171.88182.3636.6590.28186.05173.31175.46155.771. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power4080120160200SE +/- 1.37, N = 10SE +/- 2.47, N = 15SE +/- 1.54, N = 15SE +/- 1.52, N = 7SE +/- 1.88, N = 15SE +/- 0.14, N = 3SE +/- 0.85, N = 15SE +/- 1.60, N = 7SE +/- 2.12, N = 15SE +/- 1.23, N = 12SE +/- 1.22, N = 6180.34189.13144.34161.78191.0532.2772.22194.10188.42170.27145.321. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

uvg266

Video Input: Bosphorus 4K - Video Preset: Medium

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Mediumacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power612182430SE +/- 0.02, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.01, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 327.2026.9321.2124.5826.893.9712.2527.0127.0624.2817.33

uvg266

Video Input: Bosphorus 4K - Video Preset: Super Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Super Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1122334455SE +/- 0.30, N = 4SE +/- 0.16, N = 4SE +/- 0.25, N = 4SE +/- 0.33, N = 4SE +/- 0.18, N = 4SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.22, N = 4SE +/- 0.28, N = 4SE +/- 0.28, N = 4SE +/- 0.58, N = 1545.1946.0740.7141.5745.416.7725.4346.2646.3139.9633.79

uvg266

Video Input: Bosphorus 4K - Video Preset: Ultra Fast

OpenBenchmarking.orgFrames Per Second, More Is Betteruvg266 0.4.1Video Input: Bosphorus 4K - Video Preset: Ultra Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1122334455SE +/- 0.30, N = 4SE +/- 0.21, N = 4SE +/- 0.18, N = 4SE +/- 0.19, N = 4SE +/- 0.49, N = 5SE +/- 0.04, N = 3SE +/- 0.08, N = 3SE +/- 0.33, N = 4SE +/- 0.28, N = 4SE +/- 0.43, N = 4SE +/- 0.67, N = 1544.5046.4540.8241.9045.466.8821.6547.2546.0841.1333.76

VP9 libvpx Encoding

Speed: Speed 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterVP9 libvpx Encoding 1.13Speed: Speed 5 - Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power48121620SE +/- 0.12, N = 15SE +/- 0.20, N = 3SE +/- 0.01, N = 3SE +/- 0.10, N = 12SE +/- 0.26, N = 15SE +/- 0.01, N = 3SE +/- 0.04, N = 12SE +/- 0.27, N = 15SE +/- 0.41, N = 12SE +/- 0.12, N = 3SE +/- 0.14, N = 1510.7214.1714.368.4713.321.863.0613.3712.8311.637.951. (CXX) g++ options: -m64 -lm -lpthread -O3 -fPIC -U_FORTIFY_SOURCE -std=gnu++11

VVenC

Video Input: Bosphorus 4K - Video Preset: Fast

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fastacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.91131.82262.73393.64524.5565SE +/- 0.014, N = 3SE +/- 0.005, N = 3SE +/- 0.007, N = 3SE +/- 0.009, N = 3SE +/- 0.021, N = 3SE +/- 0.002, N = 3SE +/- 0.009, N = 3SE +/- 0.011, N = 3SE +/- 0.018, N = 3SE +/- 0.023, N = 3SE +/- 0.011, N = 33.9744.0503.7673.6764.0210.5683.1364.0224.0233.3592.4711. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

VVenC

Video Input: Bosphorus 4K - Video Preset: Faster

OpenBenchmarking.orgFrames Per Second, More Is BetterVVenC 1.7Video Input: Bosphorus 4K - Video Preset: Fasteracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power246810SE +/- 0.043, N = 3SE +/- 0.075, N = 3SE +/- 0.068, N = 3SE +/- 0.030, N = 3SE +/- 0.084, N = 4SE +/- 0.008, N = 3SE +/- 0.049, N = 3SE +/- 0.075, N = 3SE +/- 0.083, N = 4SE +/- 0.045, N = 3SE +/- 0.018, N = 37.3737.3207.3476.6467.3061.1576.2307.3977.3526.3264.7691. (CXX) g++ options: -O3 -flto -fno-fat-lto-objects -flto=auto

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265 3.4Video Input: Bosphorus 4Kacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power510152025SE +/- 0.17, N = 3SE +/- 0.23, N = 3SE +/- 0.16, N = 3SE +/- 0.19, N = 3SE +/- 0.08, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.18, N = 3SE +/- 0.08, N = 3SE +/- 0.18, N = 319.9020.9620.6719.2920.744.3716.3620.5520.6318.5615.331. (CXX) g++ options: -O3 -rdynamic -lpthread -lrt -ldl -lnuma

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power120240360480600SE +/- 4.59, N = 8SE +/- 1.76, N = 3SE +/- 6.96, N = 3SE +/- 3.61, N = 3SE +/- 6.51, N = 4SE +/- 1.20, N = 3SE +/- 5.51, N = 3SE +/- 1.76, N = 3SE +/- 4.37, N = 3SE +/- 4.72, N = 7SE +/- 2.08, N = 3524524531514534102468516512514477MIN: 148 / MAX: 1602MIN: 149 / MAX: 1516MIN: 153 / MAX: 1787MIN: 149 / MAX: 1600MIN: 153 / MAX: 1522MIN: 24 / MAX: 400MIN: 146 / MAX: 1159MIN: 150 / MAX: 1507MIN: 151 / MAX: 1504MIN: 148 / MAX: 1583MIN: 107 / MAX: 1723

OpenVKL

Benchmark: vklBenchmark Scalar

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark Scalaracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power80160240320400SE +/- 1.76, N = 3SE +/- 4.13, N = 9SE +/- 4.33, N = 3SE +/- 3.76, N = 3SE +/- 3.95, N = 9SE +/- 0.33, N = 3SE +/- 2.31, N = 3SE +/- 3.82, N = 5SE +/- 1.20, N = 3SE +/- 6.08, N = 6SE +/- 2.19, N = 335736737636337472327374385364346MIN: 75 / MAX: 1532MIN: 73 / MAX: 1729MIN: 75 / MAX: 1829MIN: 73 / MAX: 1686MIN: 74 / MAX: 1559MIN: 11 / MAX: 516MIN: 72 / MAX: 1129MIN: 75 / MAX: 1552MIN: 75 / MAX: 1589MIN: 71 / MAX: 1707MIN: 62 / MAX: 1800

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression Ratingacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power110K220K330K440K550KSE +/- 6757.49, N = 3SE +/- 5372.93, N = 6SE +/- 3716.48, N = 3SE +/- 2092.51, N = 3SE +/- 6313.35, N = 3SE +/- 1055.88, N = 3SE +/- 3670.50, N = 7SE +/- 5053.05, N = 3SE +/- 5870.22, N = 4SE +/- 480.40, N = 3SE +/- 3758.30, N = 35070395282894758614853875306891009703949825223485144435004714596171. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression Ratingacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power160K320K480K640K800KSE +/- 1725.95, N = 3SE +/- 2437.88, N = 6SE +/- 156.12, N = 3SE +/- 1773.36, N = 3SE +/- 2158.20, N = 3SE +/- 136.02, N = 3SE +/- 2716.47, N = 7SE +/- 18690.79, N = 3SE +/- 10875.45, N = 4SE +/- 858.55, N = 3SE +/- 5960.12, N = 37400397429557485497390167463761042876992287265217338827167036614201. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

Stargate Digital Audio Workstation

Sample Rate: 192000 - Buffer Size: 1024

OpenBenchmarking.orgRender Ratio, More Is BetterStargate Digital Audio Workstation 22.11.5Sample Rate: 192000 - Buffer Size: 1024acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.53261.06521.59782.13042.663SE +/- 0.003977, N = 3SE +/- 0.015239, N = 3SE +/- 0.001977, N = 3SE +/- 0.009049, N = 3SE +/- 0.008972, N = 3SE +/- 0.000425, N = 3SE +/- 0.011706, N = 12SE +/- 0.005634, N = 3SE +/- 0.031447, N = 3SE +/- 0.017556, N = 15SE +/- 0.042633, N = 122.3267702.3670742.3461121.3585492.3630700.3014500.8114182.3480792.3464472.0592591.8012381. (CXX) g++ options: -lpthread -lsndfile -lm -O3 -march=native -ffast-math -funroll-loops -fstrength-reduce -fstrict-aliasing -finline-functions

Timed Gem5 Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 21.2Time To Compileacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 1.68, N = 4SE +/- 0.41, N = 3SE +/- 1.73, N = 3SE +/- 1.36, N = 3SE +/- 0.56, N = 3SE +/- 13.66, N = 3SE +/- 1.72, N = 3SE +/- 1.78, N = 3SE +/- 0.95, N = 3SE +/- 1.30, N = 3SE +/- 1.51, N = 8152.99147.00149.22153.90146.641100.36156.95149.77148.50157.10173.20

Timed Godot Game Engine Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 3.2.3Time To Compileacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 0.38, N = 3SE +/- 0.23, N = 3SE +/- 0.36, N = 3SE +/- 0.12, N = 3SE +/- 0.46, N = 3SE +/- 1.50, N = 3SE +/- 0.30, N = 15SE +/- 0.05, N = 3SE +/- 0.27, N = 3SE +/- 0.44, N = 3SE +/- 0.43, N = 338.3737.3837.5840.8137.05258.8741.9437.3237.0141.9047.94

Timed Linux Kernel Compilation

Build: defconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.17, N = 14SE +/- 0.14, N = 13SE +/- 0.14, N = 13SE +/- 0.21, N = 15SE +/- 0.18, N = 10SE +/- 1.30, N = 9SE +/- 0.23, N = 14SE +/- 0.15, N = 13SE +/- 0.14, N = 15SE +/- 0.16, N = 13SE +/- 0.24, N = 1323.4422.6522.6124.5222.52156.7825.3922.6222.5325.5230.83

Timed Linux Kernel Compilation

Build: allmodconfig

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.85, N = 3SE +/- 0.71, N = 3SE +/- 0.77, N = 3SE +/- 1.27, N = 3SE +/- 0.72, N = 3SE +/- 2.74, N = 3SE +/- 1.59, N = 3SE +/- 0.74, N = 3SE +/- 0.76, N = 3SE +/- 0.78, N = 3SE +/- 0.62, N = 3174.95173.63172.61177.06173.641094.37182.77172.88172.86176.50184.47

Timed Node.js Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 18.8Time To Compileacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power160320480640800SE +/- 0.16, N = 3SE +/- 0.15, N = 3SE +/- 0.23, N = 3SE +/- 0.13, N = 3SE +/- 0.08, N = 3SE +/- 0.88, N = 3SE +/- 0.24, N = 3SE +/- 0.15, N = 3SE +/- 0.19, N = 3SE +/- 0.68, N = 3SE +/- 0.22, N = 3107.14105.54106.47109.81104.93752.99113.13105.53105.83111.95120.48

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Traceracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power14K28K42K56K70KSE +/- 1.20, N = 3SE +/- 1.00, N = 3SE +/- 2.85, N = 3SE +/- 2.03, N = 3SE +/- 1.15, N = 3SE +/- 875.42, N = 12SE +/- 0.88, N = 3SE +/- 1.33, N = 3SE +/- 0.88, N = 3SE +/- 1.20, N = 3SE +/- 0.67, N = 31120110411031118109867000116611031101110111021. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Traceracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power15K30K45K60K75KSE +/- 2.19, N = 3SE +/- 1.45, N = 3SE +/- 0.67, N = 3SE +/- 0.67, N = 3SE +/- 1.45, N = 3SE +/- 831.01, N = 12SE +/- 1.15, N = 3SE +/- 2.03, N = 3SE +/- 2.08, N = 3SE +/- 0.58, N = 3SE +/- 0.88, N = 31322130613061322130068548137612991302130413031. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Traceracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60K120K180K240K300KSE +/- 25.51, N = 3SE +/- 117.33, N = 3SE +/- 88.76, N = 3SE +/- 52.33, N = 3SE +/- 23.07, N = 3SE +/- 829.19, N = 3SE +/- 66.07, N = 3SE +/- 76.22, N = 3SE +/- 31.26, N = 3SE +/- 29.34, N = 3SE +/- 69.50, N = 3356283540635505354403518629174336976355733521035438352431. (CXX) g++ options: -O3 -lm -ldl

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Traceracpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power70K140K210K280K350KSE +/- 28.29, N = 3SE +/- 98.82, N = 3SE +/- 70.48, N = 3SE +/- 85.87, N = 3SE +/- 83.21, N = 3SE +/- 671.47, N = 3SE +/- 7.42, N = 3SE +/- 58.85, N = 3SE +/- 36.04, N = 3SE +/- 62.74, N = 3SE +/- 90.34, N = 3422644185942130418974158833295043705416504168641798415321. (CXX) g++ options: -O3 -lm -ldl

ClickHouse

100M Rows Hits Dataset, First Run / Cold Cache

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, First Run / Cold Cacheacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 3.45, N = 3SE +/- 3.06, N = 3SE +/- 1.22, N = 3SE +/- 0.46, N = 3SE +/- 0.63, N = 3SE +/- 0.36, N = 3SE +/- 2.12, N = 3SE +/- 4.76, N = 3SE +/- 2.11, N = 3SE +/- 1.39, N = 3SE +/- 0.77, N = 3351.39393.15351.21297.77394.3266.81252.79395.53392.95355.12339.68MIN: 47.54 / MAX: 2857.14MIN: 50.63 / MAX: 3750MIN: 49.63 / MAX: 4000MIN: 44.15 / MAX: 2068.97MIN: 48.47 / MAX: 3750MIN: 43.29 / MAX: 4000MIN: 48.98 / MAX: 4000MIN: 51.28 / MAX: 3750MIN: 43.45 / MAX: 4000MIN: 39.27 / MAX: 3157.89

ClickHouse

100M Rows Hits Dataset, Second Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Second Runacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 2.51, N = 3SE +/- 3.72, N = 3SE +/- 0.20, N = 3SE +/- 2.11, N = 3SE +/- 4.90, N = 3SE +/- 0.06, N = 3SE +/- 3.86, N = 3SE +/- 4.88, N = 3SE +/- 1.07, N = 3SE +/- 3.92, N = 3SE +/- 1.73, N = 3357.63410.46362.27306.46404.9575.86254.40409.86407.73373.47349.30MIN: 57.8 / MAX: 3529.41MIN: 58.42 / MAX: 4615.38MIN: 50.98 / MAX: 4615.38MIN: 50.98 / MAX: 2222.22MIN: 54.05 / MAX: 4285.71MIN: 47.85 / MAX: 4285.71MIN: 57.64 / MAX: 4285.71MIN: 56.66 / MAX: 4285.71MIN: 52.86 / MAX: 3750MIN: 45.25 / MAX: 4000

ClickHouse

100M Rows Hits Dataset, Third Run

OpenBenchmarking.orgQueries Per Minute, Geo Mean, More Is BetterClickHouse 22.12.3.5100M Rows Hits Dataset, Third Runacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 2.12, N = 3SE +/- 1.10, N = 3SE +/- 1.95, N = 3SE +/- 0.84, N = 3SE +/- 2.49, N = 3SE +/- 0.60, N = 3SE +/- 2.60, N = 3SE +/- 1.36, N = 3SE +/- 3.27, N = 3SE +/- 3.70, N = 3SE +/- 2.43, N = 3357.94401.81352.85310.66406.4176.66251.84406.99394.98372.98353.17MIN: 56.71 / MAX: 2857.14MIN: 56.71 / MAX: 3333.33MIN: 50.59 / MAX: 3529.41MIN: 51.28 / MAX: 2222.22MIN: 52.77 / MAX: 3529.41MIN: 8.52 / MAX: 588.24MIN: 48.15 / MAX: 3157.89MIN: 53.29 / MAX: 3333.33MIN: 57.97 / MAX: 3529.41MIN: 54.1 / MAX: 4285.71MIN: 44.91 / MAX: 3000

CockroachDB

Workload: MoVR - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: MoVR - Concurrency: 512acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power170340510680850SE +/- 3.24, N = 3SE +/- 3.30, N = 3SE +/- 0.92, N = 3SE +/- 4.45, N = 3SE +/- 1.79, N = 3SE +/- 0.42, N = 3SE +/- 2.51, N = 15SE +/- 1.59, N = 3SE +/- 2.65, N = 3SE +/- 2.27, N = 3SE +/- 1.71, N = 3698.0765.2438.2574.8766.8126.8195.9761.0763.4641.8570.5

CockroachDB

Workload: KV, 10% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 10% Reads - Concurrency: 512acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power11K22K33K44K55KSE +/- 590.54, N = 4SE +/- 577.32, N = 3SE +/- 524.19, N = 15SE +/- 457.69, N = 6SE +/- 526.94, N = 3SE +/- 162.55, N = 3SE +/- 410.53, N = 15SE +/- 504.99, N = 3SE +/- 207.31, N = 3SE +/- 451.19, N = 3SE +/- 530.33, N = 449459.949731.947827.045780.349340.411461.441485.550217.249015.544725.543287.2

CockroachDB

Workload: KV, 95% Reads - Concurrency: 512

OpenBenchmarking.orgops/s, More Is BetterCockroachDB 22.2Workload: KV, 95% Reads - Concurrency: 512acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20K40K60K80K100KSE +/- 1583.45, N = 15SE +/- 373.82, N = 3SE +/- 1766.85, N = 15SE +/- 1169.53, N = 15SE +/- 1631.30, N = 15SE +/- 36.89, N = 3SE +/- 1298.96, N = 15SE +/- 262.84, N = 3SE +/- 465.83, N = 3SE +/- 1522.12, N = 15SE +/- 99.42, N = 381782.386045.279962.275334.782071.416811.872179.686214.886477.375876.474380.0

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2023Implementation: MPI CPU - Input: water_GMX50_bareacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power3691215SE +/- 0.125, N = 15SE +/- 0.018, N = 3SE +/- 0.046, N = 3SE +/- 0.448, N = 15SE +/- 0.036, N = 3SE +/- 0.004, N = 3SE +/- 0.601, N = 12SE +/- 0.057, N = 3SE +/- 0.065, N = 3SE +/- 0.032, N = 3SE +/- 0.019, N = 310.85311.12511.1739.55011.0532.1678.48211.17911.07411.07911.1311. (CXX) g++ options: -O3

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power300K600K900K1200K1500KSE +/- 16168.04, N = 3SE +/- 16034.65, N = 4SE +/- 24805.29, N = 12SE +/- 38153.01, N = 12SE +/- 2192.30, N = 3SE +/- 3162.32, N = 6SE +/- 23969.59, N = 12SE +/- 10261.05, N = 3SE +/- 10272.10, N = 3SE +/- 28243.17, N = 11SE +/- 16514.38, N = 31124224128590512914711037703131183731848063608813060991286042128855012927981. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Only - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.35350.7071.06051.4141.7675SE +/- 0.006, N = 3SE +/- 0.005, N = 4SE +/- 0.009, N = 12SE +/- 0.020, N = 12SE +/- 0.001, N = 3SE +/- 0.016, N = 6SE +/- 0.025, N = 12SE +/- 0.003, N = 3SE +/- 0.003, N = 3SE +/- 0.010, N = 11SE +/- 0.005, N = 30.4450.3890.3890.4900.3811.5710.7960.3830.3890.3900.3871. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power300K600K900K1200K1500KSE +/- 11695.71, N = 4SE +/- 8479.39, N = 3SE +/- 716.94, N = 3SE +/- 36540.35, N = 12SE +/- 9347.57, N = 3SE +/- 2702.31, N = 8SE +/- 21438.85, N = 12SE +/- 15062.87, N = 3SE +/- 7684.39, N = 3SE +/- 8403.56, N = 3SE +/- 2388.78, N = 3107450012348691258066997742126868831736070492912417261240406124826612459141. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Only - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.56751.1351.70252.272.8375SE +/- 0.008, N = 4SE +/- 0.004, N = 3SE +/- 0.001, N = 3SE +/- 0.033, N = 12SE +/- 0.005, N = 3SE +/- 0.022, N = 8SE +/- 0.033, N = 12SE +/- 0.008, N = 3SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.001, N = 30.7450.6480.6360.8150.6302.5221.1460.6440.6450.6410.6421. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power300K600K900K1200K1500KSE +/- 3711.22, N = 3SE +/- 9650.25, N = 3SE +/- 5317.94, N = 3SE +/- 40789.54, N = 12SE +/- 13365.19, N = 3SE +/- 1792.34, N = 3SE +/- 20475.53, N = 12SE +/- 7063.00, N = 3SE +/- 6415.45, N = 3SE +/- 5837.45, N = 3SE +/- 3162.21, N = 3108279412026371237871955977123084131224571498012090331226743120754012264291. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Only - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power0.72071.44142.16212.88283.6035SE +/- 0.003, N = 3SE +/- 0.006, N = 3SE +/- 0.004, N = 3SE +/- 0.048, N = 12SE +/- 0.009, N = 3SE +/- 0.018, N = 3SE +/- 0.040, N = 12SE +/- 0.005, N = 3SE +/- 0.004, N = 3SE +/- 0.004, N = 3SE +/- 0.002, N = 30.9240.8320.8081.0690.8123.2031.4110.8270.8150.8280.8151. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Writeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power8K16K24K32K40KSE +/- 904.79, N = 12SE +/- 531.49, N = 12SE +/- 523.79, N = 12SE +/- 2388.98, N = 12SE +/- 539.21, N = 12SE +/- 295.83, N = 12SE +/- 1491.09, N = 12SE +/- 2742.94, N = 12SE +/- 524.88, N = 12SE +/- 508.85, N = 12SE +/- 497.87, N = 122934733019280163248632858668619298356103228628873286821. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 500 - Mode: Read Write - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.46, N = 12SE +/- 0.23, N = 12SE +/- 0.30, N = 12SE +/- 1.31, N = 12SE +/- 0.22, N = 12SE +/- 2.49, N = 12SE +/- 2.25, N = 12SE +/- 0.71, N = 12SE +/- 0.24, N = 12SE +/- 0.28, N = 12SE +/- 0.28, N = 1217.1915.1817.9116.4415.2675.9827.7414.6415.5317.3717.491. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Writeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power6K12K18K24K30KSE +/- 234.54, N = 3SE +/- 343.31, N = 3SE +/- 213.86, N = 12SE +/- 148.91, N = 3SE +/- 225.23, N = 12SE +/- 60.47, N = 12SE +/- 766.72, N = 9SE +/- 272.14, N = 3SE +/- 307.60, N = 4SE +/- 216.59, N = 3SE +/- 233.05, N = 122349327093237431905627880546512397268302759624275241731. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 800 - Mode: Read Write - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.34, N = 3SE +/- 0.37, N = 3SE +/- 0.30, N = 12SE +/- 0.33, N = 3SE +/- 0.24, N = 12SE +/- 1.56, N = 12SE +/- 3.77, N = 9SE +/- 0.30, N = 3SE +/- 0.32, N = 4SE +/- 0.29, N = 3SE +/- 0.32, N = 1234.0629.5433.7241.9928.72146.5766.3929.8229.0032.9633.131. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write

OpenBenchmarking.orgTPS, More Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Writeacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power6K12K18K24K30KSE +/- 157.83, N = 3SE +/- 72.30, N = 3SE +/- 232.73, N = 12SE +/- 179.41, N = 3SE +/- 63.64, N = 3SE +/- 29.56, N = 3SE +/- 734.11, N = 9SE +/- 174.68, N = 12SE +/- 207.97, N = 3SE +/- 214.70, N = 3SE +/- 224.57, N = 32227925252225671787524904497312613242992608521978215221. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

PostgreSQL

Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latency

OpenBenchmarking.orgms, Fewer Is BetterPostgreSQL 15Scaling Factor: 100 - Clients: 1000 - Mode: Read Write - Average Latencyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power4080120160200SE +/- 0.32, N = 3SE +/- 0.11, N = 3SE +/- 0.45, N = 12SE +/- 0.57, N = 3SE +/- 0.10, N = 3SE +/- 1.19, N = 3SE +/- 4.17, N = 9SE +/- 0.30, N = 12SE +/- 0.31, N = 3SE +/- 0.45, N = 3SE +/- 0.48, N = 344.8939.6044.3655.9540.16201.1081.1941.1838.3445.5146.471. (CC) gcc options: -fno-strict-aliasing -fwrapv -O2 -lpgcommon -lpgport -lpq -lm

TensorFlow

Device: CPU - Batch Size: 256 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: AlexNetacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.82, N = 9SE +/- 0.99, N = 3SE +/- 1.99, N = 9SE +/- 0.66, N = 3SE +/- 0.36, N = 3SE +/- 0.01, N = 3SE +/- 0.31, N = 3SE +/- 0.07, N = 3SE +/- 0.28, N = 3SE +/- 0.04, N = 3SE +/- 0.63, N = 694.6295.7179.3675.6997.5016.5436.5097.1296.7387.7565.63

TensorFlow

Device: CPU - Batch Size: 256 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 256 - Model: GoogLeNetacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power918273645SE +/- 0.06, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.09, N = 3SE +/- 0.04, N = 3SE +/- 0.12, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.19, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 340.0040.4239.2437.0340.898.7426.6340.1940.3938.4131.64

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1632486480SE +/- 0.05, N = 3SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.14, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 372.7773.1673.1072.5272.9112.9770.7572.9573.0672.8572.80

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power10002000300040005000SE +/- 0.08, N = 3SE +/- 0.34, N = 3SE +/- 0.13, N = 3SE +/- 0.23, N = 3SE +/- 0.55, N = 3SE +/- 3.96, N = 3SE +/- 0.52, N = 3SE +/- 0.32, N = 3SE +/- 0.36, N = 3SE +/- 0.37, N = 3SE +/- 0.34, N = 3872.89869.19868.82876.50867.904864.70895.13868.87868.26869.22868.92

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 1.23, N = 3SE +/- 1.66, N = 3SE +/- 0.68, N = 3SE +/- 0.27, N = 3SE +/- 1.11, N = 3SE +/- 0.06, N = 3SE +/- 0.59, N = 3SE +/- 2.48, N = 3SE +/- 1.42, N = 3SE +/- 3.90, N = 3SE +/- 0.75, N = 3929.79928.54932.00931.20930.49215.52897.64929.79931.58926.20931.60

Neural Magic DeepSparse

Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 0.08, N = 3SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3SE +/- 0.08, N = 3SE +/- 0.07, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.10, N = 3SE +/- 0.28, N = 3SE +/- 0.05, N = 368.7168.7768.5568.6068.65295.4971.1668.7168.5868.9268.56

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power70140210280350SE +/- 0.62, N = 3SE +/- 0.30, N = 3SE +/- 0.24, N = 3SE +/- 0.48, N = 3SE +/- 0.08, N = 3SE +/- 0.06, N = 3SE +/- 0.24, N = 3SE +/- 0.12, N = 3SE +/- 0.15, N = 3SE +/- 0.30, N = 3SE +/- 0.37, N = 3308.68310.61310.09309.60310.3056.66299.57310.43310.74310.30309.38

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.31, N = 3SE +/- 0.17, N = 3SE +/- 0.09, N = 3SE +/- 0.25, N = 3SE +/- 0.01, N = 3SE +/- 1.11, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.17, N = 3SE +/- 0.05, N = 3206.45205.28205.49206.14205.411124.30212.63205.42205.30205.68205.70

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 0.36, N = 3SE +/- 0.15, N = 3SE +/- 0.60, N = 3SE +/- 0.34, N = 3SE +/- 0.37, N = 3SE +/- 0.15, N = 3SE +/- 0.49, N = 3SE +/- 0.15, N = 3SE +/- 0.32, N = 3SE +/- 0.20, N = 3SE +/- 0.10, N = 3403.28404.13404.27401.73404.3070.87388.64404.95404.55403.29403.59

Neural Magic DeepSparse

Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.15, N = 3SE +/- 0.09, N = 3SE +/- 0.18, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 3SE +/- 1.48, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.17, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3158.05157.88157.83158.95157.80884.29164.20157.55157.70158.13158.08

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 1.55, N = 3SE +/- 0.63, N = 3SE +/- 0.64, N = 3SE +/- 1.55, N = 3SE +/- 1.41, N = 3SE +/- 0.17, N = 3SE +/- 0.84, N = 3SE +/- 1.68, N = 3SE +/- 1.26, N = 3SE +/- 1.36, N = 3SE +/- 1.08, N = 3829.17828.82828.90834.46830.85147.69809.90830.01830.32830.10829.60

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power90180270360450SE +/- 0.12, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3SE +/- 0.17, N = 3SE +/- 0.08, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.14, N = 3SE +/- 0.12, N = 377.0177.0677.1076.5776.91431.9678.8776.9876.9176.9977.02

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power130260390520650SE +/- 0.14, N = 3SE +/- 0.68, N = 3SE +/- 1.19, N = 3SE +/- 0.13, N = 3SE +/- 0.82, N = 3SE +/- 0.09, N = 3SE +/- 1.22, N = 3SE +/- 0.26, N = 3SE +/- 0.35, N = 3SE +/- 0.85, N = 3SE +/- 0.24, N = 3608.30609.04609.76607.33609.96109.77587.48609.61610.32610.70609.90

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power120240360480600SE +/- 0.06, N = 3SE +/- 0.11, N = 3SE +/- 0.20, N = 3SE +/- 0.05, N = 3SE +/- 0.14, N = 3SE +/- 0.31, N = 3SE +/- 0.25, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.11, N = 3SE +/- 0.04, N = 3105.02104.80104.75105.15104.73577.77108.66104.76104.62104.57104.66

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.18, N = 3SE +/- 0.20, N = 3SE +/- 0.00, N = 3SE +/- 0.06, N = 3SE +/- 0.04, N = 3SE +/- 0.10, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3107.90108.16108.13107.47108.4018.20104.89108.20108.11108.20108.15

Neural Magic DeepSparse

Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power7001400210028003500SE +/- 0.20, N = 3SE +/- 0.22, N = 3SE +/- 0.24, N = 3SE +/- 0.30, N = 3SE +/- 0.41, N = 3SE +/- 0.92, N = 3SE +/- 0.38, N = 3SE +/- 0.13, N = 3SE +/- 0.23, N = 3SE +/- 0.37, N = 3SE +/- 0.15, N = 3588.61587.38587.78589.69586.863485.21605.67587.84587.61587.74587.78

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power70140210280350SE +/- 0.60, N = 3SE +/- 0.69, N = 3SE +/- 0.63, N = 3SE +/- 0.22, N = 3SE +/- 0.44, N = 3SE +/- 0.07, N = 3SE +/- 0.78, N = 3SE +/- 0.82, N = 3SE +/- 0.09, N = 3SE +/- 0.63, N = 3SE +/- 0.25, N = 3306.68307.17307.72306.40307.2755.22297.14307.64307.89307.04307.71

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.26, N = 3SE +/- 0.28, N = 3SE +/- 0.52, N = 3SE +/- 0.15, N = 3SE +/- 0.30, N = 3SE +/- 0.96, N = 3SE +/- 0.54, N = 3SE +/- 0.48, N = 3SE +/- 0.11, N = 3SE +/- 0.29, N = 3SE +/- 0.11, N = 3207.88207.58207.27208.09207.671143.06214.47207.44207.19207.61207.33

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1632486480SE +/- 0.02, N = 3SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.18, N = 3SE +/- 0.05, N = 3SE +/- 0.00, N = 3SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 372.7873.2573.0372.4173.2713.0071.0172.9473.1473.0273.05

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.3.2Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Streamacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power10002000300040005000SE +/- 0.15, N = 3SE +/- 0.69, N = 3SE +/- 0.11, N = 3SE +/- 0.56, N = 3SE +/- 0.10, N = 3SE +/- 2.96, N = 3SE +/- 0.79, N = 3SE +/- 0.23, N = 3SE +/- 0.76, N = 3SE +/- 0.33, N = 3SE +/- 0.24, N = 3872.07867.83866.62876.33866.964868.11893.43867.93866.98868.08867.02

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Classroom - Compute: CPU-Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 0.09, N = 3SE +/- 0.10, N = 3SE +/- 0.07, N = 3SE +/- 0.03, N = 3SE +/- 0.12, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.09, N = 337.9237.7137.6137.8537.73254.4640.0437.6837.5737.9438.35

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Fishy Cat - Compute: CPU-Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.11, N = 3SE +/- 0.05, N = 3SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.18, N = 3SE +/- 0.16, N = 3SE +/- 0.10, N = 3SE +/- 0.09, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 319.0019.0118.9019.1818.89124.4820.2618.8018.9519.1719.74

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Barbershop - Compute: CPU-Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2004006008001000SE +/- 0.15, N = 3SE +/- 0.03, N = 3SE +/- 0.28, N = 3SE +/- 0.24, N = 3SE +/- 0.10, N = 3SE +/- 0.78, N = 3SE +/- 0.32, N = 3SE +/- 0.14, N = 3SE +/- 0.20, N = 3SE +/- 0.14, N = 3SE +/- 0.33, N = 3141.98140.45140.55141.91140.35933.41147.46140.18140.36141.79143.04

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 3.4Blend File: Pabellon Barcelona - Compute: CPU-Onlyacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 0.07, N = 3SE +/- 0.15, N = 3SE +/- 0.08, N = 3SE +/- 0.29, N = 3SE +/- 0.02, N = 3SE +/- 0.71, N = 3SE +/- 0.08, N = 3SE +/- 0.08, N = 3SE +/- 0.09, N = 3SE +/- 0.20, N = 3SE +/- 0.42, N = 345.9245.8545.9546.1945.77297.6748.4945.7245.7545.9946.73

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power48121620SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.06, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 315.4415.4915.4115.2415.522.5414.6315.5415.5515.5215.501. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Detection FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power5K10K15K20K25KSE +/- 2.84, N = 3SE +/- 4.16, N = 3SE +/- 5.84, N = 3SE +/- 15.80, N = 3SE +/- 4.79, N = 3SE +/- 217.31, N = 3SE +/- 8.81, N = 3SE +/- 8.61, N = 3SE +/- 9.11, N = 3SE +/- 4.72, N = 3SE +/- 6.67, N = 34041.314032.104054.304103.644030.7924236.974262.294015.914005.034030.034033.63MIN: 18903.29 / MAX: 30172.21. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power1224364860SE +/- 0.03, N = 3SE +/- 0.01, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.35, N = 3SE +/- 0.04, N = 3SE +/- 0.04, N = 352.7653.1253.0652.4853.038.3850.3553.0752.7953.0952.911. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Face Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power16003200480064008000SE +/- 0.25, N = 3SE +/- 0.38, N = 3SE +/- 1.11, N = 3SE +/- 0.24, N = 3SE +/- 0.68, N = 3SE +/- 16.67, N = 3SE +/- 0.52, N = 3SE +/- 0.45, N = 3SE +/- 8.32, N = 3SE +/- 0.15, N = 3SE +/- 0.05, N = 31203.421195.141195.761210.761195.237565.211260.491195.601203.521195.351199.87MIN: 7058.85 / MAX: 8272.071. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power8001600240032004000SE +/- 1.17, N = 3SE +/- 0.08, N = 3SE +/- 1.38, N = 3SE +/- 176.75, N = 15SE +/- 1.03, N = 3SE +/- 0.14, N = 3SE +/- 78.31, N = 12SE +/- 0.22, N = 3SE +/- 0.90, N = 3SE +/- 1.15, N = 3SE +/- 0.85, N = 33689.973741.353741.061960.303749.69596.041416.773748.173744.853738.043730.661. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Vehicle Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power20406080100SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 3.03, N = 15SE +/- 0.00, N = 3SE +/- 0.03, N = 3SE +/- 2.29, N = 12SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 317.3317.0917.0936.3517.05107.1746.4917.0617.0717.1017.14MIN: 9.07 / MAX: 83.28MIN: 9.82 / MAX: 80.61MIN: 9.24 / MAX: 81.88MIN: 7.98 / MAX: 137.61MIN: 9.39 / MAX: 80.76MIN: 59.84 / MAX: 344.36MIN: 8.5 / MAX: 147.24MIN: 9.02 / MAX: 83.41MIN: 8.56 / MAX: 80.26MIN: 9.33 / MAX: 84.63MIN: 9.37 / MAX: 88.861. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power60120180240300SE +/- 1.08, N = 3SE +/- 1.06, N = 3SE +/- 1.35, N = 3SE +/- 0.14, N = 3SE +/- 0.60, N = 3SE +/- 0.34, N = 15SE +/- 0.47, N = 3SE +/- 1.18, N = 3SE +/- 2.34, N = 3SE +/- 1.00, N = 3SE +/- 0.60, N = 3264.82268.04266.14279.33267.3051.52265.31266.96266.56267.15268.241. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Machine Translation EN To DE FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power30060090012001500SE +/- 1.01, N = 3SE +/- 0.97, N = 3SE +/- 1.21, N = 3SE +/- 0.15, N = 3SE +/- 0.54, N = 3SE +/- 7.94, N = 15SE +/- 0.48, N = 3SE +/- 1.09, N = 3SE +/- 2.12, N = 3SE +/- 0.82, N = 3SE +/- 0.51, N = 3241.17238.32239.94228.75239.021229.86240.82239.29239.70239.05238.16MIN: 599.82 / MAX: 5117.071. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power11002200330044005500SE +/- 0.47, N = 3SE +/- 0.80, N = 3SE +/- 0.71, N = 3SE +/- 1.03, N = 3SE +/- 2.23, N = 3SE +/- 0.10, N = 3SE +/- 0.59, N = 3SE +/- 1.37, N = 3SE +/- 0.41, N = 3SE +/- 0.95, N = 3SE +/- 1.46, N = 35250.155291.815292.425224.835292.08830.315029.055294.975291.005291.455277.021. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Weld Porosity Detection FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power306090120150SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 324.3624.1724.1724.4824.17153.7825.4324.1624.1724.1724.24MIN: 78.56 / MAX: 301.881. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power8001600240032004000SE +/- 13.56, N = 3SE +/- 4.78, N = 3SE +/- 6.58, N = 3SE +/- 155.56, N = 12SE +/- 4.65, N = 3SE +/- 1.43, N = 15SE +/- 113.70, N = 15SE +/- 6.01, N = 3SE +/- 3.54, N = 3SE +/- 3.07, N = 3SE +/- 8.08, N = 33621.583655.413663.481915.373678.91202.832062.043670.783679.313654.513645.601. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Person Vehicle Bike Detection FP16 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power70140210280350SE +/- 0.07, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 3SE +/- 2.27, N = 12SE +/- 0.02, N = 3SE +/- 2.16, N = 15SE +/- 1.86, N = 15SE +/- 0.03, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 317.6517.4817.4435.3917.37315.2632.4217.4117.3717.4917.53MIN: 86.78 / MAX: 701.541. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power8K16K24K32K40KSE +/- 1008.62, N = 15SE +/- 342.83, N = 5SE +/- 1216.09, N = 15SE +/- 946.71, N = 12SE +/- 1205.35, N = 12SE +/- 15.51, N = 3SE +/- 909.70, N = 12SE +/- 724.32, N = 12SE +/- 1139.15, N = 15SE +/- 1060.84, N = 15SE +/- 894.45, N = 1535666.6932979.7436248.3835501.2136428.765175.9633751.5835601.8336507.1135205.4736975.341. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.3Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power612182430SE +/- 0.10, N = 15SE +/- 0.04, N = 5SE +/- 0.11, N = 15SE +/- 0.10, N = 12SE +/- 0.12, N = 12SE +/- 0.07, N = 3SE +/- 0.11, N = 12SE +/- 0.07, N = 12SE +/- 0.10, N = 15SE +/- 0.10, N = 15SE +/- 0.09, N = 153.443.723.413.403.3924.553.553.453.383.513.32MIN: 5.27 / MAX: 260.671. (CXX) g++ options: -isystem -fsigned-char -ffunction-sections -fdata-sections -msse4.1 -msse4.2 -O3 -fno-strict-overflow -fwrapv -fPIC -fvisibility=hidden -Os -std=c++11 -MD -MT -MF

PyBench

Total For Average Test Times

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test Timesacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power2K4K6K8K10KSE +/- 9.13, N = 3SE +/- 5.81, N = 3SE +/- 7.81, N = 3SE +/- 5.81, N = 3SE +/- 3.28, N = 3SE +/- 41.93, N = 3SE +/- 2.85, N = 3SE +/- 6.01, N = 3SE +/- 4.04, N = 3SE +/- 0.88, N = 3SE +/- 7.22, N = 310061002999100410108775987998101010031008

nginx

Connections: 500

OpenBenchmarking.orgRequests Per Second, More Is Betternginx 1.23.2Connections: 500acpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power30K60K90K120K150KSE +/- 977.04, N = 3SE +/- 693.20, N = 3SE +/- 1781.93, N = 4SE +/- 208.90, N = 3SE +/- 684.93, N = 3SE +/- 131.35, N = 3SE +/- 115.95, N = 3SE +/- 1361.88, N = 3SE +/- 2024.19, N = 3SE +/- 1575.56, N = 5SE +/- 1620.42, N = 5149876.52147285.78146083.16122126.56151325.0127774.70138510.00147764.25152654.86146738.16145614.761. (CC) gcc options: -lluajit-5.1 -lm -lssl -lcrypto -lpthread -ldl -std=c99 -O2

PHPBench

PHP Benchmark Suite

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark Suiteacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power150K300K450K600K750KSE +/- 5594.67, N = 3SE +/- 4034.04, N = 3SE +/- 2191.80, N = 3SE +/- 5843.40, N = 3SE +/- 3225.60, N = 3SE +/- 423.55, N = 3SE +/- 5021.57, N = 3SE +/- 5808.55, N = 12SE +/- 4455.74, N = 3SE +/- 2423.31, N = 3SE +/- 981.48, N = 370821869981669878570534170121579570711125697478700287687682671207

BRL-CAD

VGR Performance Metric

OpenBenchmarking.orgVGR Performance Metric, More Is BetterBRL-CAD 7.34VGR Performance Metricacpi_cpufreq ondemandacpi_cpufreq performanceacpi_cpufreq schedutilamd_pstate ondemandamd_pstate performanceamd_pstate powersaveamd_pstate schedutilamd_pstate_epp performance balance_performanceamd_pstate_epp performance performanceamd_pstate_epp powersave balance_performanceamd_pstate_epp powersave power600K1200K1800K2400K3000K28142692921572302117128637422815356405614283650429051812980719285398328639511. (CXX) g++ options: -std=c++14 -pipe -fvisibility=hidden -fno-strict-aliasing -fno-common -fexceptions -ftemplate-depth-128 -m64 -ggdb3 -O3 -fipa-pta -fstrength-reduce -finline-functions -flto -ltcl8.6 -lregex_brl -lz_brl -lnetpbm -ldl -lm -ltk8.6

Phoronix Test Suite v10.8.4