AMD EPYC Turin AVX-512 Comparison

AMD EPYC 9755 AVX-512 comparison by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2410104-NE-TURINAVX566&sro.

AMD EPYC Turin AVX-512 ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionAVX-512 OffAVX-512 256b DPAVX-512 512b DPAMD EPYC 9755 128-Core @ 2.70GHz (128 Cores / 256 Threads)AMD VOLCANO (RVOT1000D BIOS)AMD Device 153a12 x 64GB DDR5-6000MT/s Samsung M321R8GA0PB1-CCPKC2 x 1920GB KIOXIA KCD8XPUG1T92ASPEEDBroadcom NetXtreme BCM5720 PCIeUbuntu 24.046.10.0-phx (x86_64)GCC 13.2.0ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xb002110 Python Details- Python 3.12.2Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD EPYC Turin AVX-512 Comparisonminibude: OpenMP - BM1minibude: OpenMP - BM1minibude: OpenMP - BM2minibude: OpenMP - BM2namd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomsgromacs: MPI CPU - water_GMX50_bareopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timesimdjson: PartialTweetssimdjson: LargeRandsimdjson: Kostyasimdjson: DistinctUserIDsimdjson: TopTweetembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownopenvkl: vklBenchmarkCPU ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 2 - 4K - 1 - Path Tracer - CPUospray-studio: 2 - 4K - 16 - Path Tracer - CPUospray-studio: 2 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUy-cruncher: 1By-cruncher: 5By-cruncher: 10Bxmrig: GhostRider - 1Msmhasher: FarmHash32 x86_64 AVXsmhasher: FarmHash32 x86_64 AVXonednn: Convolution Batch Shapes Auto - CPUonednn: Deconvolution Batch shapes_3d - CPUonednn: IP Shapes 3D - CPUonednn: Recurrent Neural Network Training - CPUpytorch: CPU - 1 - ResNet-50pytorch: CPU - 256 - ResNet-50pytorch: CPU - 512 - ResNet-50tensorflow: CPU - 256 - ResNet-50tensorflow: CPU - 512 - ResNet-50openvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUmnn: mobilenetV3mnn: resnet-v2-50libxsmm: 128onnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet101_DUC_HDC-12 - CPU - Standardonnx: ResNet101_DUC_HDC-12 - CPU - Standardnumpy: svt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 5 - Bosphorus 4Ksvt-av1: Preset 3 - Bosphorus 4KAVX-512 OffAVX-512 256b DPAVX-512 512b DP4882.808195.3124790.132191.6057.000682.2809718.35020.421965161.951947.301.404.697.647.49205.9535178.4839167.0048309931.719030.607242.13167141139622869719114512295583613357308208.02031.24561.25616826.732099.0326.5120.3739251.312143.14198447.79845.0538.3838.82158.25179.25117.14544.38165052.360.57382.43167.0711702.4410.756189.6910.264150.4515.32398.57160.3419828.796.291861.7268.682626.8324.304727.3513.353010.6342.422.05510.0533431.77.89424127.019161.9646.1739517.058259.0304181.5565.5057838.838025.74575.50491181.736739.69378.434101.84446.24513.0388221.739328.8707916.409316.65613.310024.1702619.54419.976723163.51458.601.575.668.998.84221.3817190.1200178.1347356045.408744.787649.34996711073321539675108162164679112693253937.75124.60247.27117480.434422.4126.8850.3500340.7003790.323221482.88151.6343.5543.50190.08221.25137.51463.88175156.040.55710.9889.9013579.909.258450.687.488024.137.90866.8373.7324619.045.044203.2130.352855.3422.3610058.846.2910112.3411.791.9808.8513652.98.92861112.542162.9606.1392617.920955.8217191.1765.2286244.612922.43635.67626177.487794.98388.542108.12448.59513.7629884.254395.3709676.254387.05014.182934.6256522.83920.24893160.997429.461.595.909.929.87223.1431191.6390179.6822366046.972146.326950.90156391016920379642102312043875211963240307.78924.06745.85520005.234394.9826.4910.2576320.5090190.322331425.22052.3343.8543.39203.33246.10194.04329.05192118.560.48766.9983.3218690.326.6011239.495.618755.757.211111.6957.4731620.583.874780.2426.633297.8519.2913925.764.4910450.9810.751.8727.6743764.410.329996.8050206.8234.8348121.599846.3369192.8375.1836943.822222.84736.96791143.940795.31400.898114.98050.73714.278OpenBenchmarking.org

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 3.23, N = 10SE +/- 2.65, N = 11SE +/- 3.11, N = 88221.749884.254882.811. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 256b DPAVX-512 512b DPAVX-512 Off90180270360450SE +/- 0.13, N = 10SE +/- 0.11, N = 11SE +/- 0.12, N = 8328.87395.37195.311. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.511.522.51.7502.2220.795

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270030394174AVX-512 512b DP270029104157AVX-512 Off270030334152OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

miniBUDE

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.3188.0444.4AVX-512 512b DP44.2177.9461.5AVX-512 Off44.9245.6458.2OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption Monitor120240360480600

miniBUDE

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.842.647.4AVX-512 512b DP27.541.245.8AVX-512 Off28.446.051.5OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature Monitor1530456075

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 17.43, N = 4SE +/- 105.52, N = 4SE +/- 15.88, N = 37916.419676.254790.131. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 256b DPAVX-512 512b DPAVX-512 Off80160240320400SE +/- 0.70, N = 4SE +/- 4.22, N = 4SE +/- 0.64, N = 3316.66387.05191.611. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.25610.51220.76831.02441.28050.9351.1380.498

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033044147AVX-512 512b DP270030044146AVX-512 Off270031844148OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

miniBUDE

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6338.8454.7AVX-512 512b DP44.3340.0464.3AVX-512 Off24.3384.9460.6OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption Monitor120240360480600

miniBUDE

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.852.758.4AVX-512 512b DP29.651.857.6AVX-512 Off32.155.060.1OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature Monitor1632486480

NAMD

Input: ATPase with 327,506 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsAVX-512 256b DPAVX-512 512b DPAVX-512 Off48121620SE +/- 0.02496, N = 7SE +/- 0.06451, N = 7SE +/- 0.01866, N = 313.3100214.182937.00068

NAMD

Input: ATPase with 327,506 Atoms

OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.01690.03380.05070.06760.08450.0670.0750.040

NAMD

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033384158AVX-512 512b DP270032534149AVX-512 Off270036894147OpenBenchmarking.orgMegahertz, More Is BetterNAMD 3.0b6CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

NAMD

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7198.0427.6AVX-512 512b DP44.8188.3410.9AVX-512 Off44.9173.2453.4OpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption Monitor120240360480600

NAMD

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.943.747.6AVX-512 512b DP34.141.945.4AVX-512 Off35.944.551.1OpenBenchmarking.orgCelsius, Fewer Is BetterNAMD 3.0b6CPU Temperature Monitor1530456075

NAMD

Input: STMV with 1,066,628 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsAVX-512 256b DPAVX-512 512b DPAVX-512 Off1.04082.08163.12244.16325.204SE +/- 0.00881, N = 4SE +/- 0.00436, N = 4SE +/- 0.00213, N = 34.170264.625652.28097

NAMD

Input: STMV with 1,066,628 Atoms

OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.00430.00860.01290.01720.02150.0160.0190.009

NAMD

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270034804149AVX-512 512b DP255433624151AVX-512 Off270034474182OpenBenchmarking.orgMegahertz, More Is BetterNAMD 3.0b6CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

NAMD

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.8264.6450.8AVX-512 512b DP44.7248.5427.4AVX-512 Off44.6249.2463.8OpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption Monitor120240360480600

NAMD

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP32.447.353.4AVX-512 512b DP31.444.850.5AVX-512 Off33.547.856.1OpenBenchmarking.orgCelsius, Fewer Is BetterNAMD 3.0b6CPU Temperature Monitor1632486480

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 256b DPAVX-512 512b DPAVX-512 Off510152025SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 319.5422.8418.351. (CXX) g++ options: -O3 -lm

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day Per Watt, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.01510.03020.04530.06040.07550.0570.0670.052

GROMACS

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270035044148AVX-512 512b DP270034894155AVX-512 Off270033734150OpenBenchmarking.orgMegahertz, More Is BetterGROMACS 2024CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

GROMACS

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5343.3467.5AVX-512 512b DP22.2339.4488.1AVX-512 Off44.6350.2475.6OpenBenchmarking.orgWatts, Fewer Is BetterGROMACS 2024CPU Power Consumption Monitor130260390520650

GROMACS

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.352.758.3AVX-512 512b DP33.151.757.6AVX-512 Off33.453.659.9OpenBenchmarking.orgCelsius, Fewer Is BetterGROMACS 2024CPU Temperature Monitor1632486480

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeAVX-512 256b DPAVX-512 512b DPAVX-512 Off51015202519.9820.2520.421. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033904150AVX-512 512b DP270033874174AVX-512 Off270034134156OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenFOAM

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0373.7491.3AVX-512 512b DP44.5371.0490.5AVX-512 Off45.0381.9490.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption Monitor130260390520650

OpenFOAM

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.153.659.8AVX-512 512b DP35.352.759.0AVX-512 Off36.453.960.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200163.51161.00161.951. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270035764152AVX-512 512b DP270035494168AVX-512 Off270035764155OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenFOAM

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0447.3491.2AVX-512 512b DP44.5446.4488.5AVX-512 Off45.1446.9489.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption Monitor130260390520650

OpenFOAM

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.859.561.6AVX-512 512b DP35.359.362.0AVX-512 Off36.359.962.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: PartialTweetsAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.09, N = 6SE +/- 0.09, N = 15SE +/- 0.04, N = 38.609.467.301. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: PartialTweetsAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02340.04680.07020.09360.1170.0950.1040.079

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040584146AVX-512 512b DP270040574156AVX-512 Off270040594140OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.390.794.8AVX-512 512b DP44.391.296.1AVX-512 Off44.791.895.2OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP33.937.941.6AVX-512 512b DP32.437.944.0AVX-512 Off36.541.843.8OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1224364860

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: LargeRandomAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.35780.71561.07341.43121.789SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.571.591.401. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: LargeRandomAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.00380.00760.01140.01520.0190.0170.0170.015

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040714152AVX-512 512b DP270040684141AVX-512 Off270040294145OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.693.297.0AVX-512 512b DP44.193.497.4AVX-512 Off44.792.396.6OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.836.938.4AVX-512 512b DP27.537.139.3AVX-512 Off30.139.641.4OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1122334455

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: KostyaAVX-512 256b DPAVX-512 512b DPAVX-512 Off1.32752.6553.98255.316.6375SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.665.904.691. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: KostyaAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.01350.0270.04050.0540.06750.0580.0600.048

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040654146AVX-512 512b DP270040774160AVX-512 Off270040744158OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.498.0101.5AVX-512 512b DP44.398.3102.4AVX-512 Off45.397.9101.5OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.839.441.8AVX-512 512b DP27.338.541.4AVX-512 Off29.439.940.9OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1224364860

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.04, N = 3SE +/- 0.12, N = 4SE +/- 0.02, N = 38.999.927.641. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02450.0490.07350.0980.12250.0990.1090.084

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040484138AVX-512 512b DP270040504153AVX-512 Off270040624152OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.290.894.7AVX-512 512b DP44.191.494.7AVX-512 Off45.491.496.9OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP28.036.537.4AVX-512 512b DP27.837.639.5AVX-512 Off29.639.141.5OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1122334455

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: TopTweetAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.849.877.491. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: TopTweetAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02430.04860.07290.09720.12150.0970.1080.082

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040594158AVX-512 512b DP270040694158AVX-512 Off270040514141OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.090.895.9AVX-512 512b DP44.291.795.7AVX-512 Off44.591.595.0OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.437.939.4AVX-512 512b DP27.137.839.8AVX-512 Off29.339.541.3OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1122334455

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 256b DPAVX-512 512b DPAVX-512 Off50100150200250SE +/- 0.05, N = 8SE +/- 0.09, N = 8SE +/- 0.08, N = 8221.38223.14205.95MIN: 217.86 / MAX: 225.89MIN: 218.68 / MAX: 229MIN: 202.63 / MAX: 210.88

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.22250.4450.66750.891.11250.9890.9790.885

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031784156AVX-512 512b DP270031664157AVX-512 Off270030624146OpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Embree

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.3223.9464.9AVX-512 512b DP44.4227.9466.7AVX-512 Off44.4232.8466.4OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption Monitor120240360480600

Embree

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.640.845.4AVX-512 512b DP27.340.245.0AVX-512 Off29.442.647.1OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature Monitor1428425670

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.11, N = 5SE +/- 0.08, N = 5SE +/- 0.17, N = 5190.12191.64178.48MIN: 186.67 / MAX: 194.33MIN: 188.18 / MAX: 196.08MIN: 174.73 / MAX: 183.09

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.24590.49180.73770.98361.22951.0881.0930.962

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270035754146AVX-512 512b DP270035794139AVX-512 Off270035404150OpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Embree

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5174.7461.6AVX-512 512b DP44.5175.3465.8AVX-512 Off44.8185.6465.5OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption Monitor120240360480600

Embree

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.442.145.6AVX-512 512b DP30.841.744.9AVX-512 Off32.843.947.5OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature Monitor1428425670

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.12, N = 8SE +/- 0.09, N = 8SE +/- 0.18, N = 8178.13179.68167.00MIN: 173.22 / MAX: 184.71MIN: 174.97 / MAX: 186.29MIN: 162.73 / MAX: 173.25

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.15820.31640.47460.63280.7910.6960.7030.638

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031084151AVX-512 512b DP270031144169AVX-512 Off270031004146OpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Embree

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5255.9472.2AVX-512 512b DP44.3255.6483.0AVX-512 Off44.9262.0473.8OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption Monitor120240360480600

Embree

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.144.749.3AVX-512 512b DP30.844.148.8AVX-512 Off33.046.651.6OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature Monitor1530456075

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 256b DPAVX-512 512b DPAVX-512 Off8001600240032004000SE +/- 1.76, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3356036603099MIN: 284 / MAX: 41727MIN: 293 / MAX: 42710MIN: 245 / MAX: 36357

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 256b DPAVX-512 512b DPAVX-512 Off36912159.0559.1807.791

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 2.0.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 256b DPAVX-512 512b DPAVX-512 Off7001400210028003500Min: 2700 / Avg: 3662.48 / Max: 4157Min: 2700 / Avg: 3603.43 / Max: 4154Min: 2700 / Avg: 3535.06 / Max: 4152

OpenVKL

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 2.0.0CPU Power Consumption MonitorAVX-512 256b DPAVX-512 512b DPAVX-512 Off90180270360450Min: 44.39 / Avg: 393.15 / Max: 472.86Min: 45.15 / Avg: 398.69 / Max: 481.96Min: 45.12 / Avg: 397.74 / Max: 490.78

OpenVKL

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 2.0.0CPU Temperature MonitorAVX-512 256b DPAVX-512 512b DPAVX-512 Off1224364860Min: 32.88 / Avg: 54.99 / Max: 60.5Min: 32.63 / Avg: 56.14 / Max: 61.88Min: 34.75 / Avg: 56.31 / Max: 61.63

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off1122334455SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.01, N = 345.4146.9731.72

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02430.04860.07290.09720.12150.1080.1080.077

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270034444141AVX-512 512b DP270033644151AVX-512 Off270033744147OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.1421.3481.5AVX-512 512b DP45.0433.1492.2AVX-512 Off44.9411.2479.1OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption Monitor130260390520650

OSPRay

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.457.260.4AVX-512 512b DP37.959.662.6AVX-512 Off36.556.860.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature Monitor20406080100

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off1122334455SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 344.7946.3330.61

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02410.04820.07230.09640.12050.1060.1070.074

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270034574142AVX-512 512b DP270033724148AVX-512 Off270033764149OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0422.3481.7AVX-512 512b DP44.7431.5491.6AVX-512 Off45.1415.0485.0OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption Monitor130260390520650

OSPRay

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.657.660.9AVX-512 512b DP39.159.862.9AVX-512 Off37.857.561.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature Monitor20406080100

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off1122334455SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 349.3550.9042.13

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02790.05580.08370.11160.13950.1210.1240.101

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032884150AVX-512 512b DP270032244149AVX-512 Off270032144148OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.9406.8463.2AVX-512 512b DP44.8412.0469.6AVX-512 Off44.9418.8472.1OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption Monitor120240360480600

OSPRay

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.655.959.8AVX-512 512b DP39.558.261.0AVX-512 Off37.857.560.3OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature Monitor20406080100

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off150300450600750SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.00, N = 3671639714

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033294145AVX-512 512b DP270032244153AVX-512 Off270032244143OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0367.5458.2AVX-512 512b DP44.7370.3465.6AVX-512 Off44.8369.4466.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.954.058.5AVX-512 512b DP36.555.760.0AVX-512 Off34.653.958.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor1632486480

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 5.86, N = 3SE +/- 9.28, N = 3SE +/- 7.69, N = 3107331016911396

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033344151AVX-512 512b DP270032214152AVX-512 Off270032284144OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.8357.7460.6AVX-512 512b DP44.8358.8465.2AVX-512 Off44.9363.4473.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.353.757.8AVX-512 512b DP39.155.159.8AVX-512 Off37.653.757.8OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor1632486480

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off5K10K15K20K25KSE +/- 6.39, N = 3SE +/- 25.38, N = 3SE +/- 34.33, N = 3215392037922869

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032724134AVX-512 512b DP270031734139AVX-512 Off270031664142OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5386.0462.4AVX-512 512b DP46.1382.7467.1AVX-512 Off45.6388.1468.7OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.654.558.5AVX-512 512b DP38.456.760.9AVX-512 Off37.054.758.9OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off160320480640800SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3675642719

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033314145AVX-512 512b DP270032544154AVX-512 Off270032484155OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5368.4462.2AVX-512 512b DP45.2370.9468.2AVX-512 Off44.9370.4472.3OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.053.858.0AVX-512 512b DP39.656.360.6AVX-512 Off37.054.458.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 11.85, N = 3SE +/- 10.11, N = 3SE +/- 2.85, N = 3108161023111451

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033424155AVX-512 512b DP270032414152AVX-512 Off270032484143OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7357.9461.6AVX-512 512b DP45.3360.9473.7AVX-512 Off45.2365.7470.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.353.958.5AVX-512 512b DP39.156.060.6AVX-512 Off36.953.558.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off5K10K15K20K25KSE +/- 8.65, N = 3SE +/- 8.88, N = 3SE +/- 25.87, N = 3216462043822955

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033024150AVX-512 512b DP270031944144AVX-512 Off270031924150OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7386.9462.6AVX-512 512b DP45.4386.9474.9AVX-512 Off44.9391.0472.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.655.158.5AVX-512 512b DP39.357.360.9AVX-512 Off37.155.258.6OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2004006008001000SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3791752836

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033124144AVX-512 512b DP270032234141AVX-512 Off270032264140OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7367.6460.8AVX-512 512b DP44.7374.4467.4AVX-512 Off45.1370.3467.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.154.158.1AVX-512 512b DP39.356.760.9AVX-512 Off37.054.158.3OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3K6K9K12K15KSE +/- 7.80, N = 3SE +/- 7.06, N = 3SE +/- 13.35, N = 3126931196313357

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033194144AVX-512 512b DP270032104162AVX-512 Off270031714148OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.3370.7460.9AVX-512 512b DP44.8371.3471.7AVX-512 Off45.0400.4471.8OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.854.558.6AVX-512 512b DP39.356.260.9AVX-512 Off36.855.358.9OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off7K14K21K28K35KSE +/- 2.00, N = 3SE +/- 20.00, N = 3SE +/- 109.14, N = 3253932403030820

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032844151AVX-512 512b DP270031704151AVX-512 Off270033074153OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7393.5461.3AVX-512 512b DP45.4393.5473.2AVX-512 Off45.0321.5470.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.655.459.1AVX-512 512b DP39.157.661.1AVX-512 Off37.551.557.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 1BAVX-512 256b DPAVX-512 512b DPAVX-512 Off246810SE +/- 0.005, N = 5SE +/- 0.012, N = 5SE +/- 0.014, N = 57.7517.7898.020

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP269536924151AVX-512 512b DP270036254154AVX-512 Off246436004155OpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Y-Cruncher

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6231.0415.0AVX-512 512b DP44.8230.3409.3AVX-512 Off44.5240.3448.1OpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption Monitor120240360480600

Y-Cruncher

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.442.346.8AVX-512 512b DP33.544.248.5AVX-512 Off32.044.349.6OpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature Monitor1428425670

Y-Cruncher

Pi Digits To Calculate: 5B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 5BAVX-512 256b DPAVX-512 512b DPAVX-512 Off714212835SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 324.6024.0731.25

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP263836164146AVX-512 512b DP206335044142AVX-512 Off243736014157OpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Y-Cruncher

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.9316.2491.2AVX-512 512b DP44.9311.2489.1AVX-512 Off44.6320.5498.2OpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption Monitor130260390520650

Y-Cruncher

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.848.254.6AVX-512 512b DP34.149.655.9AVX-512 Off32.851.860.0OpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature Monitor1632486480

Y-Cruncher

Pi Digits To Calculate: 10B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 10BAVX-512 256b DPAVX-512 512b DPAVX-512 Off1428425670SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 347.2745.8661.26

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP261336384155AVX-512 512b DP207735304160AVX-512 Off246535964148OpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Y-Cruncher

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7346.4503.6AVX-512 512b DP44.9337.9496.7AVX-512 Off45.0344.8505.2OpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption Monitor130260390520650

Y-Cruncher

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.350.856.5AVX-512 512b DP35.951.957.6AVX-512 Off34.854.661.6OpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature Monitor20406080100

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MAVX-512 256b DPAVX-512 512b DPAVX-512 Off4K8K12K16K20KSE +/- 973.55, N = 15SE +/- 779.44, N = 15SE +/- 973.00, N = 1517480.420005.216826.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MAVX-512 256b DPAVX-512 512b DPAVX-512 Off112233445542.2947.0740.85

Xmrig

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040134153AVX-512 512b DP270039554136AVX-512 Off270040114140OpenBenchmarking.orgMegahertz, More Is BetterXmrig 6.21CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Xmrig

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP23.4413.3484.4AVX-512 512b DP45.0425.0483.0AVX-512 Off44.9411.9480.5OpenBenchmarking.orgWatts, Fewer Is BetterXmrig 6.21CPU Power Consumption Monitor120240360480600

Xmrig

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP25.655.660.1AVX-512 512b DP28.959.263.0AVX-512 Off26.155.760.3OpenBenchmarking.orgCelsius, Fewer Is BetterXmrig 6.21CPU Temperature Monitor20406080100

SMHasher

Hash: FarmHash32 x86_64 AVX

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 256b DPAVX-512 512b DPAVX-512 Off7K14K21K28K35KSE +/- 20.30, N = 6SE +/- 23.52, N = 6SE +/- 19.92, N = 634422.4134394.9832099.031. (CXX) g++ options: -march=native -O3 -flto=auto -fno-fat-lto-objects

SMHasher

Hash: FarmHash32 x86_64 AVX

OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 256b DPAVX-512 512b DPAVX-512 Off612182430SE +/- 0.38, N = 6SE +/- 0.01, N = 6SE +/- 0.26, N = 626.8926.4926.511. (CXX) g++ options: -march=native -O3 -flto=auto -fno-fat-lto-objects

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Convolution Batch Shapes Auto - Engine: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.08410.16820.25230.33640.4205SE +/- 0.000363, N = 7SE +/- 0.000532, N = 7SE +/- 0.000549, N = 70.3500340.2576320.373925MIN: 0.33MIN: 0.25MIN: 0.351. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032894145AVX-512 512b DP270028844153AVX-512 Off270031464042OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7236.8397.5AVX-512 512b DP44.8208.7377.1AVX-512 Off44.7236.4416.4OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption Monitor110220330440550

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.845.248.8AVX-512 512b DP40.145.849.0AVX-512 Off37.145.649.4OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature Monitor1428425670

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.29520.59040.88561.18081.476SE +/- 0.000342, N = 9SE +/- 0.000468, N = 9SE +/- 0.001041, N = 90.7003790.5090191.312140MIN: 0.68MIN: 0.48MIN: 1.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP217230494150AVX-512 512b DP255927304150AVX-512 Off270031604144OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5170.8350.1AVX-512 512b DP44.6155.0307.5AVX-512 Off44.7169.7341.3OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption Monitor100200300400500

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP32.539.842.4AVX-512 512b DP33.940.342.5AVX-512 Off31.944.948.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature Monitor1428425670

oneDNN

Harness: IP Shapes 3D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.70691.41382.12072.82763.5345SE +/- 0.000924, N = 5SE +/- 0.000544, N = 5SE +/- 0.003218, N = 50.3232210.3223313.141980MIN: 3.071. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270035364145AVX-512 512b DP270035284155AVX-512 Off270037304152OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5199.6293.3AVX-512 512b DP44.6201.5293.5AVX-512 Off44.8165.9308.6OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption Monitor80160240320400

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.638.040.5AVX-512 512b DP33.340.443.0AVX-512 Off31.438.040.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature Monitor1224364860

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off100200300400500SE +/- 0.27, N = 3SE +/- 0.60, N = 3SE +/- 0.35, N = 3482.88425.22447.80MIN: 478.35MIN: 418.82MIN: 443.231. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270037904156AVX-512 512b DP188632984162AVX-512 Off248731934143OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4307.2401.2AVX-512 512b DP44.9270.5371.2AVX-512 Off44.7313.7425.2OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption Monitor110220330440550

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.848.751.6AVX-512 512b DP33.348.250.9AVX-512 Off30.147.152.4OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature Monitor1530456075

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off1224364860SE +/- 0.12, N = 3SE +/- 0.38, N = 3SE +/- 0.23, N = 351.6352.3345.05MIN: 48.86 / MAX: 52.93MIN: 49.93 / MAX: 54.1MIN: 43.23 / MAX: 46.3

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.04930.09860.14790.19720.24650.2190.2170.179

PyTorch

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270039274157AVX-512 512b DP270039524153AVX-512 Off270039464143OpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

PyTorch

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.8235.7297.7AVX-512 512b DP45.2240.8304.4AVX-512 Off22.4251.8308.7OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption Monitor80160240320400

PyTorch

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.040.943.0AVX-512 512b DP36.944.246.6AVX-512 Off33.841.844.4OpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature Monitor1428425670

PyTorch

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off1020304050SE +/- 0.31, N = 3SE +/- 0.55, N = 3SE +/- 0.43, N = 343.5543.8538.38MIN: 41.56 / MAX: 44.75MIN: 41.39 / MAX: 45.93MIN: 36.82 / MAX: 39.67

PyTorch

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.03580.07160.10740.14320.1790.1590.1580.135

PyTorch

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040374153AVX-512 512b DP270040374151AVX-512 Off270040304144OpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

PyTorch

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5273.2315.2AVX-512 512b DP44.9277.5320.5AVX-512 Off45.0284.8324.2OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption Monitor80160240320400

PyTorch

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.341.644.1AVX-512 512b DP34.845.447.6AVX-512 Off31.642.844.9OpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature Monitor1428425670

PyTorch

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off1020304050SE +/- 0.34, N = 3SE +/- 0.52, N = 4SE +/- 0.08, N = 343.5043.3938.82MIN: 41.09 / MAX: 44.92MIN: 40.31 / MAX: 44.91MIN: 37.4 / MAX: 39.86

PyTorch

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.03580.07160.10740.14320.1790.1590.1560.136

PyTorch

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040394151AVX-512 512b DP270040234143AVX-512 Off270040364145OpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

PyTorch

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4272.9314.1AVX-512 512b DP45.3277.9321.2AVX-512 Off45.3286.1324.5OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption Monitor80160240320400

PyTorch

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP32.142.043.9AVX-512 512b DP35.845.748.1AVX-512 Off32.443.245.4OpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature Monitor1428425670

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.40, N = 3SE +/- 0.98, N = 3SE +/- 0.47, N = 3190.08203.33158.25

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.14830.29660.44490.59320.74150.5210.6590.477

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270038354148AVX-512 512b DP262332474165AVX-512 Off254032154156OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.16.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

TensorFlow

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4364.6400.7AVX-512 512b DP45.3308.4336.5AVX-512 Off44.9331.5366.1OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption Monitor110220330440550

TensorFlow

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.349.551.1AVX-512 512b DP33.547.850.3AVX-512 Off30.647.148.5OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.16.1CPU Temperature Monitor1530456075

TensorFlow

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off50100150200250SE +/- 0.23, N = 3SE +/- 0.45, N = 3SE +/- 0.20, N = 3221.25246.10179.25

TensorFlow

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.1640.3280.4920.6560.820.5700.7290.491

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270038024147AVX-512 512b DP199332434144AVX-512 Off229433284155OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.16.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

TensorFlow

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0388.4431.1AVX-512 512b DP45.1337.6366.3AVX-512 Off44.9365.3399.9OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption Monitor110220330440550

TensorFlow

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP33.851.752.9AVX-512 512b DP35.650.654.8AVX-512 Off32.850.252.9OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.16.1CPU Temperature Monitor1530456075

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.02, N = 3SE +/- 0.46, N = 3SE +/- 0.07, N = 3137.51194.04117.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off120240360480600SE +/- 0.07, N = 3SE +/- 0.76, N = 3SE +/- 0.31, N = 3463.88329.05544.38MIN: 405.2 / MAX: 482.04MIN: 146.73 / MAX: 360.28MIN: 261.15 / MAX: 569.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031824150AVX-512 512b DP228024754150AVX-512 Off256327674146OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.3389.6438.2AVX-512 512b DP44.9362.1406.0AVX-512 Off44.9383.0429.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor110220330440550

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.554.357.6AVX-512 512b DP37.054.757.5AVX-512 Off33.853.556.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off40K80K120K160K200KSE +/- 517.64, N = 3SE +/- 544.06, N = 3SE +/- 339.72, N = 3175156.04192118.56165052.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.12830.25660.38490.51320.6415SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.550.480.57MIN: 0.18 / MAX: 22.43MIN: 0.13 / MAX: 25.07MIN: 0.2 / MAX: 26.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270034424163AVX-512 512b DP270031704142AVX-512 Off270031924152OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5365.4401.5AVX-512 512b DP45.1331.6366.3AVX-512 Off45.0366.1402.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor110220330440550

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.351.153.0AVX-512 512b DP37.551.653.5AVX-512 Off35.151.453.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1530456075

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off170340510680850SE +/- 0.61, N = 3SE +/- 0.42, N = 3SE +/- 0.04, N = 3710.98766.99382.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 389.9083.32167.07MIN: 40.69 / MAX: 160.4MIN: 35.6 / MAX: 146.57MIN: 75.83 / MAX: 256.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032264168AVX-512 512b DP264227684162AVX-512 Off270030314147OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7431.6479.6AVX-512 512b DP44.9387.3431.5AVX-512 Off45.2423.0469.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.156.158.9AVX-512 512b DP36.655.757.9AVX-512 Off34.355.958.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off4K8K12K16K20KSE +/- 5.42, N = 3SE +/- 12.83, N = 3SE +/- 1.96, N = 313579.9018690.3211702.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 39.256.6010.75MIN: 4.08 / MAX: 21.6MIN: 2.24 / MAX: 26.72MIN: 4.66 / MAX: 32.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031014145AVX-512 512b DP220024144152AVX-512 Off263028134149OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.8392.6427.0AVX-512 512b DP44.8358.6390.9AVX-512 Off45.0387.6424.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor110220330440550

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.654.456.6AVX-512 512b DP37.654.256.0AVX-512 Off35.553.956.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 0.88, N = 3SE +/- 0.53, N = 3SE +/- 1.18, N = 38450.6811239.496189.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 37.485.6110.26MIN: 4.14 / MAX: 23.69MIN: 2.24 / MAX: 30.88MIN: 6.21 / MAX: 38.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031474154AVX-512 512b DP238025734150AVX-512 Off268828234156OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.4410.7449.1AVX-512 512b DP44.7390.5426.8AVX-512 Off23.2407.5446.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.455.558.0AVX-512 512b DP37.456.658.9AVX-512 Off34.855.357.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 14.15, N = 3SE +/- 25.40, N = 3SE +/- 9.55, N = 38024.138755.754150.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off48121620SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 37.907.2115.32MIN: 5.02 / MAX: 29.4MIN: 4.13 / MAX: 25.4MIN: 7.91 / MAX: 45.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031464153AVX-512 512b DP239425224152AVX-512 Off270028754145OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.2409.7452.7AVX-512 512b DP27.6352.3395.0AVX-512 Off45.4398.5449.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.555.357.9AVX-512 512b DP38.653.054.8AVX-512 Off35.853.455.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2004006008001000SE +/- 1.32, N = 3SE +/- 5.73, N = 3SE +/- 0.88, N = 3866.831111.69398.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.34, N = 373.7357.47160.34MIN: 35.26 / MAX: 113MIN: 26.92 / MAX: 106.12MIN: 88.77 / MAX: 245.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032724195AVX-512 512b DP241627334152AVX-512 Off254127234153OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.3435.9487.1AVX-512 512b DP44.7435.0493.2AVX-512 Off45.0415.4462.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor130260390520650

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.657.160.0AVX-512 512b DP36.659.362.1AVX-512 Off34.855.057.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor20406080100

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off7K14K21K28K35KSE +/- 4.94, N = 3SE +/- 23.78, N = 3SE +/- 6.94, N = 324619.0431620.5819828.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 35.043.876.29MIN: 2.51 / MAX: 19.14MIN: 1.69 / MAX: 21.99MIN: 3.06 / MAX: 24.121. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270030974152AVX-512 512b DP233626014149AVX-512 Off269728914145OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6402.2440.8AVX-512 512b DP45.3377.8414.0AVX-512 Off45.2398.8437.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.455.057.3AVX-512 512b DP39.556.057.9AVX-512 Off35.855.157.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off10002000300040005000SE +/- 2.89, N = 3SE +/- 1.88, N = 3SE +/- 1.11, N = 34203.214780.241861.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off1530456075SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 330.3526.6368.68MIN: 17.71 / MAX: 42.78MIN: 15.61 / MAX: 47.58MIN: 40.62 / MAX: 87.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270029654148AVX-512 512b DP261327674147AVX-512 Off252026144162OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4428.9467.6AVX-512 512b DP44.7428.1471.7AVX-512 Off45.0410.7448.5OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.155.858.3AVX-512 512b DP38.059.161.5AVX-512 Off35.154.356.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor20406080100

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off7001400210028003500SE +/- 3.53, N = 3SE +/- 5.22, N = 3SE +/- 0.80, N = 32855.343297.852626.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off612182430SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 322.3619.2924.30MIN: 11.44 / MAX: 40.97MIN: 9.84 / MAX: 44.85MIN: 13.82 / MAX: 53.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031874144AVX-512 512b DP258527234144AVX-512 Off270030214157OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.2410.6455.6AVX-512 512b DP45.0367.8407.6AVX-512 Off45.9426.7471.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.155.257.5AVX-512 512b DP39.454.556.3AVX-512 Off35.556.659.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3K6K9K12K15KSE +/- 6.22, N = 3SE +/- 7.20, N = 3SE +/- 1.32, N = 310058.8413925.764727.351. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 36.294.4913.35MIN: 3.16 / MAX: 20.63MIN: 1.96 / MAX: 22.35MIN: 6.22 / MAX: 36.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032314147AVX-512 512b DP248827004154AVX-512 Off268228324151OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5415.5459.1AVX-512 512b DP45.0410.4450.5AVX-512 Off44.9393.3433.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.456.559.1AVX-512 512b DP37.659.261.8AVX-512 Off36.354.056.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor20406080100

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 47.84, N = 3SE +/- 29.86, N = 3SE +/- 16.72, N = 310112.3410450.983010.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off1020304050SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.24, N = 311.7910.7542.42MIN: 6.96 / MAX: 33.85MIN: 6.13 / MAX: 31.81MIN: 15.51 / MAX: 60.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270030874153AVX-512 512b DP269928694150AVX-512 Off270032414405OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7411.4466.1AVX-512 512b DP45.3390.9437.9AVX-512 Off45.1327.8367.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.853.456.1AVX-512 512b DP39.554.957.1AVX-512 Off35.148.050.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: mobilenetV3AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.46240.92481.38721.84962.312SE +/- 0.033, N = 3SE +/- 0.008, N = 3SE +/- 0.012, N = 31.9801.8722.055MIN: 1.83 / MAX: 2.34MIN: 1.73 / MAX: 2.43MIN: 1.91 / MAX: 2.321. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: resnet-v2-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.037, N = 3SE +/- 0.113, N = 3SE +/- 0.040, N = 38.8517.67410.053MIN: 8.53 / MAX: 10.37MIN: 7.38 / MAX: 8.78MIN: 9.74 / MAX: 12.331. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

libxsmm

M N K: 128

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 128AVX-512 256b DPAVX-512 512b DPAVX-512 Off8001600240032004000SE +/- 5.61, N = 3SE +/- 9.17, N = 3SE +/- 12.94, N = 33652.93764.43431.7-msse4.2-msse4.2-pedantic -fopenmp -march=core-avx21. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lquadmath -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden

libxsmm

M N K: 128

OpenBenchmarking.orgGFLOPS/s Per Watt, More Is Betterlibxsmm 2-1.17-3645M N K: 128AVX-512 256b DPAVX-512 512b DPAVX-512 Off51015202521.0120.7416.38

libxsmm

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040204151AVX-512 512b DP270040104153AVX-512 Off270040394154OpenBenchmarking.orgMegahertz, More Is Betterlibxsmm 2-1.17-3645CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

libxsmm

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5173.9448.3AVX-512 512b DP44.7181.5454.9AVX-512 Off44.9209.5465.0OpenBenchmarking.orgWatts, Fewer Is Betterlibxsmm 2-1.17-3645CPU Power Consumption Monitor120240360480600

libxsmm

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP32.840.444.0AVX-512 512b DP36.645.748.6AVX-512 Off33.342.146.3OpenBenchmarking.orgCelsius, Fewer Is Betterlibxsmm 2-1.17-3645CPU Temperature Monitor1428425670

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.16447, N = 15SE +/- 0.01681, N = 3SE +/- 0.11217, N = 158.9286110.329907.894241. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off306090120150SE +/- 2.11, N = 15SE +/- 0.16, N = 3SE +/- 1.75, N = 15112.5496.81127.021. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270038224161AVX-512 512b DP270033874149AVX-512 Off270035194155OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP28.1381.0419.9AVX-512 512b DP45.1317.6346.2AVX-512 Off45.0343.5379.8OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor110220330440550

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP33.952.254.6AVX-512 512b DP37.649.851.4AVX-512 Off33.549.253.6OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1530456075

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off50100150200250SE +/- 1.79, N = 5SE +/- 0.29, N = 3SE +/- 0.15, N = 3162.96206.82161.961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off246810SE +/- 0.06960, N = 5SE +/- 0.00683, N = 3SE +/- 0.00589, N = 36.139264.834816.173951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040384137AVX-512 512b DP270040384143AVX-512 Off270040494151OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5164.2174.4AVX-512 512b DP45.5174.9196.5AVX-512 Off44.9174.4186.4OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor50100150200250

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.945.546.6AVX-512 512b DP36.150.852.4AVX-512 Off32.347.648.9OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1530456075

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off510152025SE +/- 0.21, N = 4SE +/- 0.17, N = 15SE +/- 0.38, N = 1217.9221.6017.061. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off1326395265SE +/- 0.65, N = 4SE +/- 0.38, N = 15SE +/- 1.68, N = 1255.8246.3459.031. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040524148AVX-512 512b DP270040434162AVX-512 Off270040444139OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6337.8367.1AVX-512 512b DP45.1350.2376.7AVX-512 Off24.1353.1382.5OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor100200300400500

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.651.654.8AVX-512 512b DP34.155.857.8AVX-512 Off30.853.655.9OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1632486480

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: GPT-2 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.18, N = 3SE +/- 0.74, N = 3SE +/- 0.16, N = 3191.18192.84181.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: GPT-2 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off1.23882.47763.71644.95526.194SE +/- 0.00487, N = 3SE +/- 0.02005, N = 3SE +/- 0.00462, N = 35.228625.183695.505781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040324138AVX-512 512b DP270040594160AVX-512 Off270040524148OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6142.5153.3AVX-512 512b DP44.9145.0154.8AVX-512 Off44.7144.3154.2OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor4080120160200

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.837.839.3AVX-512 512b DP37.441.042.1AVX-512 Off34.137.338.6OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1224364860

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off1020304050SE +/- 0.38, N = 15SE +/- 0.43, N = 15SE +/- 0.02, N = 344.6143.8238.841. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off612182430SE +/- 0.19, N = 15SE +/- 0.22, N = 15SE +/- 0.01, N = 322.4422.8525.751. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040484153AVX-512 512b DP270040414156AVX-512 Off270040234146OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7358.0389.2AVX-512 512b DP45.3362.0392.7AVX-512 Off44.8359.3392.6OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor110220330440550

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP29.149.751.8AVX-512 512b DP32.853.055.4AVX-512 Off28.347.850.6OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1530456075

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off246810SE +/- 0.12978, N = 15SE +/- 0.10140, N = 15SE +/- 0.06677, N = 45.676266.967915.504911. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 4.12, N = 15SE +/- 2.10, N = 15SE +/- 2.26, N = 4177.49143.94181.741. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270036944148AVX-512 512b DP270031684140AVX-512 Off270034024159OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6394.2436.1AVX-512 512b DP44.8336.5372.3AVX-512 Off44.9381.1419.9OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor110220330440550

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP33.653.856.1AVX-512 512b DP37.551.553.8AVX-512 Off33.652.454.8OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1632486480

Numpy Benchmark

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 256b DPAVX-512 512b DPAVX-512 Off2004006008001000SE +/- 2.12, N = 3SE +/- 2.30, N = 3SE +/- 1.08, N = 3794.98795.31739.69

Numpy Benchmark

OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkAVX-512 256b DPAVX-512 512b DPAVX-512 Off2468108.6618.6138.029

Numpy Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040794154AVX-512 512b DP270040824154AVX-512 Off270040894151OpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Numpy Benchmark

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.391.899.3AVX-512 512b DP44.792.3100.3AVX-512 Off44.792.1100.1OpenBenchmarking.orgWatts, Fewer Is BetterNumpy BenchmarkCPU Power Consumption Monitor20406080100

Numpy Benchmark

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.440.944.6AVX-512 512b DP36.543.149.3AVX-512 Off34.040.344.4OpenBenchmarking.orgCelsius, Fewer Is BetterNumpy BenchmarkCPU Temperature Monitor1428425670

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 13 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off90180270360450SE +/- 6.38, N = 15SE +/- 6.48, N = 15SE +/- 0.63, N = 6388.54400.90378.43-mavx2 -mavx512f -mavx512bw -mavx512dq-mavx2 -mavx512f -mavx512bw -mavx512dq1. (CXX) g++ options: -march=native -mno-avx

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 13 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.5061.0121.5182.0242.532.2022.2492.125

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270036394168AVX-512 512b DP270036344159AVX-512 Off270036794157OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 2.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.2176.5291.7AVX-512 512b DP44.7178.3298.3AVX-512 Off44.5178.1293.7OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.2CPU Power Consumption Monitor70140210280350

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP28.640.944.8AVX-512 512b DP31.944.649.0AVX-512 Off28.640.144.5OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 2.2CPU Temperature Monitor1428425670

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 8 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off306090120150SE +/- 0.47, N = 3SE +/- 0.52, N = 3SE +/- 0.40, N = 3108.12114.98101.84-mavx2 -mavx512f -mavx512bw -mavx512dq-mavx2 -mavx512f -mavx512bw -mavx512dq1. (CXX) g++ options: -march=native -mno-avx

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 8 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.11840.23680.35520.47360.5920.5100.5260.462

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270039434153AVX-512 512b DP270039284170AVX-512 Off270039474150OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 2.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7212.0282.3AVX-512 512b DP44.5218.7287.1AVX-512 Off44.7220.6284.4OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.2CPU Power Consumption Monitor70140210280350

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP29.644.347.9AVX-512 512b DP33.348.552.4AVX-512 Off29.345.549.8OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 2.2CPU Temperature Monitor1530456075

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 5 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off1122334455SE +/- 0.20, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 348.6050.7446.25-mavx2 -mavx512f -mavx512bw -mavx512dq-mavx2 -mavx512f -mavx512bw -mavx512dq1. (CXX) g++ options: -march=native -mno-avx

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 5 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.05040.10080.15120.20160.2520.2200.2240.202

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040454153AVX-512 512b DP270040354159AVX-512 Off270040314163OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 2.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4220.5286.2AVX-512 512b DP44.6226.3292.3AVX-512 Off44.7229.0302.3OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.2CPU Power Consumption Monitor80160240320400

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.846.751.6AVX-512 512b DP34.551.053.8AVX-512 Off30.347.750.9OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 2.2CPU Temperature Monitor1530456075

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 3 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off48121620SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 313.7614.2813.04-mavx2 -mavx512f -mavx512bw -mavx512dq-mavx2 -mavx512f -mavx512bw -mavx512dq1. (CXX) g++ options: -march=native -mno-avx

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 3 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.01280.02560.03840.05120.0640.0560.0570.052

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270041084167AVX-512 512b DP270041134162AVX-512 Off270041094171OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 2.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6245.4380.0AVX-512 512b DP44.9250.2395.9AVX-512 Off44.7250.9389.3OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.2CPU Power Consumption Monitor110220330440550

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.950.454.1AVX-512 512b DP33.553.657.9AVX-512 Off30.651.154.9OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 2.2CPU Temperature Monitor1632486480

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 256b DPAVX-512 512b DPAVX-512 Off8001600240032004000Min: 2172 / Avg: 3712.06 / Max: 4195Min: 1886 / Avg: 3621.72 / Max: 4224Min: 2294 / Avg: 3647.31 / Max: 4647

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 256b DPAVX-512 512b DPAVX-512 Off90180270360450Min: 22.32 / Avg: 305.93 / Max: 503.55Min: 22.21 / Avg: 292.98 / Max: 502.06Min: 22.25 / Avg: 297.71 / Max: 505.2

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 256b DPAVX-512 512b DPAVX-512 Off1326395265Min: 25.13 / Avg: 49.34 / Max: 63.75Min: 23.88 / Avg: 50.93 / Max: 66Min: 26.13 / Avg: 49.06 / Max: 63.5

Phoronix Test Suite v10.8.5