AMD EPYC Turin AVX-512 Comparison

AMD EPYC 9755 AVX-512 comparison by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2410104-NE-TURINAVX566&sro&gru.

AMD EPYC Turin AVX-512 ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelCompilerFile-SystemScreen ResolutionAVX-512 OffAVX-512 256b DPAVX-512 512b DPAMD EPYC 9755 128-Core @ 2.70GHz (128 Cores / 256 Threads)AMD VOLCANO (RVOT1000D BIOS)AMD Device 153a12 x 64GB DDR5-6000MT/s Samsung M321R8GA0PB1-CCPKC2 x 1920GB KIOXIA KCD8XPUG1T92ASPEEDBroadcom NetXtreme BCM5720 PCIeUbuntu 24.046.10.0-phx (x86_64)GCC 13.2.0ext41920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-OiuXZC/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xb002110 Python Details- Python 3.12.2Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD EPYC Turin AVX-512 Comparisonpytorch: CPU - 256 - ResNet-50pytorch: CPU - 512 - ResNet-50pytorch: CPU - 1 - ResNet-50minibude: OpenMP - BM1minibude: OpenMP - BM2openvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownsvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 5 - Bosphorus 4Ksvt-av1: Preset 3 - Bosphorus 4Ksimdjson: PartialTweetssimdjson: LargeRandsimdjson: Kostyasimdjson: DistinctUserIDsimdjson: TopTweetminibude: OpenMP - BM1minibude: OpenMP - BM2libxsmm: 128xmrig: GhostRider - 1Mtensorflow: CPU - 256 - ResNet-50tensorflow: CPU - 512 - ResNet-50onnx: fcn-resnet101-11 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: GPT-2 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet101_DUC_HDC-12 - CPU - Standardopenvkl: vklBenchmarkCPU ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timesmhasher: FarmHash32 x86_64 AVXgromacs: MPI CPU - water_GMX50_barenamd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomsnumpy: smhasher: FarmHash32 x86_64 AVXonnx: fcn-resnet101-11 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: GPT-2 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet101_DUC_HDC-12 - CPU - Standardospray-studio: 1 - 4K - 1 - Path Tracer - CPUospray-studio: 1 - 4K - 16 - Path Tracer - CPUospray-studio: 1 - 4K - 32 - Path Tracer - CPUospray-studio: 2 - 4K - 1 - Path Tracer - CPUospray-studio: 2 - 4K - 16 - Path Tracer - CPUospray-studio: 2 - 4K - 32 - Path Tracer - CPUospray-studio: 3 - 4K - 1 - Path Tracer - CPUospray-studio: 3 - 4K - 16 - Path Tracer - CPUospray-studio: 3 - 4K - 32 - Path Tracer - CPUonednn: Convolution Batch Shapes Auto - CPUonednn: Deconvolution Batch shapes_3d - CPUonednn: IP Shapes 3D - CPUonednn: Recurrent Neural Network Training - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUmnn: mobilenetV3mnn: resnet-v2-50openfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timey-cruncher: 1By-cruncher: 5By-cruncher: 10BAVX-512 OffAVX-512 256b DPAVX-512 512b DP38.3838.8245.05195.312191.605117.14165052.36382.4311702.446189.694150.45398.5719828.791861.722626.834727.353010.63205.9535178.4839167.0048378.434101.84446.24513.0387.301.404.697.647.494882.8084790.1323431.716826.7158.25179.257.89424161.96417.0582181.55638.83805.50491309931.719030.607242.131632099.0318.3507.000682.28097739.6926.512127.0196.1739559.03045.5057825.7457181.7367141139622869719114512295583613357308200.3739251.312143.14198447.798544.380.57167.0710.7510.2615.32160.346.2968.6824.3013.3542.422.05510.05320.421965161.951948.02031.24561.25643.5543.5051.63328.870316.656137.51175156.04710.9813579.908450.688024.13866.8324619.044203.212855.3410058.8410112.34221.3817190.1200178.1347388.542108.12448.59513.7628.601.575.668.998.848221.7397916.4093652.917480.4190.08221.258.92861162.96017.9209191.17644.61295.67626356045.408744.787649.349934422.4119.54413.310024.17026794.9826.885112.5426.1392655.82175.2286222.4363177.4876711073321539675108162164679112693253930.3500340.7003790.323221482.881463.880.5589.909.257.487.9073.735.0430.3522.366.2911.791.9808.85119.976723163.51457.75124.60247.27143.8543.3952.33395.370387.050194.04192118.56766.9918690.3211239.498755.751111.6931620.584780.243297.8513925.7610450.98223.1431191.6390179.6822400.898114.98050.73714.2789.461.595.909.929.879884.2549676.2543764.420005.2203.33246.1010.3299206.82321.5998192.83743.82226.96791366046.972146.326950.901534394.9822.83914.182934.62565795.3126.49196.80504.8348146.33695.1836922.8473143.9406391016920379642102312043875211963240300.2576320.5090190.322331425.220329.050.4883.326.605.617.2157.473.8726.6319.294.4910.751.8727.67420.24893160.997427.78924.06745.855OpenBenchmarking.org

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 256b DPAVX-512 512b DPAVX-512 Off1326395265Min: 25.13 / Avg: 49.34 / Max: 63.75Min: 23.88 / Avg: 50.93 / Max: 66Min: 26.13 / Avg: 49.06 / Max: 63.5

CPU Peak Freq (Highest CPU Core Frequency) Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringAVX-512 256b DPAVX-512 512b DPAVX-512 Off8001600240032004000Min: 2172 / Avg: 3712.06 / Max: 4195Min: 1886 / Avg: 3621.72 / Max: 4224Min: 2294 / Avg: 3647.31 / Max: 4647

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 256b DPAVX-512 512b DPAVX-512 Off90180270360450Min: 22.32 / Avg: 305.93 / Max: 503.55Min: 22.21 / Avg: 292.98 / Max: 502.06Min: 22.25 / Avg: 297.71 / Max: 505.2

PyTorch

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off1020304050SE +/- 0.31, N = 3SE +/- 0.55, N = 3SE +/- 0.43, N = 343.5543.8538.38MIN: 41.56 / MAX: 44.75MIN: 41.39 / MAX: 45.93MIN: 36.82 / MAX: 39.67

PyTorch

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off1020304050SE +/- 0.34, N = 3SE +/- 0.52, N = 4SE +/- 0.08, N = 343.5043.3938.82MIN: 41.09 / MAX: 44.92MIN: 40.31 / MAX: 44.91MIN: 37.4 / MAX: 39.86

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.04930.09860.14790.19720.24650.2190.2170.179

PyTorch

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.03580.07160.10740.14320.1790.1590.1580.135

PyTorch

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.03580.07160.10740.14320.1790.1590.1560.136

PyTorch

Device: CPU - Batch Size: 1 - Model: ResNet-50

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off1224364860SE +/- 0.12, N = 3SE +/- 0.38, N = 3SE +/- 0.23, N = 351.6352.3345.05MIN: 48.86 / MAX: 52.93MIN: 49.93 / MAX: 54.1MIN: 43.23 / MAX: 46.3

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.25610.51220.76831.02441.28050.9351.1380.498

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 256b DPAVX-512 512b DPAVX-512 Off90180270360450SE +/- 0.13, N = 10SE +/- 0.11, N = 11SE +/- 0.12, N = 8328.87395.37195.311. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 256b DPAVX-512 512b DPAVX-512 Off80160240320400SE +/- 0.70, N = 4SE +/- 4.22, N = 4SE +/- 0.64, N = 3316.66387.05191.611. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.511.522.51.7502.2220.795

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.02, N = 3SE +/- 0.46, N = 3SE +/- 0.07, N = 3137.51194.04117.141. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off40K80K120K160K200KSE +/- 517.64, N = 3SE +/- 544.06, N = 3SE +/- 339.72, N = 3175156.04192118.56165052.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off170340510680850SE +/- 0.61, N = 3SE +/- 0.42, N = 3SE +/- 0.04, N = 3710.98766.99382.431. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off4K8K12K16K20KSE +/- 5.42, N = 3SE +/- 12.83, N = 3SE +/- 1.96, N = 313579.9018690.3211702.441. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 0.88, N = 3SE +/- 0.53, N = 3SE +/- 1.18, N = 38450.6811239.496189.691. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 14.15, N = 3SE +/- 25.40, N = 3SE +/- 9.55, N = 38024.138755.754150.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2004006008001000SE +/- 1.32, N = 3SE +/- 5.73, N = 3SE +/- 0.88, N = 3866.831111.69398.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off7K14K21K28K35KSE +/- 4.94, N = 3SE +/- 23.78, N = 3SE +/- 6.94, N = 324619.0431620.5819828.791. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off10002000300040005000SE +/- 2.89, N = 3SE +/- 1.88, N = 3SE +/- 1.11, N = 34203.214780.241861.721. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off7001400210028003500SE +/- 3.53, N = 3SE +/- 5.22, N = 3SE +/- 0.80, N = 32855.343297.852626.831. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3K6K9K12K15KSE +/- 6.22, N = 3SE +/- 7.20, N = 3SE +/- 1.32, N = 310058.8413925.764727.351. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 47.84, N = 3SE +/- 29.86, N = 3SE +/- 16.72, N = 310112.3410450.983010.631. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 256b DPAVX-512 512b DPAVX-512 Off50100150200250SE +/- 0.05, N = 8SE +/- 0.09, N = 8SE +/- 0.08, N = 8221.38223.14205.95MIN: 217.86 / MAX: 225.89MIN: 218.68 / MAX: 229MIN: 202.63 / MAX: 210.88

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 13 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.5061.0121.5182.0242.532.2022.2492.125

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.11, N = 5SE +/- 0.08, N = 5SE +/- 0.17, N = 5190.12191.64178.48MIN: 186.67 / MAX: 194.33MIN: 188.18 / MAX: 196.08MIN: 174.73 / MAX: 183.09

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.12, N = 8SE +/- 0.09, N = 8SE +/- 0.18, N = 8178.13179.68167.00MIN: 173.22 / MAX: 184.71MIN: 174.97 / MAX: 186.29MIN: 162.73 / MAX: 173.25

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 13 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off90180270360450SE +/- 6.38, N = 15SE +/- 6.48, N = 15SE +/- 0.63, N = 6388.54400.90378.43-mavx2 -mavx512f -mavx512bw -mavx512dq-mavx2 -mavx512f -mavx512bw -mavx512dq1. (CXX) g++ options: -march=native -mno-avx

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.15820.31640.47460.63280.7910.6960.7030.638

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 8 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.11840.23680.35520.47360.5920.5100.5260.462

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 5 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.05040.10080.15120.20160.2520.2200.2240.202

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 3 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.01280.02560.03840.05120.0640.0560.0570.052

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 8 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off306090120150SE +/- 0.47, N = 3SE +/- 0.52, N = 3SE +/- 0.40, N = 3108.12114.98101.84-mavx2 -mavx512f -mavx512bw -mavx512dq-mavx2 -mavx512f -mavx512bw -mavx512dq1. (CXX) g++ options: -march=native -mno-avx

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 5 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off1122334455SE +/- 0.20, N = 3SE +/- 0.02, N = 3SE +/- 0.13, N = 348.6050.7446.25-mavx2 -mavx512f -mavx512bw -mavx512dq-mavx2 -mavx512f -mavx512bw -mavx512dq1. (CXX) g++ options: -march=native -mno-avx

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.2Encoder Mode: Preset 3 - Input: Bosphorus 4KAVX-512 256b DPAVX-512 512b DPAVX-512 Off48121620SE +/- 0.05, N = 3SE +/- 0.05, N = 3SE +/- 0.08, N = 313.7614.2813.04-mavx2 -mavx512f -mavx512bw -mavx512dq-mavx2 -mavx512f -mavx512bw -mavx512dq1. (CXX) g++ options: -march=native -mno-avx

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.22250.4450.66750.891.11250.9890.9790.885

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.24590.49180.73770.98361.22951.0881.0930.962

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: PartialTweetsAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.09, N = 6SE +/- 0.09, N = 15SE +/- 0.04, N = 38.609.467.301. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: LargeRandomAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.35780.71561.07341.43121.789SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 31.571.591.401. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: KostyaAVX-512 256b DPAVX-512 512b DPAVX-512 Off1.32752.6553.98255.316.6375SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 35.665.904.691. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.04, N = 3SE +/- 0.12, N = 4SE +/- 0.02, N = 38.999.927.641. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: TopTweetAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 38.849.877.491. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: PartialTweetsAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02340.04680.07020.09360.1170.0950.1040.079

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: LargeRandomAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.00380.00760.01140.01520.0190.0170.0170.015

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: KostyaAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.01350.0270.04050.0540.06750.0580.0600.048

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02450.0490.07350.0980.12250.0990.1090.084

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 3.10Throughput Test: TopTweetAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02430.04860.07290.09720.12150.0970.1080.082

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 3.23, N = 10SE +/- 2.65, N = 11SE +/- 3.11, N = 88221.749884.254882.811. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 17.43, N = 4SE +/- 105.52, N = 4SE +/- 15.88, N = 37916.419676.254790.131. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

libxsmm

M N K: 128

OpenBenchmarking.orgGFLOPS/s Per Watt, More Is Betterlibxsmm 2-1.17-3645M N K: 128AVX-512 256b DPAVX-512 512b DPAVX-512 Off51015202521.0120.7416.38

libxsmm

M N K: 128

OpenBenchmarking.orgGFLOPS/s, More Is Betterlibxsmm 2-1.17-3645M N K: 128AVX-512 256b DPAVX-512 512b DPAVX-512 Off8001600240032004000SE +/- 5.61, N = 3SE +/- 9.17, N = 3SE +/- 12.94, N = 33652.93764.43431.7-msse4.2-msse4.2-pedantic -fopenmp -march=core-avx21. (CXX) g++ options: -dynamic -Bstatic -static-libgcc -lgomp -lm -lrt -ldl -lquadmath -lstdc++ -pthread -fPIC -std=c++14 -O2 -fopenmp-simd -funroll-loops -ftree-vectorize -fdata-sections -ffunction-sections -fvisibility=hidden

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s Per Watt, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MAVX-512 256b DPAVX-512 512b DPAVX-512 Off112233445542.2947.0740.85

Xmrig

Variant: GhostRider - Hash Count: 1M

OpenBenchmarking.orgH/s, More Is BetterXmrig 6.21Variant: GhostRider - Hash Count: 1MAVX-512 256b DPAVX-512 512b DPAVX-512 Off4K8K12K16K20KSE +/- 973.55, N = 15SE +/- 779.44, N = 15SE +/- 973.00, N = 1517480.420005.216826.71. (CXX) g++ options: -fexceptions -fno-rtti -maes -O3 -Ofast -static-libgcc -static-libstdc++ -rdynamic -lssl -lcrypto -luv -lpthread -lrt -ldl -lhwloc

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.40, N = 3SE +/- 0.98, N = 3SE +/- 0.47, N = 3190.08203.33158.25

TensorFlow

Device: CPU - Batch Size: 256 - Model: ResNet-50

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 256 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.14830.29660.44490.59320.74150.5210.6590.477

TensorFlow

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off50100150200250SE +/- 0.23, N = 3SE +/- 0.45, N = 3SE +/- 0.20, N = 3221.25246.10179.25

TensorFlow

Device: CPU - Batch Size: 512 - Model: ResNet-50

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 512 - Model: ResNet-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.1640.3280.4920.6560.820.5700.7290.491

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.16447, N = 15SE +/- 0.01681, N = 3SE +/- 0.11217, N = 158.9286110.329907.894241. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off50100150200250SE +/- 1.79, N = 5SE +/- 0.29, N = 3SE +/- 0.15, N = 3162.96206.82161.961. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off510152025SE +/- 0.21, N = 4SE +/- 0.17, N = 15SE +/- 0.38, N = 1217.9221.6017.061. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: GPT-2 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.18, N = 3SE +/- 0.74, N = 3SE +/- 0.16, N = 3191.18192.84181.561. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off1020304050SE +/- 0.38, N = 15SE +/- 0.43, N = 15SE +/- 0.02, N = 344.6143.8238.841. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off246810SE +/- 0.12978, N = 15SE +/- 0.10140, N = 15SE +/- 0.06677, N = 45.676266.967915.504911. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 256b DPAVX-512 512b DPAVX-512 Off36912159.0559.1807.791

OpenVKL

Benchmark: vklBenchmarkCPU ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 2.0.0Benchmark: vklBenchmarkCPU ISPCAVX-512 256b DPAVX-512 512b DPAVX-512 Off8001600240032004000SE +/- 1.76, N = 3SE +/- 0.58, N = 3SE +/- 0.33, N = 3356036603099MIN: 284 / MAX: 41727MIN: 293 / MAX: 42710MIN: 245 / MAX: 36357

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02430.04860.07290.09720.12150.1080.1080.077

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02410.04820.07230.09640.12050.1060.1070.074

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.02790.05580.08370.11160.13950.1210.1240.101

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off1122334455SE +/- 0.03, N = 3SE +/- 0.16, N = 3SE +/- 0.01, N = 345.4146.9731.72

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off1122334455SE +/- 0.13, N = 3SE +/- 0.11, N = 3SE +/- 0.02, N = 344.7946.3330.61

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 256b DPAVX-512 512b DPAVX-512 Off1122334455SE +/- 0.05, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 349.3550.9042.13

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270030394174AVX-512 512b DP270029104157AVX-512 Off270030334152OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033044147AVX-512 512b DP270030044146AVX-512 Off270031844148OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

NAMD

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033384158AVX-512 512b DP270032534149AVX-512 Off270036894147OpenBenchmarking.orgMegahertz, More Is BetterNAMD 3.0b6CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

NAMD

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270034804149AVX-512 512b DP255433624151AVX-512 Off270034474182OpenBenchmarking.orgMegahertz, More Is BetterNAMD 3.0b6CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

GROMACS

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270035044148AVX-512 512b DP270034894155AVX-512 Off270033734150OpenBenchmarking.orgMegahertz, More Is BetterGROMACS 2024CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033904150AVX-512 512b DP270033874174AVX-512 Off270034134156OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270035764152AVX-512 512b DP270035494168AVX-512 Off270035764155OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040584146AVX-512 512b DP270040574156AVX-512 Off270040594140OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040714152AVX-512 512b DP270040684141AVX-512 Off270040294145OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040654146AVX-512 512b DP270040774160AVX-512 Off270040744158OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040484138AVX-512 512b DP270040504153AVX-512 Off270040624152OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040594158AVX-512 512b DP270040694158AVX-512 Off270040514141OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 3.10CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031784156AVX-512 512b DP270031664157AVX-512 Off270030624146OpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270035754146AVX-512 512b DP270035794139AVX-512 Off270035404150OpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031084151AVX-512 512b DP270031144169AVX-512 Off270031004146OpenBenchmarking.orgMegahertz, More Is BetterEmbree 4.3CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 2.0.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 256b DPAVX-512 512b DPAVX-512 Off7001400210028003500Min: 2700 / Avg: 3662.48 / Max: 4157Min: 2700 / Avg: 3603.43 / Max: 4154Min: 2700 / Avg: 3535.06 / Max: 4152

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270034444141AVX-512 512b DP270033644151AVX-512 Off270033744147OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270034574142AVX-512 512b DP270033724148AVX-512 Off270033764149OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032884150AVX-512 512b DP270032244149AVX-512 Off270032144148OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 3.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033294145AVX-512 512b DP270032244153AVX-512 Off270032244143OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033344151AVX-512 512b DP270032214152AVX-512 Off270032284144OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032724134AVX-512 512b DP270031734139AVX-512 Off270031664142OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033314145AVX-512 512b DP270032544154AVX-512 Off270032484155OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033424155AVX-512 512b DP270032414152AVX-512 Off270032484143OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033024150AVX-512 512b DP270031944144AVX-512 Off270031924150OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033124144AVX-512 512b DP270032234141AVX-512 Off270032264140OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270033194144AVX-512 512b DP270032104162AVX-512 Off270031714148OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032844151AVX-512 512b DP270031704151AVX-512 Off270033074153OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 1.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP269536924151AVX-512 512b DP270036254154AVX-512 Off246436004155OpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP263836164146AVX-512 512b DP206335044142AVX-512 Off243736014157OpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Y-Cruncher

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP261336384155AVX-512 512b DP207735304160AVX-512 Off246535964148OpenBenchmarking.orgMegahertz, More Is BetterY-Cruncher 0.8.5CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Xmrig

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040134153AVX-512 512b DP270039554136AVX-512 Off270040114140OpenBenchmarking.orgMegahertz, More Is BetterXmrig 6.21CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032894145AVX-512 512b DP270028844153AVX-512 Off270031464042OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP217230494150AVX-512 512b DP255927304150AVX-512 Off270031604144OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270035364145AVX-512 512b DP270035284155AVX-512 Off270037304152OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270037904156AVX-512 512b DP188632984162AVX-512 Off248731934143OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 3.4CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

PyTorch

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270039274157AVX-512 512b DP270039524153AVX-512 Off270039464143OpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

PyTorch

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040374153AVX-512 512b DP270040374151AVX-512 Off270040304144OpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

PyTorch

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040394151AVX-512 512b DP270040234143AVX-512 Off270040364145OpenBenchmarking.orgMegahertz, More Is BetterPyTorch 2.2.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270038354148AVX-512 512b DP262332474165AVX-512 Off254032154156OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.16.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270038024147AVX-512 512b DP199332434144AVX-512 Off229433284155OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.16.1CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031824150AVX-512 512b DP228024754150AVX-512 Off256327674146OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270034424163AVX-512 512b DP270031704142AVX-512 Off270031924152OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032264168AVX-512 512b DP264227684162AVX-512 Off270030314147OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031014145AVX-512 512b DP220024144152AVX-512 Off263028134149OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031474154AVX-512 512b DP238025734150AVX-512 Off268828234156OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031464153AVX-512 512b DP239425224152AVX-512 Off270028754145OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032724195AVX-512 512b DP241627334152AVX-512 Off254127234153OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270030974152AVX-512 512b DP233626014149AVX-512 Off269728914145OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270029654148AVX-512 512b DP261327674147AVX-512 Off252026144162OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270031874144AVX-512 512b DP258527234144AVX-512 Off270030214157OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270032314147AVX-512 512b DP248827004154AVX-512 Off268228324151OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270030874153AVX-512 512b DP269928694150AVX-512 Off270032414405OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2024.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

libxsmm

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040204151AVX-512 512b DP270040104153AVX-512 Off270040394154OpenBenchmarking.orgMegahertz, More Is Betterlibxsmm 2-1.17-3645CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270038224161AVX-512 512b DP270033874149AVX-512 Off270035194155OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040384137AVX-512 512b DP270040384143AVX-512 Off270040494151OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040524148AVX-512 512b DP270040434162AVX-512 Off270040444139OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040324138AVX-512 512b DP270040594160AVX-512 Off270040524148OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040484153AVX-512 512b DP270040414156AVX-512 Off270040234146OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270036944148AVX-512 512b DP270031684140AVX-512 Off270034024159OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.19CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

Numpy Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040794154AVX-512 512b DP270040824154AVX-512 Off270040894151OpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270036394168AVX-512 512b DP270036344159AVX-512 Off270036794157OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 2.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270039434153AVX-512 512b DP270039284170AVX-512 Off270039474150OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 2.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270040454153AVX-512 512b DP270040354159AVX-512 Off270040314163OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 2.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

MinAvgMaxAVX-512 256b DP270041084167AVX-512 512b DP270041134162AVX-512 Off270041094171OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 2.2CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

SMHasher

Hash: FarmHash32 x86_64 AVX

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 256b DPAVX-512 512b DPAVX-512 Off7K14K21K28K35KSE +/- 20.30, N = 6SE +/- 23.52, N = 6SE +/- 19.92, N = 634422.4134394.9832099.031. (CXX) g++ options: -march=native -O3 -flto=auto -fno-fat-lto-objects

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day Per Watt, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.01510.03020.04530.06040.07550.0570.0670.052

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 256b DPAVX-512 512b DPAVX-512 Off510152025SE +/- 0.00, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 319.5422.8418.351. (CXX) g++ options: -O3 -lm

NAMD

Input: ATPase with 327,506 Atoms

OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.01690.03380.05070.06760.08450.0670.0750.040

NAMD

Input: STMV with 1,066,628 Atoms

OpenBenchmarking.orgns/day Per Watt, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.00430.00860.01290.01720.02150.0160.0190.009

NAMD

Input: ATPase with 327,506 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: ATPase with 327,506 AtomsAVX-512 256b DPAVX-512 512b DPAVX-512 Off48121620SE +/- 0.02496, N = 7SE +/- 0.06451, N = 7SE +/- 0.01866, N = 313.3100214.182937.00068

NAMD

Input: STMV with 1,066,628 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0b6Input: STMV with 1,066,628 AtomsAVX-512 256b DPAVX-512 512b DPAVX-512 Off1.04082.08163.12244.16325.204SE +/- 0.00881, N = 4SE +/- 0.00436, N = 4SE +/- 0.00213, N = 34.170264.625652.28097

Numpy Benchmark

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 256b DPAVX-512 512b DPAVX-512 Off2004006008001000SE +/- 2.12, N = 3SE +/- 2.30, N = 3SE +/- 1.08, N = 3794.98795.31739.69

Numpy Benchmark

OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkAVX-512 256b DPAVX-512 512b DPAVX-512 Off2468108.6618.6138.029

miniBUDE

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.842.647.4AVX-512 512b DP27.541.245.8AVX-512 Off28.446.051.5OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature Monitor1530456075

miniBUDE

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.852.758.4AVX-512 512b DP29.651.857.6AVX-512 Off32.155.060.1OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature Monitor1632486480

NAMD

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.943.747.6AVX-512 512b DP34.141.945.4AVX-512 Off35.944.551.1OpenBenchmarking.orgCelsius, Fewer Is BetterNAMD 3.0b6CPU Temperature Monitor1530456075

NAMD

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP32.447.353.4AVX-512 512b DP31.444.850.5AVX-512 Off33.547.856.1OpenBenchmarking.orgCelsius, Fewer Is BetterNAMD 3.0b6CPU Temperature Monitor1632486480

GROMACS

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.352.758.3AVX-512 512b DP33.151.757.6AVX-512 Off33.453.659.9OpenBenchmarking.orgCelsius, Fewer Is BetterGROMACS 2024CPU Temperature Monitor1632486480

OpenFOAM

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.153.659.8AVX-512 512b DP35.352.759.0AVX-512 Off36.453.960.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

OpenFOAM

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.859.561.6AVX-512 512b DP35.359.362.0AVX-512 Off36.359.962.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP33.937.941.6AVX-512 512b DP32.437.944.0AVX-512 Off36.541.843.8OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1224364860

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.836.938.4AVX-512 512b DP27.537.139.3AVX-512 Off30.139.641.4OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1122334455

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.839.441.8AVX-512 512b DP27.338.541.4AVX-512 Off29.439.940.9OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1224364860

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP28.036.537.4AVX-512 512b DP27.837.639.5AVX-512 Off29.639.141.5OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1122334455

simdjson

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.437.939.4AVX-512 512b DP27.137.839.8AVX-512 Off29.339.541.3OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 3.10CPU Temperature Monitor1122334455

Embree

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP27.640.845.4AVX-512 512b DP27.340.245.0AVX-512 Off29.442.647.1OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature Monitor1428425670

Embree

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.442.145.6AVX-512 512b DP30.841.744.9AVX-512 Off32.843.947.5OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature Monitor1428425670

Embree

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.144.749.3AVX-512 512b DP30.844.148.8AVX-512 Off33.046.651.6OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 4.3CPU Temperature Monitor1530456075

OpenVKL

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 2.0.0CPU Temperature MonitorAVX-512 256b DPAVX-512 512b DPAVX-512 Off1224364860Min: 32.88 / Avg: 54.99 / Max: 60.5Min: 32.63 / Avg: 56.14 / Max: 61.88Min: 34.75 / Avg: 56.31 / Max: 61.63

OSPRay

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.457.260.4AVX-512 512b DP37.959.662.6AVX-512 Off36.556.860.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature Monitor20406080100

OSPRay

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.657.660.9AVX-512 512b DP39.159.862.9AVX-512 Off37.857.561.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature Monitor20406080100

OSPRay

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.655.959.8AVX-512 512b DP39.558.261.0AVX-512 Off37.857.560.3OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 3.2CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.954.058.5AVX-512 512b DP36.555.760.0AVX-512 Off34.653.958.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor1632486480

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.353.757.8AVX-512 512b DP39.155.159.8AVX-512 Off37.653.757.8OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor1632486480

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.654.558.5AVX-512 512b DP38.456.760.9AVX-512 Off37.054.758.9OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.053.858.0AVX-512 512b DP39.656.360.6AVX-512 Off37.054.458.5OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.353.958.5AVX-512 512b DP39.156.060.6AVX-512 Off36.953.558.4OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.655.158.5AVX-512 512b DP39.357.360.9AVX-512 Off37.155.258.6OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.154.158.1AVX-512 512b DP39.356.760.9AVX-512 Off37.054.158.3OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.854.558.6AVX-512 512b DP39.356.260.9AVX-512 Off36.855.358.9OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

OSPRay Studio

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.655.459.1AVX-512 512b DP39.157.661.1AVX-512 Off37.551.557.0OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 1.0CPU Temperature Monitor20406080100

Y-Cruncher

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.442.346.8AVX-512 512b DP33.544.248.5AVX-512 Off32.044.349.6OpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature Monitor1428425670

Y-Cruncher

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.848.254.6AVX-512 512b DP34.149.655.9AVX-512 Off32.851.860.0OpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature Monitor1632486480

Y-Cruncher

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.350.856.5AVX-512 512b DP35.951.957.6AVX-512 Off34.854.661.6OpenBenchmarking.orgCelsius, Fewer Is BetterY-Cruncher 0.8.5CPU Temperature Monitor20406080100

Xmrig

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP25.655.660.1AVX-512 512b DP28.959.263.0AVX-512 Off26.155.760.3OpenBenchmarking.orgCelsius, Fewer Is BetterXmrig 6.21CPU Temperature Monitor20406080100

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP37.845.248.8AVX-512 512b DP40.145.849.0AVX-512 Off37.145.649.4OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature Monitor1428425670

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP32.539.842.4AVX-512 512b DP33.940.342.5AVX-512 Off31.944.948.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature Monitor1428425670

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.638.040.5AVX-512 512b DP33.340.443.0AVX-512 Off31.438.040.6OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature Monitor1224364860

oneDNN

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.848.751.6AVX-512 512b DP33.348.250.9AVX-512 Off30.147.152.4OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 3.4CPU Temperature Monitor1530456075

PyTorch

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.040.943.0AVX-512 512b DP36.944.246.6AVX-512 Off33.841.844.4OpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature Monitor1428425670

PyTorch

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP31.341.644.1AVX-512 512b DP34.845.447.6AVX-512 Off31.642.844.9OpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature Monitor1428425670

PyTorch

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP32.142.043.9AVX-512 512b DP35.845.748.1AVX-512 Off32.443.245.4OpenBenchmarking.orgCelsius, Fewer Is BetterPyTorch 2.2.1CPU Temperature Monitor1428425670

TensorFlow

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.349.551.1AVX-512 512b DP33.547.850.3AVX-512 Off30.647.148.5OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.16.1CPU Temperature Monitor1530456075

TensorFlow

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP33.851.752.9AVX-512 512b DP35.650.654.8AVX-512 Off32.850.252.9OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.16.1CPU Temperature Monitor1530456075

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.554.357.6AVX-512 512b DP37.054.757.5AVX-512 Off33.853.556.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.351.153.0AVX-512 512b DP37.551.653.5AVX-512 Off35.151.453.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1530456075

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.156.158.9AVX-512 512b DP36.655.757.9AVX-512 Off34.355.958.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.654.456.6AVX-512 512b DP37.654.256.0AVX-512 Off35.553.956.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.455.558.0AVX-512 512b DP37.456.658.9AVX-512 Off34.855.357.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.555.357.9AVX-512 512b DP38.653.054.8AVX-512 Off35.853.455.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.657.160.0AVX-512 512b DP36.659.362.1AVX-512 Off34.855.057.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.455.057.3AVX-512 512b DP39.556.057.9AVX-512 Off35.855.157.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.155.858.3AVX-512 512b DP38.059.161.5AVX-512 Off35.154.356.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP36.155.257.5AVX-512 512b DP39.454.556.3AVX-512 Off35.556.659.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.456.559.1AVX-512 512b DP37.659.261.8AVX-512 Off36.354.056.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor20406080100

OpenVINO

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.853.456.1AVX-512 512b DP39.554.957.1AVX-512 Off35.148.050.1OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2024.0CPU Temperature Monitor1632486480

libxsmm

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP32.840.444.0AVX-512 512b DP36.645.748.6AVX-512 Off33.342.146.3OpenBenchmarking.orgCelsius, Fewer Is Betterlibxsmm 2-1.17-3645CPU Temperature Monitor1428425670

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP33.952.254.6AVX-512 512b DP37.649.851.4AVX-512 Off33.549.253.6OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1530456075

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.945.546.6AVX-512 512b DP36.150.852.4AVX-512 Off32.347.648.9OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1530456075

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.651.654.8AVX-512 512b DP34.155.857.8AVX-512 Off30.853.655.9OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1632486480

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP34.837.839.3AVX-512 512b DP37.441.042.1AVX-512 Off34.137.338.6OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1224364860

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP29.149.751.8AVX-512 512b DP32.853.055.4AVX-512 Off28.347.850.6OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1530456075

ONNX Runtime

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP33.653.856.1AVX-512 512b DP37.551.553.8AVX-512 Off33.652.454.8OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.19CPU Temperature Monitor1632486480

Numpy Benchmark

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP35.440.944.6AVX-512 512b DP36.543.149.3AVX-512 Off34.040.344.4OpenBenchmarking.orgCelsius, Fewer Is BetterNumpy BenchmarkCPU Temperature Monitor1428425670

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP28.640.944.8AVX-512 512b DP31.944.649.0AVX-512 Off28.640.144.5OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 2.2CPU Temperature Monitor1428425670

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP29.644.347.9AVX-512 512b DP33.348.552.4AVX-512 Off29.345.549.8OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 2.2CPU Temperature Monitor1530456075

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.846.751.6AVX-512 512b DP34.551.053.8AVX-512 Off30.347.750.9OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 2.2CPU Temperature Monitor1530456075

SVT-AV1

CPU Temperature Monitor

MinAvgMaxAVX-512 256b DP30.950.454.1AVX-512 512b DP33.553.657.9AVX-512 Off30.651.154.9OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 2.2CPU Temperature Monitor1632486480

SMHasher

Hash: FarmHash32 x86_64 AVX

OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 256b DPAVX-512 512b DPAVX-512 Off612182430SE +/- 0.38, N = 6SE +/- 0.01, N = 6SE +/- 0.26, N = 626.8926.4926.511. (CXX) g++ options: -march=native -O3 -flto=auto -fno-fat-lto-objects

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off306090120150SE +/- 2.11, N = 15SE +/- 0.16, N = 3SE +/- 1.75, N = 15112.5496.81127.021. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off246810SE +/- 0.06960, N = 5SE +/- 0.00683, N = 3SE +/- 0.00589, N = 36.139264.834816.173951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off1326395265SE +/- 0.65, N = 4SE +/- 0.38, N = 15SE +/- 1.68, N = 1255.8246.3459.031. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: GPT-2 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off1.23882.47763.71644.95526.194SE +/- 0.00487, N = 3SE +/- 0.02005, N = 3SE +/- 0.00462, N = 35.228625.183695.505781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off612182430SE +/- 0.19, N = 15SE +/- 0.22, N = 15SE +/- 0.01, N = 322.4422.8525.751. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: StandardAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 4.12, N = 15SE +/- 2.10, N = 15SE +/- 2.26, N = 4177.49143.94181.741. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off150300450600750SE +/- 0.33, N = 3SE +/- 0.58, N = 3SE +/- 0.00, N = 3671639714

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 5.86, N = 3SE +/- 9.28, N = 3SE +/- 7.69, N = 3107331016911396

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off5K10K15K20K25KSE +/- 6.39, N = 3SE +/- 25.38, N = 3SE +/- 34.33, N = 3215392037922869

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off160320480640800SE +/- 0.33, N = 3SE +/- 0.00, N = 3SE +/- 0.33, N = 3675642719

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2K4K6K8K10KSE +/- 11.85, N = 3SE +/- 10.11, N = 3SE +/- 2.85, N = 3108161023111451

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off5K10K15K20K25KSE +/- 8.65, N = 3SE +/- 8.88, N = 3SE +/- 25.87, N = 3216462043822955

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off2004006008001000SE +/- 0.58, N = 3SE +/- 0.33, N = 3SE +/- 0.33, N = 3791752836

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3K6K9K12K15KSE +/- 7.80, N = 3SE +/- 7.06, N = 3SE +/- 13.35, N = 3126931196313357

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPU

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 1.0Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer - Acceleration: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off7K14K21K28K35KSE +/- 2.00, N = 3SE +/- 20.00, N = 3SE +/- 109.14, N = 3253932403030820

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Convolution Batch Shapes Auto - Engine: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.08410.16820.25230.33640.4205SE +/- 0.000363, N = 7SE +/- 0.000532, N = 7SE +/- 0.000549, N = 70.3500340.2576320.373925MIN: 0.33MIN: 0.25MIN: 0.351. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.29520.59040.88561.18081.476SE +/- 0.000342, N = 9SE +/- 0.000468, N = 9SE +/- 0.001041, N = 90.7003790.5090191.312140MIN: 0.68MIN: 0.48MIN: 1.281. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: IP Shapes 3D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.70691.41382.12072.82763.5345SE +/- 0.000924, N = 5SE +/- 0.000544, N = 5SE +/- 0.003218, N = 50.3232210.3223313.141980MIN: 3.071. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off100200300400500SE +/- 0.27, N = 3SE +/- 0.60, N = 3SE +/- 0.35, N = 3482.88425.22447.80MIN: 478.35MIN: 418.82MIN: 443.231. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off120240360480600SE +/- 0.07, N = 3SE +/- 0.76, N = 3SE +/- 0.31, N = 3463.88329.05544.38MIN: 405.2 / MAX: 482.04MIN: 146.73 / MAX: 360.28MIN: 261.15 / MAX: 569.931. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off0.12830.25660.38490.51320.6415SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 30.550.480.57MIN: 0.18 / MAX: 22.43MIN: 0.13 / MAX: 25.07MIN: 0.2 / MAX: 26.731. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.08, N = 3SE +/- 0.04, N = 3SE +/- 0.02, N = 389.9083.32167.07MIN: 40.69 / MAX: 160.4MIN: 35.6 / MAX: 146.57MIN: 75.83 / MAX: 256.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 39.256.6010.75MIN: 4.08 / MAX: 21.6MIN: 2.24 / MAX: 26.72MIN: 4.66 / MAX: 32.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 37.485.6110.26MIN: 4.14 / MAX: 23.69MIN: 2.24 / MAX: 30.88MIN: 6.21 / MAX: 38.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off48121620SE +/- 0.01, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 37.907.2115.32MIN: 5.02 / MAX: 29.4MIN: 4.13 / MAX: 25.4MIN: 7.91 / MAX: 45.711. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200SE +/- 0.11, N = 3SE +/- 0.30, N = 3SE +/- 0.34, N = 373.7357.47160.34MIN: 35.26 / MAX: 113MIN: 26.92 / MAX: 106.12MIN: 88.77 / MAX: 245.281. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Face Detection Retail FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off246810SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.01, N = 35.043.876.29MIN: 2.51 / MAX: 19.14MIN: 1.69 / MAX: 21.99MIN: 3.06 / MAX: 24.121. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Handwritten English Recognition FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off1530456075SE +/- 0.02, N = 3SE +/- 0.01, N = 3SE +/- 0.04, N = 330.3526.6368.68MIN: 17.71 / MAX: 42.78MIN: 15.61 / MAX: 47.58MIN: 40.62 / MAX: 87.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Road Segmentation ADAS FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off612182430SE +/- 0.03, N = 3SE +/- 0.03, N = 3SE +/- 0.01, N = 322.3619.2924.30MIN: 11.44 / MAX: 40.97MIN: 9.84 / MAX: 44.85MIN: 13.82 / MAX: 53.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Person Re-Identification Retail FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 3SE +/- 0.00, N = 36.294.4913.35MIN: 3.16 / MAX: 20.63MIN: 1.96 / MAX: 22.35MIN: 6.22 / MAX: 36.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenVINO

Model: Noise Suppression Poconet-Like FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUAVX-512 256b DPAVX-512 512b DPAVX-512 Off1020304050SE +/- 0.06, N = 3SE +/- 0.07, N = 3SE +/- 0.24, N = 311.7910.7542.42MIN: 6.96 / MAX: 33.85MIN: 6.13 / MAX: 31.81MIN: 15.51 / MAX: 60.871. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Mobile Neural Network

Model: mobilenetV3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: mobilenetV3AVX-512 256b DPAVX-512 512b DPAVX-512 Off0.46240.92481.38721.84962.312SE +/- 0.033, N = 3SE +/- 0.008, N = 3SE +/- 0.012, N = 31.9801.8722.055MIN: 1.83 / MAX: 2.34MIN: 1.73 / MAX: 2.43MIN: 1.91 / MAX: 2.321. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: resnet-v2-50AVX-512 256b DPAVX-512 512b DPAVX-512 Off3691215SE +/- 0.037, N = 3SE +/- 0.113, N = 3SE +/- 0.040, N = 38.8517.67410.053MIN: 8.53 / MAX: 10.37MIN: 7.38 / MAX: 8.78MIN: 9.74 / MAX: 12.331. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

OpenFOAM

Input: drivaerFastback, Small Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeAVX-512 256b DPAVX-512 512b DPAVX-512 Off51015202519.9820.2520.421. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeAVX-512 256b DPAVX-512 512b DPAVX-512 Off4080120160200163.51161.00161.951. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 1BAVX-512 256b DPAVX-512 512b DPAVX-512 Off246810SE +/- 0.005, N = 5SE +/- 0.012, N = 5SE +/- 0.014, N = 57.7517.7898.020

Y-Cruncher

Pi Digits To Calculate: 5B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 5BAVX-512 256b DPAVX-512 512b DPAVX-512 Off714212835SE +/- 0.03, N = 3SE +/- 0.15, N = 3SE +/- 0.04, N = 324.6024.0731.25

Y-Cruncher

Pi Digits To Calculate: 10B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 10BAVX-512 256b DPAVX-512 512b DPAVX-512 Off1428425670SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.04, N = 347.2745.8661.26

miniBUDE

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.3188.0444.4AVX-512 512b DP44.2177.9461.5AVX-512 Off44.9245.6458.2OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption Monitor120240360480600

miniBUDE

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6338.8454.7AVX-512 512b DP44.3340.0464.3AVX-512 Off24.3384.9460.6OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption Monitor120240360480600

NAMD

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7198.0427.6AVX-512 512b DP44.8188.3410.9AVX-512 Off44.9173.2453.4OpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption Monitor120240360480600

NAMD

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.8264.6450.8AVX-512 512b DP44.7248.5427.4AVX-512 Off44.6249.2463.8OpenBenchmarking.orgWatts, Fewer Is BetterNAMD 3.0b6CPU Power Consumption Monitor120240360480600

GROMACS

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5343.3467.5AVX-512 512b DP22.2339.4488.1AVX-512 Off44.6350.2475.6OpenBenchmarking.orgWatts, Fewer Is BetterGROMACS 2024CPU Power Consumption Monitor130260390520650

OpenFOAM

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0373.7491.3AVX-512 512b DP44.5371.0490.5AVX-512 Off45.0381.9490.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption Monitor130260390520650

OpenFOAM

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0447.3491.2AVX-512 512b DP44.5446.4488.5AVX-512 Off45.1446.9489.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption Monitor130260390520650

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.390.794.8AVX-512 512b DP44.391.296.1AVX-512 Off44.791.895.2OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.693.297.0AVX-512 512b DP44.193.497.4AVX-512 Off44.792.396.6OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.498.0101.5AVX-512 512b DP44.398.3102.4AVX-512 Off45.397.9101.5OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.290.894.7AVX-512 512b DP44.191.494.7AVX-512 Off45.491.496.9OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

simdjson

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.090.895.9AVX-512 512b DP44.291.795.7AVX-512 Off44.591.595.0OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 3.10CPU Power Consumption Monitor20406080100

Embree

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.3223.9464.9AVX-512 512b DP44.4227.9466.7AVX-512 Off44.4232.8466.4OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption Monitor120240360480600

Embree

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5174.7461.6AVX-512 512b DP44.5175.3465.8AVX-512 Off44.8185.6465.5OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption Monitor120240360480600

Embree

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5255.9472.2AVX-512 512b DP44.3255.6483.0AVX-512 Off44.9262.0473.8OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 4.3CPU Power Consumption Monitor120240360480600

OpenVKL

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 2.0.0CPU Power Consumption MonitorAVX-512 256b DPAVX-512 512b DPAVX-512 Off90180270360450Min: 44.39 / Avg: 393.15 / Max: 472.86Min: 45.15 / Avg: 398.69 / Max: 481.96Min: 45.12 / Avg: 397.74 / Max: 490.78

OSPRay

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.1421.3481.5AVX-512 512b DP45.0433.1492.2AVX-512 Off44.9411.2479.1OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption Monitor130260390520650

OSPRay

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0422.3481.7AVX-512 512b DP44.7431.5491.6AVX-512 Off45.1415.0485.0OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption Monitor130260390520650

OSPRay

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.9406.8463.2AVX-512 512b DP44.8412.0469.6AVX-512 Off44.9418.8472.1OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 3.2CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0367.5458.2AVX-512 512b DP44.7370.3465.6AVX-512 Off44.8369.4466.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.8357.7460.6AVX-512 512b DP44.8358.8465.2AVX-512 Off44.9363.4473.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5386.0462.4AVX-512 512b DP46.1382.7467.1AVX-512 Off45.6388.1468.7OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5368.4462.2AVX-512 512b DP45.2370.9468.2AVX-512 Off44.9370.4472.3OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7357.9461.6AVX-512 512b DP45.3360.9473.7AVX-512 Off45.2365.7470.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7386.9462.6AVX-512 512b DP45.4386.9474.9AVX-512 Off44.9391.0472.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7367.6460.8AVX-512 512b DP44.7374.4467.4AVX-512 Off45.1370.3467.5OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.3370.7460.9AVX-512 512b DP44.8371.3471.7AVX-512 Off45.0400.4471.8OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

OSPRay Studio

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7393.5461.3AVX-512 512b DP45.4393.5473.2AVX-512 Off45.0321.5470.2OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 1.0CPU Power Consumption Monitor120240360480600

Y-Cruncher

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6231.0415.0AVX-512 512b DP44.8230.3409.3AVX-512 Off44.5240.3448.1OpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption Monitor120240360480600

Y-Cruncher

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.9316.2491.2AVX-512 512b DP44.9311.2489.1AVX-512 Off44.6320.5498.2OpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption Monitor130260390520650

Y-Cruncher

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7346.4503.6AVX-512 512b DP44.9337.9496.7AVX-512 Off45.0344.8505.2OpenBenchmarking.orgWatts, Fewer Is BetterY-Cruncher 0.8.5CPU Power Consumption Monitor130260390520650

Xmrig

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP23.4413.3484.4AVX-512 512b DP45.0425.0483.0AVX-512 Off44.9411.9480.5OpenBenchmarking.orgWatts, Fewer Is BetterXmrig 6.21CPU Power Consumption Monitor120240360480600

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7236.8397.5AVX-512 512b DP44.8208.7377.1AVX-512 Off44.7236.4416.4OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption Monitor110220330440550

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5170.8350.1AVX-512 512b DP44.6155.0307.5AVX-512 Off44.7169.7341.3OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption Monitor100200300400500

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5199.6293.3AVX-512 512b DP44.6201.5293.5AVX-512 Off44.8165.9308.6OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption Monitor80160240320400

oneDNN

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4307.2401.2AVX-512 512b DP44.9270.5371.2AVX-512 Off44.7313.7425.2OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 3.4CPU Power Consumption Monitor110220330440550

PyTorch

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.8235.7297.7AVX-512 512b DP45.2240.8304.4AVX-512 Off22.4251.8308.7OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption Monitor80160240320400

PyTorch

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5273.2315.2AVX-512 512b DP44.9277.5320.5AVX-512 Off45.0284.8324.2OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption Monitor80160240320400

PyTorch

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4272.9314.1AVX-512 512b DP45.3277.9321.2AVX-512 Off45.3286.1324.5OpenBenchmarking.orgWatts, Fewer Is BetterPyTorch 2.2.1CPU Power Consumption Monitor80160240320400

TensorFlow

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4364.6400.7AVX-512 512b DP45.3308.4336.5AVX-512 Off44.9331.5366.1OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption Monitor110220330440550

TensorFlow

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.0388.4431.1AVX-512 512b DP45.1337.6366.3AVX-512 Off44.9365.3399.9OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.16.1CPU Power Consumption Monitor110220330440550

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.3389.6438.2AVX-512 512b DP44.9362.1406.0AVX-512 Off44.9383.0429.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor110220330440550

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5365.4401.5AVX-512 512b DP45.1331.6366.3AVX-512 Off45.0366.1402.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor110220330440550

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7431.6479.6AVX-512 512b DP44.9387.3431.5AVX-512 Off45.2423.0469.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.8392.6427.0AVX-512 512b DP44.8358.6390.9AVX-512 Off45.0387.6424.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor110220330440550

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.4410.7449.1AVX-512 512b DP44.7390.5426.8AVX-512 Off23.2407.5446.0OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.2409.7452.7AVX-512 512b DP27.6352.3395.0AVX-512 Off45.4398.5449.8OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.3435.9487.1AVX-512 512b DP44.7435.0493.2AVX-512 Off45.0415.4462.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor130260390520650

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6402.2440.8AVX-512 512b DP45.3377.8414.0AVX-512 Off45.2398.8437.6OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4428.9467.6AVX-512 512b DP44.7428.1471.7AVX-512 Off45.0410.7448.5OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP45.2410.6455.6AVX-512 512b DP45.0367.8407.6AVX-512 Off45.9426.7471.7OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5415.5459.1AVX-512 512b DP45.0410.4450.5AVX-512 Off44.9393.3433.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

OpenVINO

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7411.4466.1AVX-512 512b DP45.3390.9437.9AVX-512 Off45.1327.8367.9OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2024.0CPU Power Consumption Monitor120240360480600

libxsmm

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5173.9448.3AVX-512 512b DP44.7181.5454.9AVX-512 Off44.9209.5465.0OpenBenchmarking.orgWatts, Fewer Is Betterlibxsmm 2-1.17-3645CPU Power Consumption Monitor120240360480600

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP28.1381.0419.9AVX-512 512b DP45.1317.6346.2AVX-512 Off45.0343.5379.8OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor110220330440550

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.5164.2174.4AVX-512 512b DP45.5174.9196.5AVX-512 Off44.9174.4186.4OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor50100150200250

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6337.8367.1AVX-512 512b DP45.1350.2376.7AVX-512 Off24.1353.1382.5OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor100200300400500

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6142.5153.3AVX-512 512b DP44.9145.0154.8AVX-512 Off44.7144.3154.2OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor4080120160200

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7358.0389.2AVX-512 512b DP45.3362.0392.7AVX-512 Off44.8359.3392.6OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor110220330440550

ONNX Runtime

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6394.2436.1AVX-512 512b DP44.8336.5372.3AVX-512 Off44.9381.1419.9OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.19CPU Power Consumption Monitor110220330440550

Numpy Benchmark

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.391.899.3AVX-512 512b DP44.792.3100.3AVX-512 Off44.792.1100.1OpenBenchmarking.orgWatts, Fewer Is BetterNumpy BenchmarkCPU Power Consumption Monitor20406080100

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.2176.5291.7AVX-512 512b DP44.7178.3298.3AVX-512 Off44.5178.1293.7OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.2CPU Power Consumption Monitor70140210280350

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.7212.0282.3AVX-512 512b DP44.5218.7287.1AVX-512 Off44.7220.6284.4OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.2CPU Power Consumption Monitor70140210280350

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.4220.5286.2AVX-512 512b DP44.6226.3292.3AVX-512 Off44.7229.0302.3OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.2CPU Power Consumption Monitor80160240320400

SVT-AV1

CPU Power Consumption Monitor

MinAvgMaxAVX-512 256b DP44.6245.4380.0AVX-512 512b DP44.9250.2395.9AVX-512 Off44.7250.9389.3OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 2.2CPU Power Consumption Monitor110220330440550

Phoronix Test Suite v10.8.5