AMD EPYC 4th Gen AVX-512 Comparison

AMD EPYC 9654 Genoa AVX-512 benchmark comparison by Michael Larabel for a future article.

HTML result view exported from: https://openbenchmarking.org/result/2212195-NE-AVXCOMPAR69&sgm=1&scalar=1&sro.

AMD EPYC 4th Gen AVX-512 ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerVulkanCompilerFile-SystemScreen ResolutionAVX-512 OnAVX-512 Off2 x AMD EPYC 9654 96-Core @ 2.40GHz (192 Cores / 384 Threads)AMD Titanite_4G (RTI1002E BIOS)AMD Device 14a41520GB800GB INTEL SSDPF21Q800GBASPEEDVGA HDMIBroadcom NetXtreme BCM5720 PCIeUbuntu 22.106.1.0-phx (x86_64)GNOME Shell 43.0X Server 1.21.1.41.3.224GCC 12.2.0 + Clang 15.0.2-1ext41920x1080OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseEnvironment Details- AVX-512 On: CXXFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" CFLAGS="-O3 -march=native -mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi -mprefer-vector-width=512" - AVX-512 Off: CXXFLAGS="-O3 -march=native -mno-avx512f" CFLAGS="-O3 -march=native -mno-avx512f" Compiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-12-U8K4Qv/gcc-12-12.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xa10110d Python Details- Python 3.10.7Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional IBRS_FW STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

AMD EPYC 4th Gen AVX-512 Comparisonai-benchmark: Device Inference Scoreai-benchmark: Device Training Scoreai-benchmark: Device AI Scoredeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Synchronous Single-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Synchronous Single-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Synchronous Single-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection,YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Synchronous Single-Streamtensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 16 - AlexNettensorflow: CPU - 16 - GoogLeNetlczero: BLASlczero: Eigenembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Asian Dragon Objembree: Pathtracer ISPC - Crownopenvkl: vklBenchmark ISPCospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray-studio: 1 - 1080p - 1 - Path Tracerospray-studio: 1 - 1080p - 16 - Path Tracerospray-studio: 1 - 1080p - 32 - Path Tracerospray-studio: 1 - 4K - 1 - Path Tracerospray-studio: 1 - 4K - 16 - Path Tracerospray-studio: 1 - 4K - 32 - Path Tracerospray-studio: 2 - 1080p - 1 - Path Tracerospray-studio: 2 - 1080p - 16 - Path Tracerospray-studio: 2 - 1080p - 32 - Path Tracerospray-studio: 2 - 4K - 1 - Path Tracerospray-studio: 2 - 4K - 16 - Path Tracerospray-studio: 2 - 4K - 32 - Path Tracerospray-studio: 3 - 1080p - 1 - Path Tracerospray-studio: 3 - 1080p - 16 - Path Tracerospray-studio: 3 - 1080p - 32 - Path Tracerospray-studio: 3 - 4K - 1 - Path Tracerospray-studio: 3 - 4K - 16 - Path Tracerospray-studio: 3 - 4K - 32 - Path Traceronednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUmnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: inception-v3cpuminer-opt: scryptcpuminer-opt: Quad SHA-256, Pyritecpuminer-opt: x25xcpuminer-opt: Garlicoincpuminer-opt: Skeincoincpuminer-opt: LBC, LBRY Creditsncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - resnet50ncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP32 - CPUopenvino: Person Detection FP32 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUgromacs: MPI CPU - water_GMX50_bareonnx: fcn-resnet101-11 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardnumpy: minibude: OpenMP - BM1minibude: OpenMP - BM1minibude: OpenMP - BM2minibude: OpenMP - BM2svt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Knumenta-nab: Bayesian Changepointnumenta-nab: Windowed Gaussiannumenta-nab: Relative Entropyoidn: RT.hdr_alb_nrm.3840x2160oidn: RT.ldr_alb_nrm.3840x2160oidn: RTLightmap.hdr.4096x4096daphne: OpenMP - NDT Mappingdaphne: OpenMP - Points2Imagesimdjson: PartialTweetssimdjson: LargeRandsimdjson: Kostyasimdjson: DistinctUserIDsimdjson: TopTweetopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timecp2k: Fayalite-FISTsmhasher: FarmHash32 x86_64 AVXsmhasher: FarmHash32 x86_64 AVXjpegxl: JPEG - 90jpegxl: JPEG - 100jpegxl: PNG - 90AVX-512 OnAVX-512 Off35102701621184.998811.7586616.6804155.3462187.08375.34131195.936780.08261953.025549.032834.520628.9609100.54589.9408761.2241125.7860189.56115.2712857.2265111.728234.251829.189222.15157.2960.1790779096212.9364184.4701180.9315133244.156643.071154.218714823534698581927118546154238447646049385188081772804560869411070221840.51616722.58750.9895911962.061955.392361.2715.4418.57945.8124800.6122606807696.06715531951330106695042.3057.7125.8872.8066.34247.3274.9358.95102.04469.29193.93246.98148967.980.55170652.710.3643.341100.2543.341101.0019800.209.639988.444.7911202.624.287452.966.439065.345.29956.8850.1118.76427174015161051575.667299.545291.9828652.005346.081246.572245.55516.6774.7279.8983.513.511.661371.1813677.7644948436.701.264.186.866.52135.77418113.637331122.72539794.4426.3879.550.749.9518211066288773.538013.5907509.4462187.8540177.53875.62821005.161595.33471410.805167.911830.606232.664771.043714.0655490.3658195.1656157.8196.3313690.8722138.586130.526732.750512.7555.1131.1284238162176.8831153.4476151.0558115526.379425.135440.51171812871574971011321226471842924586172211524229852143413682084113398267850.53768222.83541.763364953.984989.131715.7624.0989.14630.4362946.0813229605784.2548827142754349174044.1962.8629.0076.1367.48270.1286.1660.7343.941088.5094.97503.50108449.491.21151239.600.5725.501864.9325.741845.959672.9419.694110.4911.666065.767.903782.0812.675135.569.33445.59107.6218.4672506288499918548.835065.096202.6046391.519255.661239.881233.94417.3894.88210.0353.503.511.721335.6311521.385.141.043.395.255.38144.3478135.216481198.40836483.7026.4129.130.729.52OpenBenchmarking.org

AI Benchmark Alpha

Device Inference Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Inference ScoreAVX-512 OffAVX-512 On800160024003200400018213510

AI Benchmark Alpha

Device Training Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device Training ScoreAVX-512 OffAVX-512 On600120018002400300010662701

AI Benchmark Alpha

Device AI Score

OpenBenchmarking.orgScore, More Is BetterAI Benchmark Alpha 0.1.2Device AI ScoreAVX-512 OffAVX-512 On1300260039005200650028876211

AI Benchmark Alpha

Device AI Score

OpenBenchmarking.orgScore Per Watt, More Is BetterAI Benchmark Alpha 0.1.2Device AI ScoreAVX-512 OffAVX-512 On5101520259.34920.522

AI Benchmark Alpha

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterAI Benchmark Alpha 0.1.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3068 / Avg: 3710.43 / Max: 4285Min: 2400 / Avg: 3655.25 / Max: 4107

AI Benchmark Alpha

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterAI Benchmark Alpha 0.1.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 130.74 / Avg: 308.79 / Max: 452.71Min: 52.89 / Avg: 302.65 / Max: 502

AI Benchmark Alpha

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterAI Benchmark Alpha 0.1.2CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36.38 / Avg: 40.62 / Max: 49.25Min: 30.13 / Avg: 39.21 / Max: 47

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.27, N = 3SE +/- 0.45, N = 373.5485.00

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On3691215SE +/- 0.05, N = 3SE +/- 0.06, N = 313.5911.76

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3507 / Avg: 3697.8 / Max: 3967Min: 2400 / Avg: 3558.88 / Max: 3801

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 111.53 / Avg: 321.84 / Max: 409.93Min: 50.93 / Avg: 306.45 / Max: 407.88

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36.75 / Avg: 45.16 / Max: 52.38Min: 32.38 / Avg: 43.66 / Max: 51.5

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On130260390520650SE +/- 0.33, N = 3SE +/- 1.92, N = 3509.45616.68

Neural Magic DeepSparse

Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.10, N = 3SE +/- 0.47, N = 3187.85155.35

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2589 / Avg: 3135.25 / Max: 4299Min: 2400 / Avg: 3109.43 / Max: 3928

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 216.33 / Avg: 508.29 / Max: 704.99Min: 52.62 / Avg: 479.34 / Max: 678.54

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 41.75 / Avg: 51.54 / Max: 60Min: 38.63 / Avg: 49.4 / Max: 57

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.29, N = 3SE +/- 0.11, N = 3177.54187.08

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On1.26632.53263.79895.06526.3315SE +/- 0.0091, N = 3SE +/- 0.0031, N = 35.62825.3413

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3692 / Avg: 3711.83 / Max: 4154Min: 2400 / Avg: 3541.16 / Max: 3702

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 197.38 / Avg: 352.22 / Max: 401.64Min: 37.83 / Avg: 324.57 / Max: 394.52

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 43 / Avg: 50.55 / Max: 54.25Min: 39 / Avg: 47.98 / Max: 52.38

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On30060090012001500SE +/- 0.78, N = 3SE +/- 2.39, N = 31005.161195.94

Neural Magic DeepSparse

Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.05, N = 3SE +/- 0.14, N = 395.3380.08

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2623 / Avg: 2986.9 / Max: 4137Min: 2400 / Avg: 2868.39 / Max: 3737

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 217.38 / Avg: 552 / Max: 658.89Min: 48.96 / Avg: 516.75 / Max: 625.27

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 43.88 / Avg: 54.42 / Max: 59.13Min: 39.88 / Avg: 51.19 / Max: 55.5

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On400800120016002000SE +/- 0.17, N = 3SE +/- 4.32, N = 31410.811953.03

Neural Magic DeepSparse

Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On1530456075SE +/- 0.02, N = 3SE +/- 0.11, N = 367.9149.03

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2552 / Avg: 2938.06 / Max: 3959Min: 2400 / Avg: 3003.32 / Max: 3730

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On110220330440550Min: 216.19 / Avg: 558.42 / Max: 636.75Min: 55.55 / Avg: 530.66 / Max: 630.04

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 44.38 / Avg: 54.9 / Max: 59.13Min: 38.13 / Avg: 51.87 / Max: 57.25

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.03, N = 3SE +/- 0.03, N = 330.6134.52

Neural Magic DeepSparse

Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.04, N = 3SE +/- 0.03, N = 332.6628.96

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On9001800270036004500Min: 3686 / Avg: 3710.77 / Max: 4893Min: 2400 / Avg: 3550.9 / Max: 3868

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On80160240320400Min: 110.43 / Avg: 350.76 / Max: 422.85Min: 49.79 / Avg: 321.79 / Max: 419.38

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 43.88 / Avg: 50.7 / Max: 55.5Min: 38.88 / Avg: 47.8 / Max: 53.75

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On20406080100SE +/- 0.17, N = 3SE +/- 0.17, N = 371.04100.55

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On48121620SE +/- 0.0334, N = 3SE +/- 0.0172, N = 314.06559.9408

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3678 / Avg: 3701.55 / Max: 4150Min: 2400 / Avg: 3570.99 / Max: 3764

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 123.99 / Avg: 352.89 / Max: 412.55Min: 57.72 / Avg: 334.16 / Max: 406.11

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 43 / Avg: 50.59 / Max: 56.88Min: 38.13 / Avg: 48.5 / Max: 54.75

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On160320480640800SE +/- 0.61, N = 3SE +/- 0.79, N = 3490.37761.22

Neural Magic DeepSparse

Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.23, N = 3SE +/- 0.11, N = 3195.17125.79

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 2568 / Avg: 3214.25 / Max: 4450Min: 2400 / Avg: 2944.53 / Max: 3885

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 113.83 / Avg: 502.51 / Max: 699.7Min: 54.23 / Avg: 536.99 / Max: 699.93

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 43.5 / Avg: 51.54 / Max: 59.13Min: 39.25 / Avg: 51.94 / Max: 58.25

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On4080120160200SE +/- 0.17, N = 3SE +/- 0.22, N = 3157.82189.56

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On246810SE +/- 0.0068, N = 3SE +/- 0.0061, N = 36.33135.2712

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3068 / Avg: 3641.4 / Max: 4426Min: 2400 / Avg: 3527.15 / Max: 3821

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 202.02 / Avg: 364.84 / Max: 414.15Min: 52.29 / Avg: 341.29 / Max: 408.72

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 44.38 / Avg: 52.15 / Max: 55.63Min: 39.75 / Avg: 50.13 / Max: 54.63

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On2004006008001000SE +/- 1.12, N = 3SE +/- 0.77, N = 3690.87857.23

Neural Magic DeepSparse

Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-StreamAVX-512 OffAVX-512 On306090120150SE +/- 0.25, N = 3SE +/- 0.12, N = 3138.59111.73

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2535 / Avg: 2908.24 / Max: 3834Min: 2400 / Avg: 2878.73 / Max: 3730

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 217.33 / Avg: 551.67 / Max: 655.62Min: 28.14 / Avg: 552.74 / Max: 664.08

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 44.88 / Avg: 54.43 / Max: 61.75Min: 40.13 / Avg: 52.94 / Max: 57.88

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.10, N = 3SE +/- 0.08, N = 330.5334.25

Neural Magic DeepSparse

Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.1Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-StreamAVX-512 OffAVX-512 On816243240SE +/- 0.11, N = 3SE +/- 0.07, N = 332.7529.19

Neural Magic DeepSparse

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3089 / Avg: 3678.77 / Max: 4336Min: 2400 / Avg: 3533.07 / Max: 3703

Neural Magic DeepSparse

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On80160240320400Min: 209.98 / Avg: 351.07 / Max: 423.87Min: 30.18 / Avg: 328.4 / Max: 418.51

Neural Magic DeepSparse

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 43.5 / Avg: 50.69 / Max: 56.88Min: 40.63 / Avg: 48.69 / Max: 54.25

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On510152025SE +/- 0.01, N = 3SE +/- 0.11, N = 312.7522.15

TensorFlow

Device: CPU - Batch Size: 16 - Model: ResNet-50

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: ResNet-50AVX-512 OffAVX-512 On0.01620.03240.04860.06480.0810.0380.072

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3713.14 / Max: 4254Min: 2400 / Avg: 3663.75 / Max: 4099

TensorFlow

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 165.71 / Avg: 338.79 / Max: 379.67Min: 53.48 / Avg: 307.14 / Max: 397.43

TensorFlow

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 40.88 / Avg: 43.43 / Max: 53.5Min: 36.75 / Avg: 41.66 / Max: 48.63

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetAVX-512 OffAVX-512 On306090120150SE +/- 0.19, N = 3SE +/- 2.35, N = 1255.11157.29

TensorFlow

Device: CPU - Batch Size: 16 - Model: AlexNet

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: AlexNetAVX-512 OffAVX-512 On0.11810.23620.35430.47240.59050.1730.525

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3694 / Avg: 3732 / Max: 4340Min: 2400 / Avg: 3458.15 / Max: 3812

TensorFlow

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 169.73 / Avg: 318.92 / Max: 350.45Min: 48.85 / Avg: 299.74 / Max: 409.21

TensorFlow

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 39 / Avg: 41.03 / Max: 47.5Min: 35 / Avg: 40.53 / Max: 48.88

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX-512 OffAVX-512 On1326395265SE +/- 0.25, N = 3SE +/- 1.01, N = 1531.1260.17

TensorFlow

Device: CPU - Batch Size: 16 - Model: GoogLeNet

OpenBenchmarking.orgimages/sec Per Watt, More Is BetterTensorFlow 2.10Device: CPU - Batch Size: 16 - Model: GoogLeNetAVX-512 OffAVX-512 On0.04390.08780.13170.17560.21950.1040.195

TensorFlow

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterTensorFlow 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3694 / Avg: 3726.81 / Max: 4474Min: 2400 / Avg: 3586.18 / Max: 4161

TensorFlow

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterTensorFlow 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 156.06 / Avg: 298.91 / Max: 329.28Min: 53.06 / Avg: 308.04 / Max: 379.51

TensorFlow

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterTensorFlow 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 38.63 / Avg: 40.49 / Max: 50.38Min: 34.63 / Avg: 41.7 / Max: 48.88

LeelaChessZero

Backend: BLAS

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 21.53, N = 3SE +/- 103.04, N = 484239077-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -flto -O3 -march=native -pthread

LeelaChessZero

Backend: BLAS

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: BLASAVX-512 OffAVX-512 On61218243021.9323.78

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On9001800270036004500Min: 3383 / Avg: 3700.34 / Max: 4961Min: 2400 / Avg: 3683.95 / Max: 3952

LeelaChessZero

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 153.23 / Avg: 384.04 / Max: 522.79Min: 55.6 / Avg: 381.67 / Max: 513.97

LeelaChessZero

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 47.5 / Avg: 57.42 / Max: 64.5Min: 36.75 / Avg: 51.98 / Max: 63.13

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 43.59, N = 3SE +/- 45.37, N = 381629096-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -flto -O3 -march=native -pthread

LeelaChessZero

Backend: Eigen

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.28Backend: EigenAVX-512 OffAVX-512 On61218243021.2924.89

LeelaChessZero

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.28CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3699.28 / Max: 4052Min: 2400 / Avg: 3685.09 / Max: 4074

LeelaChessZero

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterLeelaChessZero 0.28CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 112.46 / Avg: 383.34 / Max: 519.63Min: 56.3 / Avg: 365.43 / Max: 500.14

LeelaChessZero

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterLeelaChessZero 0.28CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 37.25 / Avg: 39.89 / Max: 56.88Min: 32.38 / Avg: 53.41 / Max: 61

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On50100150200250SE +/- 0.21, N = 8SE +/- 0.22, N = 9176.88212.94MIN: 170.19 / MAX: 190MIN: 207.72 / MAX: 227.11

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian DragonAVX-512 OffAVX-512 On0.15910.31820.47730.63640.79550.4310.707

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 2899 / Avg: 3508.39 / Max: 4437Min: 2400 / Avg: 2974.09 / Max: 3695

Embree

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On110220330440550Min: 132.45 / Avg: 410.27 / Max: 637.46Min: 50.43 / Avg: 301.06 / Max: 634.79

Embree

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 41.75 / Avg: 45.78 / Max: 51.13Min: 35.5 / Avg: 40.45 / Max: 47

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On4080120160200SE +/- 0.36, N = 4SE +/- 0.62, N = 4153.45184.47MIN: 130.31 / MAX: 166.17MIN: 178.83 / MAX: 196.34

Embree

Binary: Pathtracer ISPC - Model: Asian Dragon Obj

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: Asian Dragon ObjAVX-512 OffAVX-512 On0.16310.32620.48930.65240.81550.4810.725

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2889 / Avg: 3592.04 / Max: 4020Min: 2400 / Avg: 3371.79 / Max: 3699

Embree

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On110220330440550Min: 217.44 / Avg: 318.92 / Max: 631.59Min: 56.17 / Avg: 254.47 / Max: 632.48

Embree

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 39.88 / Avg: 42.39 / Max: 49.25Min: 34.63 / Avg: 38.4 / Max: 46.63

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On4080120160200SE +/- 0.25, N = 7SE +/- 0.62, N = 8151.06180.93MIN: 114.4 / MAX: 176.43MIN: 124.41 / MAX: 209.74

Embree

Binary: Pathtracer ISPC - Model: Crown

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 3.13Binary: Pathtracer ISPC - Model: CrownAVX-512 OffAVX-512 On0.11790.23580.35370.47160.58950.3440.524

Embree

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterEmbree 3.13CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On9001800270036004500Min: 2726 / Avg: 3445.59 / Max: 5379Min: 2400 / Avg: 2928.33 / Max: 3696

Embree

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterEmbree 3.13CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 174.28 / Avg: 438.59 / Max: 659.78Min: 54.28 / Avg: 345.51 / Max: 646.36

Embree

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterEmbree 3.13CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 39.5 / Avg: 45.81 / Max: 52Min: 33.25 / Avg: 40.52 / Max: 48

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On30060090012001500SE +/- 8.11, N = 3SE +/- 13.58, N = 311551332MIN: 251 / MAX: 5181MIN: 329 / MAX: 4770

OpenVKL

Benchmark: vklBenchmark ISPC

OpenBenchmarking.orgItems / Sec Per Watt, More Is BetterOpenVKL 1.3.1Benchmark: vklBenchmark ISPCAVX-512 OffAVX-512 On0.64191.28381.92572.56763.20952.3552.853

OpenVKL

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVKL 1.3.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2621 / Avg: 3373.13 / Max: 4085Min: 2400 / Avg: 3408.84 / Max: 3732

OpenVKL

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVKL 1.3.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 113.56 / Avg: 490.53 / Max: 691.71Min: 55.92 / Avg: 466.92 / Max: 669.54

OpenVKL

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVKL 1.3.1CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 42.63 / Avg: 52.24 / Max: 60.88Min: 41.25 / Avg: 49.91 / Max: 58.25

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.02, N = 3SE +/- 0.21, N = 326.3844.16

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/ao/real_timeAVX-512 OffAVX-512 On0.01710.03420.05130.06840.08550.0430.076

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2771 / Avg: 3072.96 / Max: 4018Min: 2400 / Avg: 3080.62 / Max: 3695

OSPRay

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 222.05 / Avg: 617.94 / Max: 662.21Min: 56.18 / Avg: 579.96 / Max: 632.73

OSPRay

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 45.25 / Avg: 59.76 / Max: 65Min: 39.88 / Avg: 56.2 / Max: 59.5

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On1020304050SE +/- 0.04, N = 3SE +/- 0.10, N = 325.1443.07

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeAVX-512 OffAVX-512 On0.01670.03340.05010.06680.08350.0410.074

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2768 / Avg: 3082.79 / Max: 4016Min: 2400 / Avg: 3051.17 / Max: 3695

OSPRay

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 177.17 / Avg: 619.7 / Max: 661.8Min: 56.2 / Avg: 581.88 / Max: 631.81

OSPRay

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 48.38 / Avg: 60.35 / Max: 63.5Min: 41.75 / Avg: 56.82 / Max: 60.38

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On1224364860SE +/- 0.03, N = 3SE +/- 0.05, N = 340.5154.22

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.10Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeAVX-512 OffAVX-512 On0.02050.0410.06150.0820.10250.0650.091

OSPRay

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay 2.10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 2766 / Avg: 3104.1 / Max: 4475Min: 2400 / Avg: 3054.57 / Max: 3720

OSPRay

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay 2.10CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 221.33 / Avg: 627.82 / Max: 676.56Min: 57.81 / Avg: 593.48 / Max: 646.45

OSPRay

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay 2.10CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 47.5 / Avg: 61.28 / Max: 64.88Min: 42.88 / Avg: 57.75 / Max: 60.88

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On4080120160200SE +/- 0.33, N = 3SE +/- 0.33, N = 3181148-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2708 / Avg: 2997.26 / Max: 3911Min: 2400 / Avg: 2939.43 / Max: 3695

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 217.87 / Avg: 614.05 / Max: 691.83Min: 55.35 / Avg: 593 / Max: 679.54

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 41.75 / Avg: 58.88 / Max: 64.5Min: 36.38 / Avg: 56.31 / Max: 62.25

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On6001200180024003000SE +/- 1.20, N = 3SE +/- 2.33, N = 328712353-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2696 / Avg: 2979.04 / Max: 4041Min: 2400 / Avg: 2929.94 / Max: 3699

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 222.75 / Avg: 621.76 / Max: 699.12Min: 55.76 / Avg: 599.28 / Max: 685.06

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 60.67 / Max: 64.88Min: 43.5 / Avg: 58.4 / Max: 65

OSPRay Studio

Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On12002400360048006000SE +/- 6.56, N = 3SE +/- 3.71, N = 357494698-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2802 / Avg: 2978.35 / Max: 4050Min: 2400 / Avg: 2904.27 / Max: 3702

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 222 / Avg: 628.81 / Max: 701.79Min: 58.44 / Avg: 606.01 / Max: 686.62

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 61.29 / Max: 68Min: 44 / Avg: 59.04 / Max: 64

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On150300450600750SE +/- 2.08, N = 3SE +/- 1.00, N = 3710581-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2696 / Avg: 3001.5 / Max: 3902Min: 2400 / Avg: 2950.45 / Max: 3701

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 225.24 / Avg: 610.5 / Max: 696.78Min: 51.41 / Avg: 589.6 / Max: 686.74

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 48 / Avg: 60.2 / Max: 64Min: 44.13 / Avg: 57.91 / Max: 62.25

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 24.46, N = 3SE +/- 10.17, N = 3113219271-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2709 / Avg: 2936.7 / Max: 3983Min: 2400 / Avg: 2888.49 / Max: 3699

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 223.23 / Avg: 637.87 / Max: 702.53Min: 56.46 / Avg: 617.93 / Max: 683.89

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 62 / Max: 65.38Min: 43.75 / Avg: 59.73 / Max: 64.88

OSPRay Studio

Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 27.41, N = 3SE +/- 13.75, N = 32264718546-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2769 / Avg: 2988.85 / Max: 3982Min: 2400 / Avg: 2876.44 / Max: 3752

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 127.94 / Avg: 609.76 / Max: 701Min: 57.88 / Avg: 623 / Max: 686.53

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 47.5 / Avg: 60.27 / Max: 66.25Min: 44.88 / Avg: 60.33 / Max: 65.38

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On4080120160200SE +/- 0.33, N = 3SE +/- 0.00, N = 3184154-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2702 / Avg: 2995.4 / Max: 3808Min: 2400 / Avg: 2858.62 / Max: 3697

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 202.76 / Avg: 612.92 / Max: 697.25Min: 58.93 / Avg: 591.32 / Max: 670.48

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 47 / Avg: 59.91 / Max: 64Min: 44.88 / Avg: 57.66 / Max: 61.75

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On6001200180024003000SE +/- 0.88, N = 3SE +/- 9.17, N = 329242384-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2783 / Avg: 2993.27 / Max: 3739Min: 2400 / Avg: 2921.96 / Max: 3700

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 115.64 / Avg: 621.06 / Max: 700.58Min: 29.25 / Avg: 598.66 / Max: 684.37

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 60.6 / Max: 64.88Min: 43.75 / Avg: 58.37 / Max: 62.63

OSPRay Studio

Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On13002600390052006500SE +/- 8.25, N = 3SE +/- 6.24, N = 358614764-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2771 / Avg: 2971.62 / Max: 3740Min: 2400 / Avg: 2935.35 / Max: 3696

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 223.51 / Avg: 626.51 / Max: 702.12Min: 54.05 / Avg: 604.19 / Max: 685.9

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 61.29 / Max: 65.75Min: 43.75 / Avg: 58.94 / Max: 63.13

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On160320480640800SE +/- 0.67, N = 3SE +/- 1.00, N = 3722604-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2712 / Avg: 3004.41 / Max: 3940Min: 2400 / Avg: 2868.37 / Max: 3857

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 223.04 / Avg: 609.01 / Max: 695.97Min: 54.84 / Avg: 577.88 / Max: 672.17

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 59.86 / Max: 64Min: 44.38 / Avg: 56.96 / Max: 61.38

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 15.51, N = 3SE +/- 2.19, N = 3115249385-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2721 / Avg: 2960.32 / Max: 3862Min: 2400 / Avg: 2906.14 / Max: 3696

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 114.31 / Avg: 635.42 / Max: 701.46Min: 57.19 / Avg: 615.86 / Max: 687.94

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.13 / Avg: 61.63 / Max: 65.38Min: 43.5 / Avg: 59.68 / Max: 64

OSPRay Studio

Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On5K10K15K20K25KSE +/- 30.02, N = 3SE +/- 20.34, N = 32298518808-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 2726 / Avg: 3006.5 / Max: 4349Min: 2400 / Avg: 2907.3 / Max: 3700

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 223.84 / Avg: 609.38 / Max: 699.79Min: 59.92 / Avg: 615.86 / Max: 683.25

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 47.5 / Avg: 59.94 / Max: 64.13Min: 45.25 / Avg: 59.85 / Max: 64.88

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On50100150200250SE +/- 0.58, N = 3SE +/- 0.00, N = 3214177-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2705 / Avg: 3000.68 / Max: 3951Min: 2400 / Avg: 2931.19 / Max: 3701

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 223.11 / Avg: 620.67 / Max: 696.49Min: 38.44 / Avg: 597.2 / Max: 681.57

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 60.35 / Max: 64.5Min: 44.13 / Avg: 58.44 / Max: 62.25

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On7001400210028003500SE +/- 7.00, N = 3SE +/- 3.06, N = 334132804-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2721 / Avg: 2971.47 / Max: 4031Min: 2400 / Avg: 2925.76 / Max: 3699

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 222.55 / Avg: 620.61 / Max: 699.43Min: 31.45 / Avg: 602.28 / Max: 683.97

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 47 / Avg: 60.78 / Max: 64.88Min: 43.75 / Avg: 58.72 / Max: 65.38

OSPRay Studio

Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 1080p - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On15003000450060007500SE +/- 5.51, N = 3SE +/- 9.54, N = 368205608-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2715 / Avg: 2972.25 / Max: 4286Min: 2400 / Avg: 2923.29 / Max: 3697

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 222.46 / Avg: 629.66 / Max: 700.46Min: 58.42 / Avg: 611.01 / Max: 683.58

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 61.27 / Max: 66.25Min: 43.75 / Avg: 59.32 / Max: 64

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path TracerAVX-512 OffAVX-512 On2004006008001000SE +/- 1.15, N = 3SE +/- 1.53, N = 3841694-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 2721 / Avg: 2996.11 / Max: 4398Min: 2400 / Avg: 2936.87 / Max: 3698

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 221.26 / Avg: 611.93 / Max: 698.37Min: 38.6 / Avg: 591.33 / Max: 683.83

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 59.98 / Max: 64Min: 44.88 / Avg: 58.21 / Max: 62.75

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path TracerAVX-512 OffAVX-512 On3K6K9K12K15KSE +/- 22.81, N = 3SE +/- 27.14, N = 31339811070-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2752 / Avg: 2955.92 / Max: 4184Min: 2400 / Avg: 2909.58 / Max: 3697

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 114.15 / Avg: 636.62 / Max: 702.68Min: 59.99 / Avg: 618.36 / Max: 690.47

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.63 / Avg: 61.61 / Max: 64.88Min: 44.63 / Avg: 59.86 / Max: 64.88

OSPRay Studio

Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer

OpenBenchmarking.orgms, Fewer Is BetterOSPRay Studio 0.11Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path TracerAVX-512 OffAVX-512 On6K12K18K24K30KSE +/- 15.62, N = 3SE +/- 21.63, N = 32678522184-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ldl

OSPRay Studio

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOSPRay Studio 0.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2727 / Avg: 2973.4 / Max: 3711Min: 2400 / Avg: 2943.3 / Max: 3701

OSPRay Studio

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOSPRay Studio 0.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 224.25 / Avg: 620 / Max: 701.53Min: 56.53 / Avg: 589.53 / Max: 687.19

OSPRay Studio

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOSPRay Studio 0.11CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 47 / Avg: 60.75 / Max: 65.38Min: 44.63 / Avg: 57.95 / Max: 62.63

oneDNN

Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On0.1210.2420.3630.4840.605SE +/- 0.004200, N = 15SE +/- 0.004067, N = 70.5376820.516167-mno-avx512f - MIN: 0.42-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.421. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2860 / Avg: 3347.84 / Max: 3869Min: 2400 / Avg: 3181.88 / Max: 3695

oneDNN

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 216.42 / Avg: 379.51 / Max: 540.89Min: 54.12 / Avg: 327.3 / Max: 548.78

oneDNN

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 43.5 / Avg: 47.73 / Max: 53.75Min: 40.88 / Avg: 46.02 / Max: 51.13

oneDNN

Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On510152025SE +/- 0.06, N = 3SE +/- 0.16, N = 322.8422.59-mno-avx512f - MIN: 20.22-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 19.61. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2933 / Avg: 3525.84 / Max: 3802Min: 2400 / Avg: 3393.99 / Max: 3729

oneDNN

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 215.52 / Avg: 392.47 / Max: 509.73Min: 52.14 / Avg: 376.06 / Max: 492.54

oneDNN

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 39.5 / Avg: 43.77 / Max: 47Min: 37.25 / Avg: 43.54 / Max: 46.13

oneDNN

Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On0.39680.79361.19041.58721.984SE +/- 0.004550, N = 9SE +/- 0.001906, N = 91.7633600.989591-mno-avx512f - MIN: 1.55-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.91. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3569 / Avg: 3665.95 / Max: 4064Min: 2400 / Avg: 3007.81 / Max: 3695

oneDNN

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 215.17 / Avg: 323.91 / Max: 475.58Min: 54.03 / Avg: 248.76 / Max: 512.83

oneDNN

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 On918273645Min: 39 / Avg: 41.36 / Max: 43.88Min: 35.88 / Avg: 39.32 / Max: 44.38

oneDNN

Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 60.12, N = 4SE +/- 20.13, N = 54953.981962.06-mno-avx512f - MIN: 4690.85-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1899.341. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3581 / Avg: 3622.69 / Max: 3818Min: 2400 / Avg: 3570.57 / Max: 3711

oneDNN

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 215.18 / Avg: 412.46 / Max: 499.64Min: 55.47 / Avg: 418.59 / Max: 541.12

oneDNN

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 38.63 / Avg: 45.88 / Max: 50.13Min: 35.5 / Avg: 45.97 / Max: 50.63

oneDNN

Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On11002200330044005500SE +/- 41.71, N = 3SE +/- 19.67, N = 154989.131955.39-mno-avx512f - MIN: 4767.22-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 1769.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3582 / Avg: 3626.86 / Max: 4223Min: 2400 / Avg: 3567.66 / Max: 3704

oneDNN

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 195.71 / Avg: 412.52 / Max: 498.86Min: 52.5 / Avg: 419.24 / Max: 543.13

oneDNN

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 42.63 / Avg: 46.63 / Max: 50.63Min: 37.75 / Avg: 46.67 / Max: 51.5

oneDNN

Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.7Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPUAVX-512 OffAVX-512 On5001000150020002500SE +/- 22.32, N = 3SE +/- 24.41, N = 41715.762361.27-mno-avx512f - MIN: 1607.13-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 2265.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl -lpthread

oneDNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetteroneDNN 2.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3570 / Avg: 3611.7 / Max: 4005Min: 2400 / Avg: 3507.27 / Max: 3700

oneDNN

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetteroneDNN 2.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 203.96 / Avg: 413.93 / Max: 482.05Min: 55.22 / Avg: 413.84 / Max: 581.07

oneDNN

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetteroneDNN 2.7CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 42.63 / Avg: 46.79 / Max: 49.75Min: 37.75 / Avg: 45.84 / Max: 48.88

Mobile Neural Network

Model: resnet-v2-50

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: resnet-v2-50AVX-512 OffAVX-512 On612182430SE +/- 0.08, N = 8SE +/- 0.08, N = 924.1015.44-mno-avx512f - MIN: 23.44 / MAX: 71.32-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 14.79 / MAX: 54.051. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: SqueezeNetV1.0

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: SqueezeNetV1.0AVX-512 OffAVX-512 On3691215SE +/- 0.091, N = 8SE +/- 0.147, N = 99.1468.579-mno-avx512f - MIN: 7.72 / MAX: 19.03-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 6.67 / MAX: 21.51. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

Model: inception-v3

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.1Model: inception-v3AVX-512 OffAVX-512 On1020304050SE +/- 0.13, N = 8SE +/- 0.23, N = 930.4445.81-mno-avx512f - MIN: 28.75 / MAX: 109.22-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 44.13 / MAX: 87.281. (CXX) g++ options: -O3 -march=native -std=c++11 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -rdynamic -pthread -ldl

Mobile Neural Network

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterMobile Neural Network 2.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3699.72 / Max: 4041Min: 2400 / Avg: 3679.28 / Max: 3704

Mobile Neural Network

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterMobile Neural Network 2.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On60120180240300Min: 165 / Avg: 334.93 / Max: 346.27Min: 53.81 / Avg: 327.57 / Max: 340

Mobile Neural Network

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterMobile Neural Network 2.1CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 40.38 / Avg: 49.52 / Max: 52.88Min: 35.88 / Avg: 48.36 / Max: 52

Cpuminer-Opt

Algorithm: scrypt

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On10002000300040005000SE +/- 0.31, N = 3SE +/- 0.45, N = 32946.084800.61-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: scrypt

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: scryptAVX-512 OffAVX-512 On2468105.2798.076

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2933 / Avg: 3058.31 / Max: 3896Min: 2400 / Avg: 3009.4 / Max: 3697

Cpuminer-Opt

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 215.48 / Avg: 558.04 / Max: 618.31Min: 55.19 / Avg: 594.44 / Max: 681.94

Cpuminer-Opt

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39.5 / Avg: 52.4 / Max: 56.88Min: 34.13 / Avg: 52.16 / Max: 58.25

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On500K1000K1500K2000K2500KSE +/- 276.83, N = 3SE +/- 9040.25, N = 313229602260680-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Quad SHA-256, Pyrite

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: Quad SHA-256, PyriteAVX-512 OffAVX-512 On80016002400320040002252.993657.53

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3001 / Avg: 3154.76 / Max: 4285Min: 2400 / Avg: 3111.92 / Max: 3695

Cpuminer-Opt

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 133.92 / Avg: 587.2 / Max: 653.59Min: 57.27 / Avg: 618.09 / Max: 724.28

Cpuminer-Opt

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 46.63 / Avg: 57.87 / Max: 61.38Min: 43 / Avg: 58.61 / Max: 62.75

Cpuminer-Opt

Algorithm: x25x

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On16003200480064008000SE +/- 14.41, N = 3SE +/- 16.58, N = 35784.257696.06-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: x25x

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: x25xAVX-512 OffAVX-512 On36912159.97113.548

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3256 / Avg: 3350.91 / Max: 4121Min: 2400 / Avg: 3104.59 / Max: 3697

Cpuminer-Opt

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On110220330440550Min: 221.04 / Avg: 580.08 / Max: 645.02Min: 39.28 / Avg: 568.06 / Max: 650.06

Cpuminer-Opt

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 46.63 / Avg: 58.18 / Max: 60.88Min: 42 / Avg: 57.13 / Max: 60.38

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinAVX-512 OffAVX-512 On15K30K45K60K75KSE +/- 13.33, N = 3SE +/- 89.69, N = 34882771553-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Garlicoin

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: GarlicoinAVX-512 OffAVX-512 On30609012015083.22119.97

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2878 / Avg: 3030.14 / Max: 3783Min: 2400 / Avg: 3079.49 / Max: 3830

Cpuminer-Opt

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 220 / Avg: 586.76 / Max: 656.76Min: 56.98 / Avg: 596.43 / Max: 693.68

Cpuminer-Opt

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 45.75 / Avg: 57.15 / Max: 60.88Min: 41.25 / Avg: 56.3 / Max: 60.88

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On400K800K1200K1600K2000KSE +/- 3964.01, N = 3SE +/- 13005.55, N = 314275431951330-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: Skeincoin

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: SkeincoinAVX-512 OffAVX-512 On70014002100280035002381.943137.56

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2895 / Avg: 3067.56 / Max: 3848Min: 2400 / Avg: 3002.44 / Max: 3696

Cpuminer-Opt

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 221.05 / Avg: 599.32 / Max: 665.19Min: 58.24 / Avg: 621.93 / Max: 720.06

Cpuminer-Opt

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 47 / Avg: 58.73 / Max: 61.75Min: 41.25 / Avg: 57.9 / Max: 62.75

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On200K400K600K800K1000KSE +/- 667.26, N = 3SE +/- 7645.47, N = 34917401066950-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -lcurl -lz -lpthread -lssl -lcrypto -lgmp

Cpuminer-Opt

Algorithm: LBC, LBRY Credits

OpenBenchmarking.orgkH/s Per Watt, More Is BetterCpuminer-Opt 3.20.3Algorithm: LBC, LBRY CreditsAVX-512 OffAVX-512 On400800120016002000802.761658.51

Cpuminer-Opt

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterCpuminer-Opt 3.20.3CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2729 / Avg: 2933 / Max: 4111Min: 2400 / Avg: 3059.52 / Max: 3703

Cpuminer-Opt

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterCpuminer-Opt 3.20.3CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 221.61 / Avg: 612.56 / Max: 683.83Min: 58.72 / Avg: 643.32 / Max: 743.31

Cpuminer-Opt

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterCpuminer-Opt 3.20.3CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 47 / Avg: 59.2 / Max: 62.25Min: 42.38 / Avg: 59.01 / Max: 63.5

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: mnasnetAVX-512 OffAVX-512 On1020304050SE +/- 0.49, N = 3SE +/- 0.26, N = 844.1942.30-mno-avx512f - MIN: 41.56 / MAX: 148.98-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 39.64 / MAX: 571.781. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: efficientnet-b0AVX-512 OffAVX-512 On1428425670SE +/- 0.31, N = 3SE +/- 0.35, N = 862.8657.71-mno-avx512f - MIN: 59.46 / MAX: 154.82-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 54.52 / MAX: 522.741. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: blazefaceAVX-512 OffAVX-512 On714212835SE +/- 0.54, N = 3SE +/- 0.18, N = 829.0025.88-mno-avx512f - MIN: 26.03 / MAX: 144.12-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 24.45 / MAX: 112.371. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: googlenetAVX-512 OffAVX-512 On20406080100SE +/- 1.35, N = 3SE +/- 0.76, N = 876.1372.80-mno-avx512f - MIN: 70.13 / MAX: 155.61-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 67.13 / MAX: 388.521. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: resnet50AVX-512 OffAVX-512 On1530456075SE +/- 0.89, N = 3SE +/- 0.50, N = 867.4866.34-mno-avx512f - MIN: 63.4 / MAX: 170.14-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 62.92 / MAX: 194.741. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: regnety_400mAVX-512 OffAVX-512 On60120180240300SE +/- 3.75, N = 3SE +/- 2.25, N = 8270.12247.32-mno-avx512f - MIN: 245.47 / MAX: 498.8-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 232.61 / MAX: 506.551. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: vision_transformerAVX-512 OffAVX-512 On20406080100SE +/- 5.82, N = 3SE +/- 1.59, N = 886.1674.93-mno-avx512f - MIN: 73.72 / MAX: 1760.74-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 65.04 / MAX: 2154.621. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20220729Target: CPU - Model: FastestDetAVX-512 OffAVX-512 On1428425670SE +/- 2.90, N = 3SE +/- 0.49, N = 860.7358.95-mno-avx512f - MIN: 52.89 / MAX: 236.85-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 55.11 / MAX: 282.721. (CXX) g++ options: -O3 -march=native -rdynamic -lgomp -lpthread

NCNN

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNCNN 20220729CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3563 / Avg: 3574.38 / Max: 3815Min: 2400 / Avg: 3565.67 / Max: 3699

NCNN

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNCNN 20220729CPU Power Consumption MonitorAVX-512 OffAVX-512 On80160240320400Min: 199.1 / Avg: 400.13 / Max: 450.41Min: 54.96 / Avg: 396.44 / Max: 451.5

NCNN

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNCNN 20220729CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 43 / Avg: 46.1 / Max: 50.13Min: 38.63 / Avg: 44.45 / Max: 48

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100SE +/- 0.01, N = 3SE +/- 0.07, N = 343.94102.04-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 0.51, N = 3SE +/- 0.24, N = 31088.50469.29-mno-avx512f - MIN: 937.5 / MAX: 1231.55-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 410.93 / MAX: 547.331. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2652 / Avg: 2906.37 / Max: 4086Min: 2400 / Avg: 3125.56 / Max: 3696

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 218.01 / Avg: 585.03 / Max: 645.46Min: 54.45 / Avg: 639.23 / Max: 725.02

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 41.25 / Avg: 56.19 / Max: 61.88Min: 35.88 / Avg: 57.35 / Max: 64.13

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On4080120160200SE +/- 0.02, N = 3SE +/- 0.05, N = 394.97193.93-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Face Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Face Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On110220330440550SE +/- 0.07, N = 3SE +/- 0.01, N = 3503.50246.98-mno-avx512f - MIN: 402.47 / MAX: 569.65-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 204.5 / MAX: 299.541. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2920 / Avg: 3080.75 / Max: 3713Min: 2400 / Avg: 3128.94 / Max: 3696

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 216.04 / Avg: 662.24 / Max: 732.8Min: 57.67 / Avg: 611.9 / Max: 687.37

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 47 / Avg: 62.45 / Max: 66.75Min: 43 / Avg: 58.13 / Max: 61.88

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On30K60K90K120K150KSE +/- 1130.85, N = 4SE +/- 1328.20, N = 3108449.49148967.98-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16 - Device: CPUAVX-512 OffAVX-512 On0.27230.54460.81691.08921.3615SE +/- 0.01, N = 4SE +/- 0.00, N = 31.210.55-mno-avx512f - MIN: 0.98 / MAX: 47.37-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.5 / MAX: 29.571. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2992 / Avg: 3193.41 / Max: 4056Min: 2400 / Avg: 3605.38 / Max: 3828

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On110220330440550Min: 219.11 / Avg: 592.38 / Max: 636.26Min: 48.01 / Avg: 565.59 / Max: 622.19

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 49.25 / Avg: 59.9 / Max: 62.63Min: 42.13 / Avg: 55.42 / Max: 59.5

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On40K80K120K160K200KSE +/- 1455.37, N = 3SE +/- 127.59, N = 3151239.60170652.71-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On0.12830.25660.38490.51320.6415SE +/- 0.00, N = 3SE +/- 0.00, N = 30.570.36-mno-avx512f - MIN: 0.52 / MAX: 47.93-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 0.34 / MAX: 33.71. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3476 / Avg: 3673.94 / Max: 3707Min: 2400 / Avg: 3630.12 / Max: 3754

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On110220330440550Min: 217.13 / Avg: 591.56 / Max: 630.28Min: 29.34 / Avg: 514.04 / Max: 564.42

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 48 / Avg: 59.22 / Max: 62.25Min: 41.75 / Avg: 52.16 / Max: 55.13

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On1020304050SE +/- 0.22, N = 3SE +/- 0.20, N = 325.5043.34-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP16 - Device: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 15.65, N = 3SE +/- 4.83, N = 31864.931100.25-mno-avx512f - MIN: 1371.29 / MAX: 2532.74-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 783.9 / MAX: 1824.921. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2709 / Avg: 3150.36 / Max: 3863Min: 2400 / Avg: 3479.89 / Max: 3726

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 114.29 / Avg: 578.59 / Max: 649.55Min: 55.98 / Avg: 604.54 / Max: 698.93

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 47 / Avg: 58.18 / Max: 67.63Min: 39.5 / Avg: 57.42 / Max: 65.88

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On1020304050SE +/- 0.04, N = 3SE +/- 0.18, N = 325.7443.34-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Detection FP32 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Detection FP32 - Device: CPUAVX-512 OffAVX-512 On400800120016002000SE +/- 3.32, N = 3SE +/- 4.44, N = 31845.951101.00-mno-avx512f - MIN: 1386.31 / MAX: 2798-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 840.82 / MAX: 1792.511. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2729 / Avg: 3100.27 / Max: 3993Min: 2400 / Avg: 3466.22 / Max: 3698

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 215.13 / Avg: 593.3 / Max: 665.28Min: 38.34 / Avg: 607.42 / Max: 699.55

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 46.13 / Avg: 58.74 / Max: 66.75Min: 42.13 / Avg: 57.96 / Max: 67.25

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On4K8K12K16K20KSE +/- 1.81, N = 3SE +/- 12.72, N = 39672.9419800.20-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 319.699.63-mno-avx512f - MIN: 16.4 / MAX: 74.85-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 8.29 / MAX: 57.531. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2930 / Avg: 3069.55 / Max: 3969Min: 2400 / Avg: 3037.41 / Max: 3696

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 215.97 / Avg: 683.89 / Max: 728.89Min: 56.51 / Avg: 639.18 / Max: 695.95

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 45.75 / Avg: 63 / Max: 67.13Min: 42.63 / Avg: 59.43 / Max: 62.75

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 4.29, N = 3SE +/- 6.96, N = 34110.499988.44-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Weld Porosity Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Weld Porosity Detection FP16 - Device: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.01, N = 3SE +/- 0.01, N = 311.664.79-mno-avx512f - MIN: 9.72 / MAX: 43.7-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.98 / MAX: 28.791. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2672 / Avg: 2848.15 / Max: 3946Min: 2400 / Avg: 3059.83 / Max: 3695

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 220.68 / Avg: 598.02 / Max: 638.66Min: 58.21 / Avg: 660.03 / Max: 712

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 49.75 / Avg: 60.05 / Max: 61.75Min: 43 / Avg: 60.88 / Max: 64.5

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 1.39, N = 3SE +/- 2.53, N = 36065.7611202.62-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16-INT8 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUAVX-512 OffAVX-512 On246810SE +/- 0.00, N = 3SE +/- 0.00, N = 37.904.28-mno-avx512f - MIN: 6.37 / MAX: 41.53-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 3.5 / MAX: 42.621. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2988 / Avg: 3068.36 / Max: 4270Min: 2400 / Avg: 3035.65 / Max: 3900

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 214.4 / Avg: 633.62 / Max: 676.37Min: 32.93 / Avg: 597.63 / Max: 645.71

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 48 / Avg: 61.14 / Max: 64Min: 44.38 / Avg: 57.87 / Max: 60.13

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On16003200480064008000SE +/- 10.17, N = 3SE +/- 3.52, N = 33782.087452.96-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Vehicle Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Vehicle Detection FP16 - Device: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.03, N = 3SE +/- 0.00, N = 312.676.43-mno-avx512f - MIN: 9.58 / MAX: 77.91-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 5.22 / MAX: 61.261. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2571 / Avg: 2729.54 / Max: 4230Min: 2400 / Avg: 2971.83 / Max: 3706

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 216.77 / Avg: 613.49 / Max: 654.6Min: 58.93 / Avg: 633.22 / Max: 689.9

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 48.88 / Avg: 59.95 / Max: 62.25Min: 42.13 / Avg: 58.98 / Max: 62.38

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 2.17, N = 3SE +/- 4.01, N = 35135.569065.34-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Person Vehicle Bike Detection FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUAVX-512 OffAVX-512 On3691215SE +/- 0.00, N = 3SE +/- 0.00, N = 39.335.29-mno-avx512f - MIN: 7.39 / MAX: 57.57-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 4.36 / MAX: 45.251. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2799 / Avg: 2942.46 / Max: 3941Min: 2400 / Avg: 3098.85 / Max: 3699

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 217.5 / Avg: 587.65 / Max: 640.01Min: 51.08 / Avg: 588.02 / Max: 657.48

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 46.63 / Avg: 57.97 / Max: 61.38Min: 43.75 / Avg: 56.8 / Max: 59.63

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On2004006008001000SE +/- 3.04, N = 3SE +/- 4.00, N = 3445.59956.88-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

Model: Machine Translation EN To DE FP16 - Device: CPU

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2022.2.devModel: Machine Translation EN To DE FP16 - Device: CPUAVX-512 OffAVX-512 On20406080100SE +/- 0.74, N = 3SE +/- 0.21, N = 3107.6250.11-mno-avx512f - MIN: 83.48 / MAX: 216.07-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi - MIN: 38.98 / MAX: 166.691. (CXX) g++ options: -fPIC -O3 -march=native -fsigned-char -ffunction-sections -fdata-sections -fno-strict-overflow -fwrapv -flto -shared

OpenVINO

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2022.2.devCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2592 / Avg: 2965.61 / Max: 3926Min: 2400 / Avg: 3256.35 / Max: 3707

OpenVINO

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenVINO 2022.2.devCPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 212.85 / Avg: 594.7 / Max: 647.79Min: 56.72 / Avg: 636.45 / Max: 700.56

OpenVINO

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2022.2.devCPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 46.13 / Avg: 56.29 / Max: 61.38Min: 42.63 / Avg: 58.43 / Max: 61.88

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2022.1Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OffAVX-512 On510152025SE +/- 0.10, N = 3SE +/- 0.24, N = 318.4718.76-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

GROMACS

Implementation: MPI CPU - Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day Per Watt, More Is BetterGROMACS 2022.1Implementation: MPI CPU - Input: water_GMX50_bareAVX-512 OffAVX-512 On0.00790.01580.02370.03160.03950.0330.035

GROMACS

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterGROMACS 2022.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2875 / Avg: 3357.72 / Max: 4145Min: 2400 / Avg: 3168.27 / Max: 3725

GROMACS

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterGROMACS 2022.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 215.54 / Avg: 552.82 / Max: 700.14Min: 58.48 / Avg: 534.88 / Max: 698.2

GROMACS

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterGROMACS 2022.1CPU Temperature MonitorAVX-512 OffAVX-512 On1326395265Min: 43 / Avg: 54.85 / Max: 64.5Min: 43.25 / Avg: 56.11 / Max: 62.63

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On60120180240300SE +/- 2.36, N = 12SE +/- 0.44, N = 3250271-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: fcn-resnet101-11 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On0.12330.24660.36990.49320.61650.4970.548

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3047 / Avg: 3611.53 / Max: 4291Min: 2400 / Avg: 3577.02 / Max: 3696

ONNX Runtime

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On90180270360450Min: 211.3 / Avg: 502.96 / Max: 528.22Min: 51.68 / Avg: 494.16 / Max: 531.99

ONNX Runtime

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.11CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 43 / Avg: 53.38 / Max: 59.25Min: 37.75 / Avg: 51.09 / Max: 57.5

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On16003200480064008000SE +/- 260.54, N = 12SE +/- 5.46, N = 362887401-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: super-resolution-10 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On71421283523.5728.54

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3693 / Avg: 3701.93 / Max: 4397Min: 2400 / Avg: 3664.92 / Max: 3710

ONNX Runtime

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On50100150200250Min: 132.49 / Avg: 266.8 / Max: 278.02Min: 53.19 / Avg: 259.31 / Max: 268.38

ONNX Runtime

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.11CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 39.5 / Avg: 43.19 / Max: 53Min: 36.38 / Avg: 39.9 / Max: 42.63

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On110220330440550SE +/- 3.11, N = 3SE +/- 1.86, N = 3499516-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: bertsquad-12 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On0.31340.62680.94021.25361.5671.3151.393

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3701.26 / Max: 3978Min: 2400 / Avg: 3663.27 / Max: 3709

ONNX Runtime

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 193.61 / Avg: 379.57 / Max: 388.9Min: 50.25 / Avg: 370.52 / Max: 385.52

ONNX Runtime

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.11CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 39 / Avg: 48.37 / Max: 52Min: 34.63 / Avg: 46.47 / Max: 48.88

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On2004006008001000SE +/- 20.83, N = 12SE +/- 39.92, N = 129181051-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Minute Per Watt, More Is BetterONNX Runtime 1.11Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardAVX-512 OffAVX-512 On0.53531.07061.60592.14122.67652.0512.379

ONNX Runtime

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterONNX Runtime 1.11CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3593 / Avg: 3607.6 / Max: 4285Min: 2400 / Avg: 3571.99 / Max: 3770

ONNX Runtime

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterONNX Runtime 1.11CPU Power Consumption MonitorAVX-512 OffAVX-512 On80160240320400Min: 107.66 / Avg: 447.6 / Max: 464.67Min: 51.25 / Avg: 441.77 / Max: 464.82

ONNX Runtime

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterONNX Runtime 1.11CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 38.13 / Avg: 50.46 / Max: 57.25Min: 32.75 / Avg: 48.03 / Max: 50.63

Numpy Benchmark

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 On120240360480600SE +/- 0.59, N = 3SE +/- 2.18, N = 3548.83575.66

Numpy Benchmark

OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkAVX-512 OffAVX-512 On0.60461.20921.81382.41843.0232.4742.687

Numpy Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3702.41 / Max: 4024Min: 2400 / Avg: 3672.75 / Max: 3705

Numpy Benchmark

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNumpy BenchmarkCPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 110.89 / Avg: 221.87 / Max: 228.08Min: 54.05 / Avg: 214.2 / Max: 222.92

Numpy Benchmark

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNumpy BenchmarkCPU Temperature MonitorAVX-512 OffAVX-512 On918273645Min: 36.38 / Avg: 37.86 / Max: 43.5Min: 32.75 / Avg: 36.34 / Max: 40.38

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On16003200480064008000SE +/- 26.42, N = 8SE +/- 5.79, N = 105065.107299.551. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On60120180240300SE +/- 1.06, N = 8SE +/- 0.23, N = 10202.60291.981. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM1

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM1AVX-512 OffAVX-512 On0.23420.46840.70260.93681.1710.4891.041

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3107 / Avg: 3505.27 / Max: 4044Min: 2400 / Avg: 2913.13 / Max: 3739

miniBUDE

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On110220330440550Min: 212.46 / Avg: 414.07 / Max: 630.17Min: 51.94 / Avg: 280.58 / Max: 624.43

miniBUDE

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 38.63 / Avg: 45.48 / Max: 52.38Min: 31.5 / Avg: 38.53 / Max: 47.38

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgGFInst/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On2K4K6K8K10KSE +/- 31.65, N = 3SE +/- 11.62, N = 46391.528652.011. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On80160240320400SE +/- 1.27, N = 3SE +/- 0.46, N = 4255.66346.081. (CC) gcc options: -std=c99 -Ofast -ffast-math -fopenmp -march=native -lm

miniBUDE

Implementation: OpenMP - Input Deck: BM2

OpenBenchmarking.orgBillion Interactions/s Per Watt, More Is BetterminiBUDE 20210901Implementation: OpenMP - Input Deck: BM2AVX-512 OffAVX-512 On0.15620.31240.46860.62480.7810.4530.694

miniBUDE

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterminiBUDE 20210901CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2905 / Avg: 3288.43 / Max: 3891Min: 2400 / Avg: 3201.47 / Max: 3697

miniBUDE

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterminiBUDE 20210901CPU Power Consumption MonitorAVX-512 OffAVX-512 On120240360480600Min: 210.84 / Avg: 564.45 / Max: 660.67Min: 53.72 / Avg: 498.76 / Max: 646.57

miniBUDE

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterminiBUDE 20210901CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 40.38 / Avg: 53.01 / Max: 60.13Min: 32.75 / Avg: 47.75 / Max: 56

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KAVX-512 OffAVX-512 On50100150200250SE +/- 4.01, N = 15SE +/- 4.74, N = 15239.88246.57

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 13 - Input: Bosphorus 4KAVX-512 OffAVX-512 On0.34040.68081.02121.36161.7020.9861.513

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3694 / Avg: 3728.48 / Max: 4349Min: 2400 / Avg: 3201.53 / Max: 3756

SVT-AV1

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 1.4CPU Power Consumption MonitorAVX-512 OffAVX-512 On60120180240300Min: 108.8 / Avg: 243.27 / Max: 324.99Min: 52.74 / Avg: 162.93 / Max: 323.11

SVT-AV1

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 1.4CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 39 / Avg: 42.38 / Max: 49.25Min: 32.38 / Avg: 36.81 / Max: 49.25

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KAVX-512 OffAVX-512 On50100150200250SE +/- 3.57, N = 15SE +/- 4.78, N = 15233.94245.56

SVT-AV1

Encoder Mode: Preset 12 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.4Encoder Mode: Preset 12 - Input: Bosphorus 4KAVX-512 OffAVX-512 On0.3150.630.9451.261.5750.9681.400

SVT-AV1

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterSVT-AV1 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3718.3 / Max: 3985Min: 2400 / Avg: 3273.8 / Max: 3770

SVT-AV1

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterSVT-AV1 1.4CPU Power Consumption MonitorAVX-512 OffAVX-512 On60120180240300Min: 127.05 / Avg: 241.76 / Max: 338.86Min: 52.74 / Avg: 175.42 / Max: 338.09

SVT-AV1

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterSVT-AV1 1.4CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 37.75 / Avg: 40.55 / Max: 48.13Min: 30.63 / Avg: 34.59 / Max: 43

Numenta Anomaly Benchmark

Detector: Bayesian Changepoint

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Bayesian ChangepointAVX-512 OffAVX-512 On48121620SE +/- 0.19, N = 5SE +/- 0.21, N = 417.3916.68

Numenta Anomaly Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNumenta Anomaly Benchmark 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3707.41 / Max: 4079Min: 2400 / Avg: 3531.9 / Max: 3699

Numenta Anomaly Benchmark

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 137.14 / Avg: 251.15 / Max: 391.04Min: 55.08 / Avg: 215.98 / Max: 378.79

Numenta Anomaly Benchmark

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 38.63 / Avg: 43.18 / Max: 49.88Min: 32.38 / Avg: 40.39 / Max: 50.13

Numenta Anomaly Benchmark

Detector: Windowed Gaussian

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Windowed GaussianAVX-512 OffAVX-512 On1.09852.1973.29554.3945.4925SE +/- 0.044, N = 7SE +/- 0.032, N = 154.8824.727

Numenta Anomaly Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNumenta Anomaly Benchmark 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3718.16 / Max: 3948Min: 2400 / Avg: 3236.71 / Max: 3715

Numenta Anomaly Benchmark

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 212.48 / Avg: 259.24 / Max: 394.18Min: 53.32 / Avg: 184.72 / Max: 388.11

Numenta Anomaly Benchmark

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 37.75 / Avg: 42.8 / Max: 60.38Min: 32.38 / Avg: 39.19 / Max: 53.25

Numenta Anomaly Benchmark

Detector: Relative Entropy

OpenBenchmarking.orgSeconds, Fewer Is BetterNumenta Anomaly Benchmark 1.1Detector: Relative EntropyAVX-512 OffAVX-512 On3691215SE +/- 0.082, N = 5SE +/- 0.089, N = 510.0359.898

Numenta Anomaly Benchmark

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterNumenta Anomaly Benchmark 1.1CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3701.99 / Max: 3768Min: 2400 / Avg: 3436.84 / Max: 3911

Numenta Anomaly Benchmark

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 213.18 / Avg: 250.83 / Max: 339.15Min: 53.55 / Avg: 202.81 / Max: 367.18

Numenta Anomaly Benchmark

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterNumenta Anomaly Benchmark 1.1CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 37.75 / Avg: 41.49 / Max: 50.38Min: 31.5 / Avg: 38.84 / Max: 47

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.78981.57962.36943.15923.949SE +/- 0.03, N = 5SE +/- 0.01, N = 53.503.51

Intel Open Image Denoise

Run: RT.hdr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.hdr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.00270.00540.00810.01080.01350.0100.012

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2718 / Avg: 3625.91 / Max: 4090Min: 2400 / Avg: 3124.26 / Max: 3699

Intel Open Image Denoise

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 206.45 / Avg: 366.67 / Max: 574.87Min: 48.84 / Avg: 287.61 / Max: 572.88

Intel Open Image Denoise

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36.75 / Avg: 41.62 / Max: 47Min: 32.38 / Avg: 38.13 / Max: 44.88

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.ldr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.78981.57962.36943.15923.949SE +/- 0.01, N = 5SE +/- 0.01, N = 53.513.51

Intel Open Image Denoise

Run: RT.ldr_alb_nrm.3840x2160

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RT.ldr_alb_nrm.3840x2160AVX-512 OffAVX-512 On0.00270.00540.00810.01080.01350.0100.012

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2854 / Avg: 3609.95 / Max: 3919Min: 2400 / Avg: 3211.97 / Max: 3702

Intel Open Image Denoise

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 208.65 / Avg: 365.55 / Max: 577.25Min: 52.09 / Avg: 288.65 / Max: 574.25

Intel Open Image Denoise

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 39.5 / Avg: 43.31 / Max: 48.38Min: 32.75 / Avg: 38.19 / Max: 44.13

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

OpenBenchmarking.orgImages / Sec, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.3870.7741.1611.5481.935SE +/- 0.01, N = 3SE +/- 0.01, N = 31.721.66

Intel Open Image Denoise

Run: RTLightmap.hdr.4096x4096

OpenBenchmarking.orgImages / Sec Per Watt, More Is BetterIntel Open Image Denoise 1.4.0Run: RTLightmap.hdr.4096x4096AVX-512 OffAVX-512 On0.00110.00220.00330.00440.00550.0040.005

Intel Open Image Denoise

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterIntel Open Image Denoise 1.4.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3017 / Avg: 3636.42 / Max: 4215Min: 2400 / Avg: 3215.57 / Max: 3699

Intel Open Image Denoise

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On100200300400500Min: 207.23 / Avg: 398.95 / Max: 572.57Min: 52.84 / Avg: 325.63 / Max: 573.97

Intel Open Image Denoise

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterIntel Open Image Denoise 1.4.0CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 39.88 / Avg: 44.73 / Max: 49.75Min: 32.75 / Avg: 39.78 / Max: 46.38

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: NDT Mapping

OpenBenchmarking.orgTest Cases Per Minute, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteBackend: OpenMP - Kernel: NDT MappingAVX-512 OffAVX-512 On30060090012001500SE +/- 8.66, N = 3SE +/- 5.94, N = 31335.631371.181. (CXX) g++ options: -O3 -std=c++11 -fopenmp

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: NDT Mapping

OpenBenchmarking.orgTest Cases Per Minute Per Watt, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteBackend: OpenMP - Kernel: NDT MappingAVX-512 OffAVX-512 On2468105.4556.416

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3694 / Avg: 3718.89 / Max: 4426Min: 2400 / Avg: 3515.77 / Max: 3702

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Power Consumption MonitorAVX-512 OffAVX-512 On50100150200250Min: 214.99 / Avg: 244.83 / Max: 282.74Min: 37.77 / Avg: 213.7 / Max: 282.17

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 37.75 / Avg: 39.41 / Max: 49.5Min: 32.38 / Avg: 35.45 / Max: 36.38

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: Points2Image

OpenBenchmarking.orgTest Cases Per Minute, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteBackend: OpenMP - Kernel: Points2ImageAVX-512 OffAVX-512 On3K6K9K12K15KSE +/- 269.82, N = 15SE +/- 126.17, N = 1511521.3813677.761. (CXX) g++ options: -O3 -std=c++11 -fopenmp

Darmstadt Automotive Parallel Heterogeneous Suite

Backend: OpenMP - Kernel: Points2Image

OpenBenchmarking.orgTest Cases Per Minute Per Watt, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteBackend: OpenMP - Kernel: Points2ImageAVX-512 OffAVX-512 On122436486042.1952.82

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3694 / Avg: 3698.64 / Max: 4768Min: 2400 / Avg: 3647.5 / Max: 3715

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Power Consumption MonitorAVX-512 OffAVX-512 On50100150200250Min: 136.19 / Avg: 273.1 / Max: 289.31Min: 49.36 / Avg: 258.94 / Max: 283.12

Darmstadt Automotive Parallel Heterogeneous Suite

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterDarmstadt Automotive Parallel Heterogeneous SuiteCPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36.75 / Avg: 39.2 / Max: 49.75Min: 31.25 / Avg: 38.03 / Max: 47.5

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.04, N = 35.146.70-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: PartialTweetsAVX-512 OffAVX-512 On0.00720.01440.02160.02880.0360.0230.032

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3701.7 / Max: 4016Min: 2400 / Avg: 3638.64 / Max: 3702

simdjson

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 113.69 / Avg: 224.4 / Max: 230.24Min: 50.22 / Avg: 211.42 / Max: 225.12

simdjson

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature MonitorAVX-512 OffAVX-512 On1224364860Min: 39 / Avg: 51.01 / Max: 60.13Min: 36.38 / Avg: 40.49 / Max: 47.5

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: LargeRandomAVX-512 OffAVX-512 On0.28350.5670.85051.1341.4175SE +/- 0.00, N = 3SE +/- 0.00, N = 31.041.26-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: LargeRandomAVX-512 OffAVX-512 On0.00140.00280.00420.00560.0070.0050.006

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3700.69 / Max: 3788Min: 2400 / Avg: 3601.15 / Max: 3700

simdjson

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 111.57 / Avg: 222.49 / Max: 224.61Min: 53.79 / Avg: 207.04 / Max: 220.81

simdjson

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 37.75 / Avg: 47.04 / Max: 49.75Min: 33.25 / Avg: 36.74 / Max: 37.75

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: KostyaAVX-512 OffAVX-512 On0.94051.8812.82153.7624.7025SE +/- 0.00, N = 3SE +/- 0.02, N = 33.394.18-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: KostyaAVX-512 OffAVX-512 On0.00450.0090.01350.0180.02250.0150.020

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3704.16 / Max: 3981Min: 2400 / Avg: 3624.51 / Max: 3702

simdjson

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 112.46 / Avg: 223.52 / Max: 225.74Min: 54.43 / Avg: 209.87 / Max: 221.62

simdjson

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 37.25 / Avg: 46.25 / Max: 48.63Min: 33.25 / Avg: 36.37 / Max: 37.25

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.02, N = 35.256.86-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: DistinctUserIDAVX-512 OffAVX-512 On0.00740.01480.02220.02960.0370.0240.033

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3703.47 / Max: 3925Min: 2400 / Avg: 3643.23 / Max: 3754

simdjson

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 111.32 / Avg: 221.17 / Max: 223.73Min: 35.76 / Avg: 209 / Max: 219.12

simdjson

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 37.25 / Avg: 46.91 / Max: 48.13Min: 32.38 / Avg: 36.17 / Max: 37.25

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 2.0Throughput Test: TopTweetAVX-512 OffAVX-512 On246810SE +/- 0.01, N = 3SE +/- 0.08, N = 45.386.52-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s Per Watt, More Is Bettersimdjson 2.0Throughput Test: TopTweetAVX-512 OffAVX-512 On0.0070.0140.0210.0280.0350.0240.031

simdjson

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is Bettersimdjson 2.0CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3694 / Avg: 3701.26 / Max: 3912Min: 2400 / Avg: 3639.96 / Max: 3701

simdjson

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is Bettersimdjson 2.0CPU Power Consumption MonitorAVX-512 OffAVX-512 On4080120160200Min: 111.18 / Avg: 221.48 / Max: 223.37Min: 55.3 / Avg: 209.43 / Max: 219.15

simdjson

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is Bettersimdjson 2.0CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36.75 / Avg: 46.19 / Max: 47.5Min: 32.38 / Avg: 36.07 / Max: 37.25

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Mesh Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeAVX-512 OffAVX-512 On306090120150144.35135.771. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

Input: drivaerFastback, Medium Mesh Size - Execution Time

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeAVX-512 OffAVX-512 On306090120150135.22113.641. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm

OpenFOAM

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On6001200180024003000Min: 2917 / Avg: 3265.15 / Max: 3714Min: 2400 / Avg: 3185.68 / Max: 3701

OpenFOAM

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterOpenFOAM 10CPU Power Consumption MonitorAVX-512 OffAVX-512 On130260390520650Min: 220.4 / Avg: 673.86 / Max: 735.32Min: 56.79 / Avg: 662.16 / Max: 730.56

OpenFOAM

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorAVX-512 OffAVX-512 On1428425670Min: 47 / Avg: 64.94 / Max: 70.25Min: 41.25 / Avg: 62.64 / Max: 68.5

CP2K Molecular Dynamics

Input: Fayalite-FIST

OpenBenchmarking.orgSeconds, Fewer Is BetterCP2K Molecular Dynamics 8.2Input: Fayalite-FISTAVX-512 OffAVX-512 On300600900120015001198.411122.73

CP2K Molecular Dynamics

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterCP2K Molecular Dynamics 8.2CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3569 / Avg: 3664.87 / Max: 3808Min: 2400 / Avg: 3660.54 / Max: 3700

CP2K Molecular Dynamics

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterCP2K Molecular Dynamics 8.2CPU Power Consumption MonitorAVX-512 OffAVX-512 On70140210280350Min: 118.26 / Avg: 361.54 / Max: 403.02Min: 58.11 / Avg: 357.99 / Max: 402.57

CP2K Molecular Dynamics

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterCP2K Molecular Dynamics 8.2CPU Temperature MonitorAVX-512 OffAVX-512 On1122334455Min: 42.13 / Avg: 44.37 / Max: 56.88Min: 42.13 / Avg: 44.52 / Max: 53.5

SMHasher

Hash: FarmHash32 x86_64 AVX

OpenBenchmarking.orgMiB/sec, More Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On9K18K27K36K45KSE +/- 28.78, N = 5SE +/- 0.46, N = 536483.7039794.44-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects

SMHasher

Hash: FarmHash32 x86_64 AVX

OpenBenchmarking.orgcycles/hash, Fewer Is BetterSMHasher 2022-08-22Hash: FarmHash32 x86_64 AVXAVX-512 OffAVX-512 On612182430SE +/- 0.00, N = 5SE +/- 0.00, N = 526.4126.39-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -flto=auto -fno-fat-lto-objects

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90AVX-512 OffAVX-512 On3691215SE +/- 0.03, N = 3SE +/- 0.04, N = 39.139.55-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 90

OpenBenchmarking.orgMP/s Per Watt, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 90AVX-512 OffAVX-512 On0.00970.01940.02910.03880.04850.0390.043

JPEG XL libjxl

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterJPEG XL libjxl 0.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 3669 / Avg: 3701.38 / Max: 3814Min: 2400 / Avg: 3657.01 / Max: 3712

JPEG XL libjxl

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterJPEG XL libjxl 0.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On60120180240300Min: 142.58 / Avg: 233.92 / Max: 323.33Min: 54.77 / Avg: 223.4 / Max: 308.08

JPEG XL libjxl

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterJPEG XL libjxl 0.7CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 36.75 / Avg: 39.36 / Max: 48.88Min: 35 / Avg: 39.72 / Max: 46.63

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100AVX-512 OffAVX-512 On0.16650.3330.49950.6660.8325SE +/- 0.01, N = 9SE +/- 0.01, N = 90.720.74-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: JPEG - Quality: 100

OpenBenchmarking.orgMP/s Per Watt, More Is BetterJPEG XL libjxl 0.7Input: JPEG - Quality: 100AVX-512 OffAVX-512 On0.00070.00140.00210.00280.00350.0030.003

JPEG XL libjxl

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterJPEG XL libjxl 0.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On8001600240032004000Min: 3414 / Avg: 3701.38 / Max: 4381Min: 2400 / Avg: 3682.16 / Max: 4023

JPEG XL libjxl

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterJPEG XL libjxl 0.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On50100150200250Min: 110.34 / Avg: 222.62 / Max: 261.2Min: 28.84 / Avg: 217.33 / Max: 256.47

JPEG XL libjxl

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterJPEG XL libjxl 0.7CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 35.5 / Avg: 36.56 / Max: 46.63Min: 32.75 / Avg: 36.48 / Max: 49.75

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90AVX-512 OffAVX-512 On3691215SE +/- 0.02, N = 3SE +/- 0.02, N = 39.529.95-mno-avx512f-mavx512f -mavx512cd -mavx512vl -mavx512bw -mavx512dq -mavx512ifma -mavx512vbmi1. (CXX) g++ options: -O3 -march=native -fno-rtti -funwind-tables -O2 -fPIE -pie -lm -latomic

JPEG XL libjxl

Input: PNG - Quality: 90

OpenBenchmarking.orgMP/s Per Watt, More Is BetterJPEG XL libjxl 0.7Input: PNG - Quality: 90AVX-512 OffAVX-512 On0.01010.02020.03030.04040.05050.0410.045

JPEG XL libjxl

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertz, More Is BetterJPEG XL libjxl 0.7CPU Peak Freq (Highest CPU Core Frequency) MonitorAVX-512 OffAVX-512 On7001400210028003500Min: 2439 / Avg: 3696.21 / Max: 3828Min: 2400 / Avg: 3643.34 / Max: 3712

JPEG XL libjxl

CPU Power Consumption Monitor

OpenBenchmarking.orgWatts, Fewer Is BetterJPEG XL libjxl 0.7CPU Power Consumption MonitorAVX-512 OffAVX-512 On60120180240300Min: 133.98 / Avg: 232.37 / Max: 317.15Min: 56.13 / Avg: 222.23 / Max: 318.22

JPEG XL libjxl

CPU Temperature Monitor

OpenBenchmarking.orgCelsius, Fewer Is BetterJPEG XL libjxl 0.7CPU Temperature MonitorAVX-512 OffAVX-512 On1020304050Min: 35.88 / Avg: 36.75 / Max: 44.88Min: 32.38 / Avg: 36.96 / Max: 49.25

CPU Power Consumption Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On130260390520650Min: 106.95 / Avg: 449.58 / Max: 735.32Min: 26.37 / Avg: 434.8 / Max: 766.01

CPU Temperature Monitor

Phoronix Test Suite System Monitoring

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringAVX-512 OffAVX-512 On1428425670Min: 35.5 / Avg: 51.26 / Max: 73.75Min: 30.13 / Avg: 49.97 / Max: 73.38

Geometric Mean Of All Test Results

Result Composite - AMD EPYC 4th Gen AVX-512 Comparison

OpenBenchmarking.orgGeometric Mean, More Is BetterGeometric Mean Of All Test ResultsResult Composite - AMD EPYC 4th Gen AVX-512 ComparisonAVX-512 OffAVX-512 On61218243017.5623.56


Phoronix Test Suite v10.8.4