icelake march

Intel Core i7-1065G7 testing with a Dell 06CDVY (1.0.9 BIOS) and Intel Iris Plus ICL GT2 16GB on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2403273-NE-ICELAKEMA80
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Timed Code Compilation 2 Tests
C/C++ Compiler Tests 2 Tests
CPU Massive 9 Tests
Creator Workloads 9 Tests
Encoding 2 Tests
Game Development 2 Tests
HPC - High Performance Computing 4 Tests
Imaging 2 Tests
Machine Learning 4 Tests
Multi-Core 10 Tests
NVIDIA GPU Compute 2 Tests
Intel oneAPI 2 Tests
Programmer / Developer System Benchmarks 2 Tests
Python Tests 4 Tests
Renderers 2 Tests
Server CPU Tests 5 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
March 26
  4 Hours, 59 Minutes
b
March 27
  4 Hours, 48 Minutes
Invert Hiding All Results Option
  4 Hours, 54 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

a

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xc2 - Thermald 2.5.4
Python Notes: Python 3.11.6
Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Mitigation of Microcode + tsx_async_abort: Not affected

b

Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB + 2 x 0GB MassStorageClass, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi

OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc5-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0~git2312230600.551924~oibaf~m (git-551924a 2023-12-23 mantic-oibaf-ppa), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

icelake marchOpenBenchmarking.orgPhoronix Test SuiteIntel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads)Dell 06CDVY (1.0.9 BIOS)Intel Ice Lake-LP DRAM16GBToshiba KBG40ZPZ512G NVMe 512GB + 2 x 0GB MassStorageClassIntel Iris Plus ICL GT2 16GB (1100MHz)Realtek ALC289Intel Ice Lake-LP PCH CNVi WiFiUbuntu 23.106.7.0-060700rc5-generic (x86_64)GNOME Shell 45.1X Server + Wayland4.6 Mesa 24.0~git2312230600.551924~oibaf~m (git-551924a 2023-12-23 mantic-oibaf-ppa)GCC 13.2.0ext41920x1200ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelDesktopDisplay ServerOpenGLCompilerFile-SystemScreen ResolutionIcelake March BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xc2 - Thermald 2.5.4- Python 3.11.6- gather_data_sampling: Mitigation of Microcode + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Mitigation of Microcode + tsx_async_abort: Not affected

a vs. b ComparisonPhoronix Test SuiteBaseline+8.4%+8.4%+16.8%+16.8%+25.2%+25.2%33.5%22.3%15.7%15.1%15.1%12.7%11.1%10.9%10.3%9.8%9.8%9.4%9.2%9.1%9.1%9%8.9%8.7%8.4%8.4%8.4%8.4%8.2%8.2%8.1%8.1%7.8%7.6%7.5%7.4%7.3%7.3%7.2%7.1%7%6.9%6.9%6.9%6.8%6.8%6.6%6.6%6.5%6.5%6.5%6.3%6.3%6.3%6.3%6.2%6.2%6.2%6.2%6.1%6.1%6%6%5.8%5.7%5.6%5.5%5.3%5.3%5.3%5.2%5.2%5.1%5%5%4.9%4.8%4.8%4.7%4.5%4.5%4.4%4.2%4.1%4%3.9%3.9%3.8%3.7%3.6%3.5%3.5%3.2%2.9%2.6%2.3%PNG - 80CPU - 1 - ResNet-15230.4%CPU - 1 - ResNet-5025.5%WAV To WavPackSeq FillR.S.A.F.I - CPUR.S.A.F.I - CPUCPU - 1 - ResNet-50OverwriteD.B.s - CPUCPUP.V.B.D.F - CPUP.V.B.D.F - CPUP.D.F - CPUP.D.F - CPUH.E.R.F.I - CPUH.E.R.F.I - CPUPNG - 90CPU - 16 - GoogLeNetPreset 8 - Bosphorus 1080pF.D.R.F - CPURead While WritingRand ReadF.D.R.F - CPUF.D.R.F.I - CPUF.D.R.F.I - CPUM.T.E.T.D.F - CPUM.T.E.T.D.F - CPUJPEG - 90JPEG - 80C.B.S.A - CPUCPU - 32 - AlexNetW.P.D.F.I - CPUW.P.D.F.I - CPUCPU - 64 - AlexNetCPU - 32 - GoogLeNetCPU - 16 - ResNet-50Update RandP.R.I.R.F - CPUP.R.I.R.F - CPUCPU - 1 - Efficientnet_v2_lA.G.R.R.0.F.I - CPUChess BenchmarkH.E.R.F - CPUR.N.N.T - CPUH.E.R.F - CPUA.G.R.R.0.F - CPUF.D.F - CPUF.D.F - CPUA.G.R.R.0.F - CPUW.P.D.F - CPUN.S.P.L.F - CPUCPU - 64 - GoogLeNetA.G.R.R.0.F.I - CPUW.P.D.F - CPUN.S.P.L.F - CPUCPU - 64 - ResNet-50BMW27 - CPU-OnlyCPU - 16 - AlexNetCPU - 32 - ResNet-50PNG - 100AllPabellon Barcelona - CPU-OnlyCPU - 32 - ResNet-152Rand FillCPU - 16 - Efficientnet_v2_lP.D.F - CPUFishy Cat - CPU-OnlyP.D.F - CPUCPU - 64 - ResNet-152JPEG - 100CPU - 1 - GoogLeNetV.D.F - CPUV.D.F - CPU1e12Preset 4 - Bosphorus 1080pCPU - 32 - Efficientnet_v2_lCPU - 64 - Efficientnet_v2_lF.D.F.I - CPUCPU - 16 - ResNet-152Preset 13 - Bosphorus 4KV.D.F.I - CPUV.D.F.I - CPUF.D.F.I - CPUIP Shapes 1D - CPUR.R.W.RR.S.A.F - CPUR.S.A.F - CPUJunkshop - CPU-OnlyCPU - 16 - ResNet-503%CPU - 1 - AlexNetPreset 4 - Bosphorus 4KCPU - 64 - ResNet-50Rand Fill Sync2.1%JPEG-XL libjxlPyTorchPyTorchWavPack Audio EncodingRocksDBOpenVINOOpenVINOTensorFlowRocksDBoneDNNChaos Group V-RAYOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOJPEG-XL libjxlTensorFlowSVT-AV1OpenVINORocksDBRocksDBOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOJPEG-XL libjxlJPEG-XL libjxloneDNNTensorFlowOpenVINOOpenVINOTensorFlowTensorFlowTensorFlowRocksDBOpenVINOOpenVINOPyTorchOpenVINOStockfishOpenVINOoneDNNOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOTensorFlowOpenVINOOpenVINOOpenVINOTensorFlowBlenderTensorFlowTensorFlowJPEG-XL libjxlJPEG-XL Decoding libjxlBlenderPyTorchRocksDBPyTorchOpenVINOBlenderOpenVINOPyTorchJPEG-XL libjxlTensorFlowOpenVINOOpenVINOPrimesieveSVT-AV1PyTorchPyTorchOpenVINOPyTorchSVT-AV1OpenVINOOpenVINOOpenVINOoneDNNRocksDBOpenVINOOpenVINOBlenderPyTorchTensorFlowSVT-AV1PyTorchRocksDBab

icelake marchjpegxl: PNG - 80pytorch: CPU - 1 - ResNet-152pytorch: CPU - 1 - ResNet-50encode-wavpack: WAV To WavPackrocksdb: Seq Fillopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUtensorflow: CPU - 1 - ResNet-50rocksdb: Overwriteonednn: Deconvolution Batch shapes_1d - CPUv-ray: CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUjpegxl: PNG - 90tensorflow: CPU - 16 - GoogLeNetsvt-av1: Preset 8 - Bosphorus 1080popenvino: Face Detection Retail FP16 - CPUrocksdb: Read While Writingrocksdb: Rand Readopenvino: Face Detection Retail FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUjpegxl: JPEG - 90jpegxl: JPEG - 80onednn: Convolution Batch Shapes Auto - CPUtensorflow: CPU - 32 - AlexNetopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUtensorflow: CPU - 64 - AlexNettensorflow: CPU - 32 - GoogLeNettensorflow: CPU - 16 - ResNet-50rocksdb: Update Randopenvino: Person Re-Identification Retail FP16 - CPUopenvino: Person Re-Identification Retail FP16 - CPUpytorch: CPU - 1 - Efficientnet_v2_lopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUstockfish: Chess Benchmarkopenvino: Handwritten English Recognition FP16 - CPUonednn: Recurrent Neural Network Training - CPUopenvino: Handwritten English Recognition FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Face Detection FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUtensorflow: CPU - 64 - GoogLeNetopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16 - CPUopenvino: Noise Suppression Poconet-Like FP16 - CPUtensorflow: CPU - 64 - ResNet-50blender: BMW27 - CPU-Onlytensorflow: CPU - 16 - AlexNettensorflow: CPU - 32 - ResNet-50jpegxl: PNG - 100jpegxl-decode: Allblender: Pabellon Barcelona - CPU-Onlypytorch: CPU - 32 - ResNet-152rocksdb: Rand Fillpytorch: CPU - 16 - Efficientnet_v2_lopenvino: Person Detection FP32 - CPUblender: Fishy Cat - CPU-Onlyopenvino: Person Detection FP32 - CPUpytorch: CPU - 64 - ResNet-152jpegxl: JPEG - 100tensorflow: CPU - 1 - GoogLeNetopenvino: Vehicle Detection FP16 - CPUopenvino: Vehicle Detection FP16 - CPUprimesieve: 1e12svt-av1: Preset 4 - Bosphorus 1080ppytorch: CPU - 32 - Efficientnet_v2_lpytorch: CPU - 64 - Efficientnet_v2_lopenvino: Face Detection FP16-INT8 - CPUpytorch: CPU - 16 - ResNet-152svt-av1: Preset 13 - Bosphorus 4Kopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUonednn: IP Shapes 1D - CPUrocksdb: Read Rand Write Randopenvino: Road Segmentation ADAS FP16 - CPUopenvino: Road Segmentation ADAS FP16 - CPUblender: Junkshop - CPU-Onlypytorch: CPU - 16 - ResNet-50tensorflow: CPU - 1 - AlexNetsvt-av1: Preset 4 - Bosphorus 4Kpytorch: CPU - 64 - ResNet-50rocksdb: Rand Fill Synccompress-pbzip2: FreeBSD-13.0-RELEASE-amd64-memstick.img Compressiondraco: Lionsvt-av1: Preset 12 - Bosphorus 4Konednn: Recurrent Neural Network Inference - CPUjpegxl-decode: 1svt-av1: Preset 13 - Bosphorus 1080pdraco: Church Facadeonednn: IP Shapes 3D - CPUsvt-av1: Preset 12 - Bosphorus 1080pbuild-mesa: Time To Compileonednn: Deconvolution Batch shapes_3d - CPUsvt-av1: Preset 8 - Bosphorus 4Kbuild-linux-kernel: defconfigpytorch: CPU - 32 - ResNet-50ab8.2788.4520.9917.65781333547.3684.345.3548711618.832353543.990.927.26548.8536.88108.377.54319.6928.8523.865002109192128167.0310.38383.05460.938.667.6628.04813.710642.9316.82236.7145.5920.097.2818633498.2540.644.434463.622762544123.0712553.332.471779.080.636365.092.263.7734.2620.370.8662.62116.527.5671.939.047.442.997123.5122207.353.375054332.467.1848.45562.293.392.98122.1777.4751.5988.5923.6432.472.482.373.4525.118132.930.021675.087.0803750409126.34151.61921.098.9211.230.9288.54171928.581235555924.9026399.7357.584240.4684215.80745184.734143.67413.45447.551496.168.6911.0536.4816.7214.43294071154.5373.266.0354116116.9829389939.9799.857.94502.5540.2399.378.22221.4431.37322.0154215399615271819.59414.42426.39.368.2568.66212.75546.115.67253.9748.8621.527.79199263105.0338.024.734765.042945032115.511783.634.591894.370.675987.532.0767.7632.2621.630.8158.98123.677.96633.7241.387.873.169130.4432092.753.555321972.597.47806.43535.13.563.1323.2673.9154.0684.5833.8062.582.592.473.5926.134138.1128.891614.496.8263952214527.27146.48892.478.6611.560.9528.74168328.096278549124.6246341.958.041238.62683615.83135184.085143.24913.48857.569497.1818.68OpenBenchmarking.org

JPEG-XL libjxl

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 80ab36912158.27811.0531. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-152ab2468108.456.48MIN: 7.21 / MAX: 8.75MIN: 5.29 / MAX: 8.11

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: ResNet-50ab51015202520.9916.72MIN: 18.42 / MAX: 21.52MIN: 14.31 / MAX: 22.33

WavPack Audio Encoding

OpenBenchmarking.orgSeconds, Fewer Is BetterWavPack Audio Encoding 5.7WAV To WavPackab4812162017.6614.43

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Sequential Fillab200K400K600K800K1000K8133359407111. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUab122436486047.3654.531. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16-INT8 - Device: CPUab2040608010084.3473.26MIN: 42.98 / MAX: 112.29MIN: 42.21 / MAX: 97.491. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: ResNet-50ab2468105.356.03

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Overwriteab120K240K360K480K600K4871165411611. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_1d - Engine: CPUab51015202518.8316.98MIN: 16.9MIN: 15.811. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

Chaos Group V-RAY

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 6.0Mode: CPUab800160024003200400035353899

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUab102030405043.9039.97MIN: 22.03 / MAX: 69.03MIN: 22.42 / MAX: 60.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Vehicle Bike Detection FP16 - Device: CPUab2040608010090.9299.851. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUab2468107.267.941. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP16 - Device: CPUab120240360480600548.85502.55MIN: 316.87 / MAX: 622.99MIN: 251.66 / MAX: 603.51. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUab91827364536.8840.231. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16-INT8 - Device: CPUab20406080100108.3799.37MIN: 51.18 / MAX: 147.77MIN: 52.55 / MAX: 136.551. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

JPEG-XL libjxl

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 90ab2468107.5438.2221. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: GoogLeNetab51015202519.6921.44

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 1080pab71421283528.8531.371. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUab61218243023.8622.01MIN: 9.57 / MAX: 41.51MIN: 8.86 / MAX: 45.481. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While Writingab120K240K360K480K600K5002105421531. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random Readab2M4M6M8M10M919212899615271. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16 - Device: CPUab4080120160200167.03181.001. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUab369121510.389.59MIN: 4.12 / MAX: 24.58MIN: 4.46 / MAX: 25.461. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection Retail FP16-INT8 - Device: CPUab90180270360450383.05414.421. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUab100200300400500460.93426.30MIN: 257.76 / MAX: 516.23MIN: 266.17 / MAX: 497.451. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Machine Translation EN To DE FP16 - Device: CPUab36912158.669.361. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

JPEG-XL libjxl

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 90ab2468107.6628.2561. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 80ab2468108.0488.6621. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Convolution Batch Shapes Auto - Engine: CPUab4812162013.7112.76MIN: 11.94MIN: 12.131. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: AlexNetab102030405042.9346.10

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUab4812162016.8215.67MIN: 6.35 / MAX: 33.7MIN: 7.56 / MAX: 33.571. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16-INT8 - Device: CPUab60120180240300236.71253.971. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: AlexNetab112233445545.5948.86

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: GoogLeNetab51015202520.0921.52

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: ResNet-50ab2468107.287.79

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Update Randomab40K80K120K160K200K1863341992631. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUab2040608010098.25105.031. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Re-Identification Retail FP16 - Device: CPUab91827364540.6438.02MIN: 16.78 / MAX: 58.65MIN: 18.33 / MAX: 61.621. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lab1.06432.12863.19294.25725.32154.434.73MIN: 3.92 / MAX: 6.05MIN: 4.29 / MAX: 6.39

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUab100020003000400050004463.624765.041. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Stockfish

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 16.1Chess Benchmarkab600K1200K1800K2400K3000K276254429450321. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUab306090120150123.07115.50MIN: 62.42 / MAX: 153.74MIN: 62.34 / MAX: 153.581. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Training - Engine: CPUab3K6K9K12K15K12553.311783.6MIN: 12419.5MIN: 11523.51. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Handwritten English Recognition FP16 - Device: CPUab81624324032.4734.591. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUab4008001200160020001779.081894.371. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUab0.15080.30160.45240.60320.7540.630.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16 - Device: CPUab140028004200560070006365.095987.53MIN: 4117.28 / MAX: 6821.88MIN: 3948.27 / MAX: 6469.321. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16 - Device: CPUab0.4950.991.4851.982.4752.202.07MIN: 0.81 / MAX: 10.39MIN: 0.81 / MAX: 21.751. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUab153045607563.7767.761. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUab81624324034.2632.26MIN: 16.36 / MAX: 51.61MIN: 17.41 / MAX: 59.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: GoogLeNetab51015202520.3721.63

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUab0.19350.3870.58050.7740.96750.860.81MIN: 0.32 / MAX: 7.11MIN: 0.31 / MAX: 7.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Weld Porosity Detection FP16 - Device: CPUab142842567062.6258.98MIN: 28.99 / MAX: 93.01MIN: 30.6 / MAX: 85.411. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Noise Suppression Poconet-Like FP16 - Device: CPUab306090120150116.52123.671. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 64 - Model: ResNet-50ab2468107.507.96

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: BMW27 - Compute: CPU-Onlyab140280420560700671.90633.72

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 16 - Model: AlexNetab91827364539.0441.38

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 32 - Model: ResNet-50ab2468107.447.87

JPEG-XL libjxl

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: PNG - Quality: 100ab0.7131.4262.1392.8523.5652.9973.1691. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

JPEG-XL Decoding libjxl

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL Decoding libjxl 0.10.1CPU Threads: Allab306090120150123.51130.44

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Pabellon Barcelona - Compute: CPU-Onlyab50010001500200025002207.352092.75

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 32 - Model: ResNet-152ab0.79881.59762.39643.19523.9943.373.55MIN: 3.09 / MAX: 4.17MIN: 3.29 / MAX: 4.15

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random Fillab110K220K330K440K550K5054335321971. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_lab0.58281.16561.74842.33122.9142.462.59MIN: 2.18 / MAX: 3.06MIN: 2.34 / MAX: 3.21

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPUab2468107.107.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Fishy Cat - Compute: CPU-Onlyab2004006008001000848.45806.43

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Person Detection FP32 - Device: CPUab120240360480600562.29535.10MIN: 328.73 / MAX: 643.55MIN: 331.64 / MAX: 616.91. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-152ab0.8011.6022.4033.2044.0053.393.56MIN: 3.22 / MAX: 4.18MIN: 3.3 / MAX: 4.19

JPEG-XL libjxl

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL libjxl 0.10.1Input: JPEG - Quality: 100ab0.70431.40862.11292.81723.52152.9813.1301. (CXX) g++ options: -fno-rtti -O3 -fPIE -pie -lm

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: GoogLeNetab61218243022.1723.26

OpenVINO

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUab2040608010077.4773.91MIN: 41.16 / MAX: 110.74MIN: 42.25 / MAX: 102.911. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16 - Device: CPUab122436486051.5954.061. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Primesieve

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.1Length: 1e12ab2040608010088.5984.581. (CXX) g++ options: -O3

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 1080pab0.85641.71282.56923.42564.2823.6433.8061. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_lab0.58051.1611.74152.3222.90252.472.58MIN: 2.3 / MAX: 3.1MIN: 2.18 / MAX: 3.27

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lab0.58281.16561.74842.33122.9142.482.59MIN: 2.21 / MAX: 3.02MIN: 2.29 / MAX: 3.06

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUab0.55581.11161.66742.22322.7792.372.471. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 16 - Model: ResNet-152ab0.80781.61562.42343.23124.0393.453.59MIN: 3.28 / MAX: 4.26MIN: 3.18 / MAX: 4.56

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 4Kab61218243025.1226.131. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUab306090120150132.90138.111. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Vehicle Detection FP16-INT8 - Device: CPUab71421283530.0228.89MIN: 12.02 / MAX: 53.72MIN: 12.22 / MAX: 56.171. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Face Detection FP16-INT8 - Device: CPUab4008001200160020001675.081614.49MIN: 979.3 / MAX: 1858.76MIN: 989.41 / MAX: 1851.511. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 1D - Engine: CPUab2468107.080376.82639MIN: 6.62MIN: 6.611. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read Random Write Randomab110K220K330K440K550K5040915221451. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

OpenVINO

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPUab61218243026.3427.271. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2024.0Model: Road Segmentation ADAS FP16 - Device: CPUab306090120150151.61146.48MIN: 96.87 / MAX: 185.09MIN: 95.3 / MAX: 181.771. (CXX) g++ options: -fPIC -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -shared -ldl

Blender

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.1Blend File: Junkshop - Compute: CPU-Onlyab2004006008001000921.09892.47

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 16 - Model: ResNet-50ab2468108.928.66MIN: 6.82 / MAX: 10.81MIN: 7.84 / MAX: 10.76

TensorFlow

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.16.1Device: CPU - Batch Size: 1 - Model: AlexNetab369121511.2311.56

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 4 - Input: Bosphorus 4Kab0.21420.42840.64260.85681.0710.9280.9521. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 64 - Model: ResNet-50ab2468108.548.74MIN: 7.7 / MAX: 10.85MIN: 7.76 / MAX: 10.2

RocksDB

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random Fill Syncab400800120016002000171916831. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti -lpthread

Parallel BZIP2 Compression

OpenBenchmarking.orgSeconds, Fewer Is BetterParallel BZIP2 Compression 1.1.13FreeBSD-13.0-RELEASE-amd64-memstick.img Compressionab71421283528.5828.101. (CXX) g++ options: -O2 -pthread -lbz2 -lpthread

Google Draco

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: Lionab12002400360048006000555954911. (CXX) g++ options: -O3

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 4Kab61218243024.9024.621. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Recurrent Neural Network Inference - Engine: CPUab140028004200560070006399.736341.90MIN: 6336.72MIN: 6215.671. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

JPEG-XL Decoding libjxl

OpenBenchmarking.orgMP/s, More Is BetterJPEG-XL Decoding libjxl 0.10.1CPU Threads: 1ab132639526557.5858.04

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 13 - Input: Bosphorus 1080pab50100150200250240.46238.631. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Google Draco

OpenBenchmarking.orgms, Fewer Is BetterGoogle Draco 1.5.6Model: Church Facadeab2K4K6K8K10K842183611. (CXX) g++ options: -O3

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: IP Shapes 3D - Engine: CPUab1.31212.62423.93635.24846.56055.807455.83135MIN: 5.67MIN: 5.681. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 12 - Input: Bosphorus 1080pab4080120160200184.73184.091. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Timed Mesa Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Mesa Compilation 24.0Time To Compileab306090120150143.67143.25

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.4Harness: Deconvolution Batch shapes_3d - Engine: CPUab369121513.4513.49MIN: 13.22MIN: 13.241. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -pie -ldl

SVT-AV1

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.0Encoder Mode: Preset 8 - Input: Bosphorus 4Kab2468107.5517.5691. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Timed Linux Kernel Compilation

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.8Build: defconfigab110220330440550496.16497.18

PyTorch

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 32 - Model: ResNet-50ab2468108.698.68MIN: 7.73 / MAX: 9.58MIN: 7.82 / MAX: 10.13

108 Results Shown

JPEG-XL libjxl
PyTorch:
  CPU - 1 - ResNet-152
  CPU - 1 - ResNet-50
WavPack Audio Encoding
RocksDB
OpenVINO:
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
TensorFlow
RocksDB
oneDNN
Chaos Group V-RAY
OpenVINO:
  Person Vehicle Bike Detection FP16 - CPU:
    ms
    FPS
  Person Detection FP16 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16-INT8 - CPU:
    FPS
    ms
JPEG-XL libjxl
TensorFlow
SVT-AV1
OpenVINO
RocksDB:
  Read While Writing
  Rand Read
OpenVINO:
  Face Detection Retail FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Machine Translation EN To DE FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
JPEG-XL libjxl:
  JPEG - 90
  JPEG - 80
oneDNN
TensorFlow
OpenVINO:
  Weld Porosity Detection FP16-INT8 - CPU:
    ms
    FPS
TensorFlow:
  CPU - 64 - AlexNet
  CPU - 32 - GoogLeNet
  CPU - 16 - ResNet-50
RocksDB
OpenVINO:
  Person Re-Identification Retail FP16 - CPU:
    FPS
    ms
PyTorch
OpenVINO
Stockfish
OpenVINO
oneDNN
OpenVINO:
  Handwritten English Recognition FP16 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Face Detection FP16 - CPU
  Face Detection FP16 - CPU
  Age Gender Recognition Retail 0013 FP16 - CPU
  Weld Porosity Detection FP16 - CPU
  Noise Suppression Poconet-Like FP16 - CPU
TensorFlow
OpenVINO:
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Weld Porosity Detection FP16 - CPU
  Noise Suppression Poconet-Like FP16 - CPU
TensorFlow
Blender
TensorFlow:
  CPU - 16 - AlexNet
  CPU - 32 - ResNet-50
JPEG-XL libjxl
JPEG-XL Decoding libjxl
Blender
PyTorch
RocksDB
PyTorch
OpenVINO
Blender
OpenVINO
PyTorch
JPEG-XL libjxl
TensorFlow
OpenVINO:
  Vehicle Detection FP16 - CPU:
    ms
    FPS
Primesieve
SVT-AV1
PyTorch:
  CPU - 32 - Efficientnet_v2_l
  CPU - 64 - Efficientnet_v2_l
OpenVINO
PyTorch
SVT-AV1
OpenVINO:
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Face Detection FP16-INT8 - CPU:
    ms
oneDNN
RocksDB
OpenVINO:
  Road Segmentation ADAS FP16 - CPU:
    FPS
    ms
Blender
PyTorch
TensorFlow
SVT-AV1
PyTorch
RocksDB
Parallel BZIP2 Compression
Google Draco
SVT-AV1
oneDNN
JPEG-XL Decoding libjxl
SVT-AV1
Google Draco
oneDNN
SVT-AV1
Timed Mesa Compilation
oneDNN
SVT-AV1
Timed Linux Kernel Compilation
PyTorch

a

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xc2 - Thermald 2.5.4
Python Notes: Python 3.11.6
Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Mitigation of Microcode + tsx_async_abort: Not affected

Testing initiated at 26 March 2024 19:20 by user phoronix.

b

Processor: Intel Core i7-1065G7 @ 3.90GHz (4 Cores / 8 Threads), Motherboard: Dell 06CDVY (1.0.9 BIOS), Chipset: Intel Ice Lake-LP DRAM, Memory: 16GB, Disk: Toshiba KBG40ZPZ512G NVMe 512GB + 2 x 0GB MassStorageClass, Graphics: Intel Iris Plus ICL GT2 16GB (1100MHz), Audio: Realtek ALC289, Network: Intel Ice Lake-LP PCH CNVi WiFi

OS: Ubuntu 23.10, Kernel: 6.7.0-060700rc5-generic (x86_64), Desktop: GNOME Shell 45.1, Display Server: X Server + Wayland, OpenGL: 4.6 Mesa 24.0~git2312230600.551924~oibaf~m (git-551924a 2023-12-23 mantic-oibaf-ppa), Compiler: GCC 13.2.0, File-System: ext4, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xc2 - Thermald 2.5.4
Python Notes: Python 3.11.6
Security Notes: gather_data_sampling: Mitigation of Microcode + itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of Enhanced IBRS + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Mitigation of Microcode + tsx_async_abort: Not affected

Testing initiated at 27 March 2024 01:29 by user phoronix.