Xeon Platinum 8280 oneDNN 2.0 + More

2 x Intel Xeon Platinum 8280 testing with a GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2012110-HA-XEONPLATI68
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

Chess Test Suite 3 Tests
C/C++ Compiler Tests 2 Tests
CPU Massive 5 Tests
Creator Workloads 4 Tests
HPC - High Performance Computing 2 Tests
Machine Learning 2 Tests
Multi-Core 5 Tests
Intel oneAPI 2 Tests
Server 2 Tests
Server CPU Tests 4 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
December 11 2020
  5 Hours, 16 Minutes
2
December 11 2020
 
2a
December 11 2020
  1 Hour, 25 Minutes
3
December 11 2020
  2 Hours, 53 Minutes
Invert Hiding All Results Option
  2 Hours, 24 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

1

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002c
Python Notes: Python 3.8.2
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

2

2a

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002c
Python Notes: Python 3.8.2
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

3

Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE

OS: Ubuntu 20.04, Kernel: 5.4.0-18-generic (x86_64), Desktop: GNOME Shell 3.36.0, Display Server: X Server 1.20.7, Display Driver: modesetting 1.20.7, OpenGL: 3.3 Mesa 20.0.2 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Xeon Platinum 8280 oneDNN 2.0 + MoreProcessorMotherboardChipsetMemoryDiskGraphicsMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen Resolution122a32 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads)GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS)Intel Sky Lake-E DMI3 Registers378GB280GB INTEL SSDPED1D280GAllvmpipeVE2282 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbEUbuntu 20.045.4.0-18-generic (x86_64)GNOME Shell 3.36.0X Server 1.20.7modesetting 1.20.73.3 Mesa 20.0.2 (LLVM 9.0.1 256 bits)GCC 9.3.0ext41920x1080OpenBenchmarking.orgCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Disk Details- 1, 2: NONE / errors=remount-ro,relatime,rw / Block Size: 4096Processor Details- Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002cPython Details- Python 3.8.2Security Details- itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Xeon Platinum 8280 oneDNN 2.0 + Moreleveldb: Hot Readleveldb: Fill Syncleveldb: Fill Syncleveldb: Overwriteleveldb: Overwriteleveldb: Rand Fillleveldb: Rand Fillleveldb: Rand Readleveldb: Seek Randleveldb: Rand Deleteleveldb: Seq Fillleveldb: Seq Fillcrafty: Elapsed Timeonednn: IP Shapes 1D - f32 - CPUonednn: IP Shapes 3D - f32 - CPUonednn: IP Shapes 1D - u8s8f32 - CPUonednn: IP Shapes 3D - u8s8f32 - CPUonednn: IP Shapes 1D - bf16bf16bf16 - CPUonednn: IP Shapes 3D - bf16bf16bf16 - CPUonednn: Convolution Batch Shapes Auto - f32 - CPUonednn: Deconvolution Batch shapes_1d - f32 - CPUonednn: Deconvolution Batch shapes_3d - f32 - CPUonednn: Convolution Batch Shapes Auto - u8s8f32 - CPUonednn: Deconvolution Batch shapes_1d - u8s8f32 - CPUonednn: Deconvolution Batch shapes_3d - u8s8f32 - CPUonednn: Recurrent Neural Network Training - f32 - CPUonednn: Recurrent Neural Network Inference - f32 - CPUonednn: Recurrent Neural Network Training - u8s8f32 - CPUonednn: Convolution Batch Shapes Auto - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_1d - bf16bf16bf16 - CPUonednn: Deconvolution Batch shapes_3d - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - f32 - CPUonednn: Recurrent Neural Network Training - bf16bf16bf16 - CPUonednn: Recurrent Neural Network Inference - bf16bf16bf16 - CPUonednn: Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPUonednn: Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPUrav1e: 1rav1e: 5rav1e: 6rav1e: 10stockfish: Total Timeasmfish: 1024 Hash Memory, 26 Depthbuild-clash: Time To Compileastcenc: Fastastcenc: Mediumastcenc: Thoroughastcenc: Exhaustiveopenvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP16 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Face Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP16 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Person Detection 0106 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP16 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUopenvino: Age Gender Recognition Retail 0013 FP32 - CPUphpbench: PHP Benchmark Suite122a3139.4847.21684.4298.31484.3678.51462.045140.411172.1211483.2668.31493.01978149861.354733.114151.424481.094083.667132.473643.961341.453151.216393.708320.4255680.349150989.801565.554981.4343.192434.383924.44712559.6590.335755979.574565.2680.2715510.8172390.3480.9371.2082.45096447530135035548488.6345.636.617.1652.3315.511784.4815.141814.328.743142.678.683152.6138683.480.6238607.560.6266662478288681.357213.104811.392111.085033.665012.537073.991811.450031.211613.766980.4254700.349469995.326561.3521011.7613.196954.385244.45890560.9730.3370981008.338563.8590.2681510.8232100.3460.9561.2212.48696807159133208525496.0905.606.557.1552.3278363581.355783.112431.405181.095663.664132.687953.942811.462021.217153.704190.4249750.349913997.876563.1241007.0683.202584.381394.44637570.7370.3367531050.412562.3150.2707280.8222540.3460.9491.2172.45595164573132978753492.7835.626.607.1652.3315.531786.6415.191814.558.843107.468.723120.8838792.260.6238565.640.62668619OpenBenchmarking.org

LevelDB

LevelDB is a key-value storage library developed by Google that supports making use of Snappy for data compression and has other modern features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Hot Read1306090120150SE +/- 0.23, N = 3139.481. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: Fill Sync1246810SE +/- 0.00, N = 37.21. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Fill Sync1400800120016002000SE +/- 8.30, N = 31684.431. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: Overwrite1246810SE +/- 0.03, N = 38.31. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Overwrite130060090012001500SE +/- 7.25, N = 31484.371. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: Random Fill1246810SE +/- 0.03, N = 38.51. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Random Fill130060090012001500SE +/- 3.27, N = 31462.051. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Random Read1306090120150SE +/- 1.25, N = 3140.411. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Seek Random14080120160200SE +/- 1.28, N = 3172.121. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Random Delete130060090012001500SE +/- 5.02, N = 31483.271. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMB/s, More Is BetterLevelDB 1.22Benchmark: Sequential Fill1246810SE +/- 0.00, N = 38.31. (CXX) g++ options: -O3 -lsnappy -lpthread

OpenBenchmarking.orgMicroseconds Per Op, Fewer Is BetterLevelDB 1.22Benchmark: Sequential Fill130060090012001500SE +/- 2.12, N = 31493.021. (CXX) g++ options: -O3 -lsnappy -lpthread

Crafty

This is a performance test of Crafty, an advanced open-source chess engine. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterCrafty 25.2Elapsed Time12a32M4M6M8M10MSE +/- 2939.24, N = 3SE +/- 17114.61, N = 3SE +/- 11321.43, N = 37814986782886878363581. (CC) gcc options: -pthread -lstdc++ -fprofile-use -lm
OpenBenchmarking.orgNodes Per Second, More Is BetterCrafty 25.2Elapsed Time12a31.4M2.8M4.2M5.6M7MMin: 7809292 / Avg: 7814985.67 / Max: 7819099Min: 7794743 / Avg: 7828868 / Max: 7848242Min: 7815625 / Avg: 7836357.67 / Max: 78546071. (CC) gcc options: -pthread -lstdc++ -fprofile-use -lm

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU12a30.30540.61080.91621.22161.527SE +/- 0.00608, N = 3SE +/- 0.00106, N = 3SE +/- 0.00124, N = 31.354731.357211.35578MIN: 1.26MIN: 1.27MIN: 1.271. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU12a3246810Min: 1.35 / Avg: 1.35 / Max: 1.37Min: 1.36 / Avg: 1.36 / Max: 1.36Min: 1.35 / Avg: 1.36 / Max: 1.361. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU12a30.70071.40142.10212.80283.5035SE +/- 0.00815, N = 3SE +/- 0.00721, N = 3SE +/- 0.00522, N = 33.114153.104813.11243MIN: 3.04MIN: 3.04MIN: 3.041. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU12a3246810Min: 3.1 / Avg: 3.11 / Max: 3.12Min: 3.09 / Avg: 3.1 / Max: 3.11Min: 3.1 / Avg: 3.11 / Max: 3.121. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU12a30.32050.6410.96151.2821.6025SE +/- 0.01135, N = 15SE +/- 0.01426, N = 3SE +/- 0.02305, N = 31.424481.392111.40518MIN: 1.17MIN: 1.17MIN: 1.151. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU12a3246810Min: 1.34 / Avg: 1.42 / Max: 1.46Min: 1.37 / Avg: 1.39 / Max: 1.42Min: 1.36 / Avg: 1.41 / Max: 1.441. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU12a30.24650.4930.73950.9861.2325SE +/- 0.00838, N = 15SE +/- 0.00795, N = 3SE +/- 0.00538, N = 31.094081.085031.09566MIN: 0.78MIN: 0.77MIN: 0.781. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU12a3246810Min: 1.06 / Avg: 1.09 / Max: 1.2Min: 1.07 / Avg: 1.09 / Max: 1.1Min: 1.09 / Avg: 1.1 / Max: 1.111. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU12a30.82511.65022.47533.30044.1255SE +/- 0.00543, N = 3SE +/- 0.00560, N = 3SE +/- 0.00698, N = 33.667133.665013.66413MIN: 3.42MIN: 3.4MIN: 3.421. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU12a3246810Min: 3.66 / Avg: 3.67 / Max: 3.68Min: 3.65 / Avg: 3.67 / Max: 3.67Min: 3.65 / Avg: 3.66 / Max: 3.681. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU12a30.60481.20961.81442.41923.024SE +/- 0.05729, N = 15SE +/- 0.06186, N = 15SE +/- 0.06290, N = 122.473642.537072.68795MIN: 2.04MIN: 2.05MIN: 2.041. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU12a3246810Min: 2.18 / Avg: 2.47 / Max: 2.91Min: 2.2 / Avg: 2.54 / Max: 2.95Min: 2.37 / Avg: 2.69 / Max: 2.971. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU12a30.89821.79642.69463.59284.491SE +/- 0.01388, N = 3SE +/- 0.00392, N = 3SE +/- 0.00591, N = 33.961343.991813.94281MIN: 3.85MIN: 3.9MIN: 3.851. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU12a3246810Min: 3.95 / Avg: 3.96 / Max: 3.99Min: 3.98 / Avg: 3.99 / Max: 4Min: 3.93 / Avg: 3.94 / Max: 3.951. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU12a30.3290.6580.9871.3161.645SE +/- 0.01014, N = 3SE +/- 0.01385, N = 3SE +/- 0.01422, N = 31.453151.450031.46202MIN: 1.34MIN: 1.34MIN: 1.341. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU12a3246810Min: 1.44 / Avg: 1.45 / Max: 1.47Min: 1.43 / Avg: 1.45 / Max: 1.48Min: 1.44 / Avg: 1.46 / Max: 1.491. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU12a30.27390.54780.82171.09561.3695SE +/- 0.00355, N = 3SE +/- 0.00247, N = 3SE +/- 0.00135, N = 31.216391.211611.21715MIN: 1.16MIN: 1.16MIN: 1.151. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU12a3246810Min: 1.21 / Avg: 1.22 / Max: 1.22Min: 1.21 / Avg: 1.21 / Max: 1.22Min: 1.21 / Avg: 1.22 / Max: 1.221. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU12a30.84761.69522.54283.39044.238SE +/- 0.00882, N = 3SE +/- 0.00174, N = 3SE +/- 0.00878, N = 33.708323.766983.70419MIN: 3.61MIN: 3.66MIN: 3.611. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU12a3246810Min: 3.69 / Avg: 3.71 / Max: 3.72Min: 3.77 / Avg: 3.77 / Max: 3.77Min: 3.69 / Avg: 3.7 / Max: 3.721. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU12a30.09580.19160.28740.38320.479SE +/- 0.001195, N = 3SE +/- 0.001364, N = 3SE +/- 0.001956, N = 30.4255680.4254700.424975MIN: 0.37MIN: 0.38MIN: 0.381. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU12a312345Min: 0.42 / Avg: 0.43 / Max: 0.43Min: 0.42 / Avg: 0.43 / Max: 0.43Min: 0.42 / Avg: 0.42 / Max: 0.431. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU12a30.07870.15740.23610.31480.3935SE +/- 0.002877, N = 3SE +/- 0.003468, N = 3SE +/- 0.002471, N = 30.3491500.3494690.349913MIN: 0.32MIN: 0.33MIN: 0.331. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU12a312345Min: 0.34 / Avg: 0.35 / Max: 0.35Min: 0.34 / Avg: 0.35 / Max: 0.36Min: 0.34 / Avg: 0.35 / Max: 0.351. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU12a32004006008001000SE +/- 3.14, N = 3SE +/- 7.10, N = 3SE +/- 2.71, N = 3989.80995.33997.88MIN: 960.49MIN: 974.22MIN: 970.71. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU12a32004006008001000Min: 983.53 / Avg: 989.8 / Max: 993.18Min: 985 / Avg: 995.33 / Max: 1008.92Min: 993.06 / Avg: 997.88 / Max: 1002.441. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU12a3120240360480600SE +/- 3.54, N = 3SE +/- 4.95, N = 3SE +/- 3.03, N = 3565.55561.35563.12MIN: 550.61MIN: 545.36MIN: 548.721. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU12a3100200300400500Min: 561.11 / Avg: 565.55 / Max: 572.56Min: 553.29 / Avg: 561.35 / Max: 570.36Min: 557.24 / Avg: 563.12 / Max: 567.341. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU12a32004006008001000SE +/- 1.43, N = 3SE +/- 14.10, N = 3SE +/- 18.50, N = 15981.431011.761007.07MIN: 966.46MIN: 973.13MIN: 963.171. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU12a32004006008001000Min: 979 / Avg: 981.43 / Max: 983.94Min: 993.31 / Avg: 1011.76 / Max: 1039.46Min: 975.49 / Avg: 1007.07 / Max: 1264.561. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU12a30.72061.44122.16182.88243.603SE +/- 0.01321, N = 3SE +/- 0.00958, N = 3SE +/- 0.00807, N = 33.192433.196953.20258MIN: 2.96MIN: 2.95MIN: 2.961. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU12a3246810Min: 3.17 / Avg: 3.19 / Max: 3.21Min: 3.18 / Avg: 3.2 / Max: 3.22Min: 3.19 / Avg: 3.2 / Max: 3.211. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU12a30.98671.97342.96013.94684.9335SE +/- 0.00424, N = 3SE +/- 0.00185, N = 3SE +/- 0.00238, N = 34.383924.385244.38139MIN: 4.24MIN: 4.24MIN: 4.241. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU12a3246810Min: 4.38 / Avg: 4.38 / Max: 4.39Min: 4.38 / Avg: 4.39 / Max: 4.39Min: 4.38 / Avg: 4.38 / Max: 4.391. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU12a31.00332.00663.00994.01325.0165SE +/- 0.00271, N = 3SE +/- 0.01309, N = 3SE +/- 0.00236, N = 34.447124.458904.44637MIN: 4.39MIN: 4.39MIN: 4.391. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU12a3246810Min: 4.44 / Avg: 4.45 / Max: 4.45Min: 4.44 / Avg: 4.46 / Max: 4.48Min: 4.44 / Avg: 4.45 / Max: 4.451. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU12a3120240360480600SE +/- 1.36, N = 3SE +/- 1.49, N = 3SE +/- 5.42, N = 13559.66560.97570.74MIN: 549.08MIN: 549.09MIN: 545.081. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU12a3100200300400500Min: 557.13 / Avg: 559.66 / Max: 561.79Min: 558.74 / Avg: 560.97 / Max: 563.79Min: 555.77 / Avg: 570.74 / Max: 630.461. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU12a30.07580.15160.22740.30320.379SE +/- 0.005221, N = 3SE +/- 0.003594, N = 3SE +/- 0.004807, N = 30.3357550.3370980.336753MIN: 0.3MIN: 0.3MIN: 0.31. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU12a312345Min: 0.33 / Avg: 0.34 / Max: 0.35Min: 0.33 / Avg: 0.34 / Max: 0.34Min: 0.33 / Avg: 0.34 / Max: 0.341. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU12a32004006008001000SE +/- 0.37, N = 3SE +/- 13.90, N = 3SE +/- 33.04, N = 15979.571008.341050.41MIN: 967.79MIN: 978.75MIN: 963.151. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU12a32004006008001000Min: 979.07 / Avg: 979.57 / Max: 980.29Min: 991.45 / Avg: 1008.34 / Max: 1035.91Min: 978.15 / Avg: 1050.41 / Max: 1370.061. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU12a3120240360480600SE +/- 4.49, N = 3SE +/- 4.19, N = 3SE +/- 1.65, N = 3565.27563.86562.32MIN: 549.6MIN: 549.3MIN: 549.321. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU12a3100200300400500Min: 558.32 / Avg: 565.27 / Max: 573.68Min: 557.33 / Avg: 563.86 / Max: 571.68Min: 559.17 / Avg: 562.32 / Max: 564.751. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU12a30.06110.12220.18330.24440.3055SE +/- 0.002247, N = 15SE +/- 0.004018, N = 4SE +/- 0.002990, N = 70.2715510.2681510.270728MIN: 0.24MIN: 0.24MIN: 0.241. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU12a312345Min: 0.26 / Avg: 0.27 / Max: 0.29Min: 0.26 / Avg: 0.27 / Max: 0.28Min: 0.26 / Avg: 0.27 / Max: 0.291. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU12a30.18520.37040.55560.74080.926SE +/- 0.002439, N = 3SE +/- 0.002694, N = 3SE +/- 0.001883, N = 30.8172390.8232100.822254MIN: 0.76MIN: 0.76MIN: 0.761. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread
OpenBenchmarking.orgms, Fewer Is BetteroneDNN 2.0Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU12a3246810Min: 0.81 / Avg: 0.82 / Max: 0.82Min: 0.82 / Avg: 0.82 / Max: 0.83Min: 0.82 / Avg: 0.82 / Max: 0.821. (CXX) g++ options: -O3 -std=c++11 -fopenmp -msse4.1 -fPIC -pie -lpthread

rav1e

Xiph rav1e is a Rust-written AV1 video encoder. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 112a30.07830.15660.23490.31320.3915SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.002, N = 30.3480.3460.346
OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 112a312345Min: 0.35 / Avg: 0.35 / Max: 0.35Min: 0.34 / Avg: 0.35 / Max: 0.35Min: 0.34 / Avg: 0.35 / Max: 0.35

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 512a30.21510.43020.64530.86041.0755SE +/- 0.001, N = 3SE +/- 0.002, N = 3SE +/- 0.001, N = 30.9370.9560.949
OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 512a3246810Min: 0.94 / Avg: 0.94 / Max: 0.94Min: 0.95 / Avg: 0.96 / Max: 0.96Min: 0.95 / Avg: 0.95 / Max: 0.95

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 612a30.27470.54940.82411.09881.3735SE +/- 0.011, N = 3SE +/- 0.011, N = 3SE +/- 0.013, N = 31.2081.2211.217
OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 612a3246810Min: 1.19 / Avg: 1.21 / Max: 1.23Min: 1.21 / Avg: 1.22 / Max: 1.24Min: 1.19 / Avg: 1.22 / Max: 1.24

OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 1012a30.55941.11881.67822.23762.797SE +/- 0.028, N = 3SE +/- 0.033, N = 3SE +/- 0.027, N = 72.4502.4862.455
OpenBenchmarking.orgFrames Per Second, More Is Betterrav1e 0.4 AlphaSpeed: 1012a3246810Min: 2.4 / Avg: 2.45 / Max: 2.5Min: 2.45 / Avg: 2.49 / Max: 2.55Min: 2.31 / Avg: 2.46 / Max: 2.55

Stockfish

This is a test of Stockfish, an advanced C++11 chess benchmark that can scale up to 128 CPU cores. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 12Total Time12a320M40M60M80M100MSE +/- 665117.42, N = 3SE +/- 585345.87, N = 3SE +/- 865487.36, N = 39644753096807159951645731. (CXX) g++ options: -m64 -lpthread -fno-exceptions -std=c++17 -pedantic -O3 -msse -msse3 -mpopcnt -msse4.1 -mssse3 -msse2 -flto -flto=jobserver
OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 12Total Time12a320M40M60M80M100MMin: 95141823 / Avg: 96447530 / Max: 97320589Min: 95639203 / Avg: 96807159.33 / Max: 97460404Min: 94202229 / Avg: 95164573 / Max: 968917891. (CXX) g++ options: -m64 -lpthread -fno-exceptions -std=c++17 -pedantic -O3 -msse -msse3 -mpopcnt -msse4.1 -mssse3 -msse2 -flto -flto=jobserver

asmFish

This is a test of asmFish, an advanced chess benchmark written in Assembly. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-231024 Hash Memory, 26 Depth12a330M60M90M120M150MSE +/- 1433658.44, N = 3SE +/- 1096698.56, N = 3SE +/- 1438873.95, N = 3135035548133208525132978753
OpenBenchmarking.orgNodes/second, More Is BetterasmFish 2018-07-231024 Hash Memory, 26 Depth12a320M40M60M80M100MMin: 133106308 / Avg: 135035547.67 / Max: 137837191Min: 131069329 / Avg: 133208525.33 / Max: 134697793Min: 130958761 / Avg: 132978753 / Max: 135763798

Timed Clash Compilation

Build the clash-lang Haskell to VHDL/Verilog/SystemVerilog compiler with GHC 8.10.1 Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Clash CompilationTime To Compile12a3110220330440550SE +/- 4.06, N = 3SE +/- 0.83, N = 3SE +/- 1.81, N = 3488.63496.09492.78
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Clash CompilationTime To Compile12a390180270360450Min: 480.52 / Avg: 488.63 / Max: 492.91Min: 495.17 / Avg: 496.09 / Max: 497.76Min: 489.24 / Avg: 492.78 / Max: 495.17

ASTC Encoder

ASTC Encoder (astcenc) is for the Adaptive Scalable Texture Compression (ASTC) format commonly used with OpenGL, OpenGL ES, and Vulkan graphics APIs. This test profile does a coding test of both compression/decompression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Fast12a31.26682.53363.80045.06726.334SE +/- 0.02, N = 3SE +/- 0.04, N = 3SE +/- 0.01, N = 35.635.605.621. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Fast12a3246810Min: 5.6 / Avg: 5.63 / Max: 5.66Min: 5.54 / Avg: 5.6 / Max: 5.67Min: 5.6 / Avg: 5.62 / Max: 5.651. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Medium12a3246810SE +/- 0.01, N = 3SE +/- 0.01, N = 3SE +/- 0.01, N = 36.616.556.601. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Medium12a33691215Min: 6.59 / Avg: 6.61 / Max: 6.63Min: 6.53 / Avg: 6.55 / Max: 6.58Min: 6.58 / Avg: 6.6 / Max: 6.631. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Thorough12a3246810SE +/- 0.02, N = 3SE +/- 0.02, N = 3SE +/- 0.01, N = 37.167.157.161. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Thorough12a33691215Min: 7.14 / Avg: 7.16 / Max: 7.2Min: 7.13 / Avg: 7.15 / Max: 7.19Min: 7.13 / Avg: 7.16 / Max: 7.181. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Exhaustive12a31224364860SE +/- 0.04, N = 3SE +/- 0.02, N = 3SE +/- 0.03, N = 352.3352.3252.331. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread
OpenBenchmarking.orgSeconds, Fewer Is BetterASTC Encoder 2.0Preset: Exhaustive12a31020304050Min: 52.29 / Avg: 52.33 / Max: 52.4Min: 52.29 / Avg: 52.32 / Max: 52.34Min: 52.28 / Avg: 52.33 / Max: 52.371. (CXX) g++ options: -std=c++14 -fvisibility=hidden -O3 -flto -mfpmath=sse -mavx2 -mpopcnt -lpthread

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU1348121620SE +/- 0.02, N = 3SE +/- 0.02, N = 315.5115.53
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU1348121620Min: 15.49 / Avg: 15.51 / Max: 15.55Min: 15.51 / Avg: 15.53 / Max: 15.56

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU13400800120016002000SE +/- 1.55, N = 3SE +/- 1.08, N = 31784.481786.64
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP16 - Device: CPU1330060090012001500Min: 1782.61 / Avg: 1784.48 / Max: 1787.56Min: 1784.49 / Avg: 1786.64 / Max: 1787.8

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU1348121620SE +/- 0.09, N = 3SE +/- 0.04, N = 315.1415.19
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU1348121620Min: 14.97 / Avg: 15.14 / Max: 15.28Min: 15.13 / Avg: 15.19 / Max: 15.26

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU13400800120016002000SE +/- 1.30, N = 3SE +/- 1.38, N = 31814.321814.55
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Face Detection 0106 FP32 - Device: CPU1330060090012001500Min: 1811.73 / Avg: 1814.32 / Max: 1815.68Min: 1811.87 / Avg: 1814.55 / Max: 1816.47

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU13246810SE +/- 0.08, N = 10SE +/- 0.04, N = 38.748.84
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU133691215Min: 8.03 / Avg: 8.74 / Max: 8.84Min: 8.77 / Avg: 8.84 / Max: 8.91

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU137001400210028003500SE +/- 37.41, N = 10SE +/- 19.60, N = 33142.673107.46
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP16 - Device: CPU135001000150020002500Min: 3089.33 / Avg: 3142.67 / Max: 3477.82Min: 3079.71 / Avg: 3107.46 / Max: 3145.31

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU13246810SE +/- 0.02, N = 3SE +/- 0.03, N = 38.688.72
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU133691215Min: 8.66 / Avg: 8.68 / Max: 8.71Min: 8.67 / Avg: 8.72 / Max: 8.78

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU137001400210028003500SE +/- 15.31, N = 3SE +/- 3.09, N = 33152.613120.88
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Person Detection 0106 FP32 - Device: CPU135001000150020002500Min: 3122.82 / Avg: 3152.61 / Max: 3173.64Min: 3114.94 / Avg: 3120.88 / Max: 3125.32

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU138K16K24K32K40KSE +/- 50.16, N = 3SE +/- 148.89, N = 338683.4838792.26
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU137K14K21K28K35KMin: 38588.94 / Avg: 38683.48 / Max: 38759.83Min: 38538.15 / Avg: 38792.26 / Max: 39053.76

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU130.13950.2790.41850.5580.6975SE +/- 0.00, N = 3SE +/- 0.00, N = 30.620.62
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU13246810Min: 0.62 / Avg: 0.62 / Max: 0.62Min: 0.61 / Avg: 0.62 / Max: 0.62

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU138K16K24K32K40KSE +/- 80.48, N = 3SE +/- 81.70, N = 338607.5638565.64
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU137K14K21K28K35KMin: 38483.41 / Avg: 38607.56 / Max: 38758.36Min: 38418.08 / Avg: 38565.64 / Max: 38700.2

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU130.13950.2790.41850.5580.6975SE +/- 0.00, N = 3SE +/- 0.00, N = 30.620.62
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2021.1Model: Age Gender Recognition Retail 0013 FP32 - Device: CPU13246810Min: 0.62 / Avg: 0.62 / Max: 0.62Min: 0.62 / Avg: 0.62 / Max: 0.62

PHPBench

PHPBench is a benchmark suite for PHP. It performs a large number of simple tests in order to bench various aspects of the PHP interpreter. PHPBench can be used to compare hardware, operating systems, PHP versions, PHP accelerators and caches, compiler options, etc. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark Suite13140K280K420K560K700KSE +/- 1558.00, N = 3SE +/- 351.36, N = 3666624668619
OpenBenchmarking.orgScore, More Is BetterPHPBench 0.8.1PHP Benchmark Suite13120K240K360K480K600KMin: 663744 / Avg: 666624.33 / Max: 669094Min: 668129 / Avg: 668618.67 / Max: 669300

61 Results Shown

LevelDB:
  Hot Read
  Fill Sync
  Fill Sync
  Overwrite
  Overwrite
  Rand Fill
  Rand Fill
  Rand Read
  Seek Rand
  Rand Delete
  Seq Fill
  Seq Fill
Crafty
oneDNN:
  IP Shapes 1D - f32 - CPU
  IP Shapes 3D - f32 - CPU
  IP Shapes 1D - u8s8f32 - CPU
  IP Shapes 3D - u8s8f32 - CPU
  IP Shapes 1D - bf16bf16bf16 - CPU
  IP Shapes 3D - bf16bf16bf16 - CPU
  Convolution Batch Shapes Auto - f32 - CPU
  Deconvolution Batch shapes_1d - f32 - CPU
  Deconvolution Batch shapes_3d - f32 - CPU
  Convolution Batch Shapes Auto - u8s8f32 - CPU
  Deconvolution Batch shapes_1d - u8s8f32 - CPU
  Deconvolution Batch shapes_3d - u8s8f32 - CPU
  Recurrent Neural Network Training - f32 - CPU
  Recurrent Neural Network Inference - f32 - CPU
  Recurrent Neural Network Training - u8s8f32 - CPU
  Convolution Batch Shapes Auto - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_1d - bf16bf16bf16 - CPU
  Deconvolution Batch shapes_3d - bf16bf16bf16 - CPU
  Recurrent Neural Network Inference - u8s8f32 - CPU
  Matrix Multiply Batch Shapes Transformer - f32 - CPU
  Recurrent Neural Network Training - bf16bf16bf16 - CPU
  Recurrent Neural Network Inference - bf16bf16bf16 - CPU
  Matrix Multiply Batch Shapes Transformer - u8s8f32 - CPU
  Matrix Multiply Batch Shapes Transformer - bf16bf16bf16 - CPU
rav1e:
  1
  5
  6
  10
Stockfish
asmFish
Timed Clash Compilation
ASTC Encoder:
  Fast
  Medium
  Thorough
  Exhaustive
OpenVINO:
  Face Detection 0106 FP16 - CPU:
    FPS
    ms
  Face Detection 0106 FP32 - CPU:
    FPS
    ms
  Person Detection 0106 FP16 - CPU:
    FPS
    ms
  Person Detection 0106 FP32 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP32 - CPU:
    FPS
    ms
PHPBench

1

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002c
Python Notes: Python 3.8.2
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 11 December 2020 10:56 by user phoronix.

2

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Disk Notes: NONE / errors=remount-ro,relatime,rw / Block Size: 4096
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002c
Python Notes: Python 3.8.2
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 11 December 2020 16:32 by user phoronix.

2a

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002c
Python Notes: Python 3.8.2
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 11 December 2020 16:32 by user phoronix.

3

Processor: 2 x Intel Xeon Platinum 8280 @ 4.00GHz (56 Cores / 112 Threads), Motherboard: GIGABYTE MD61-SC2-00 v01000100 (T15 BIOS), Chipset: Intel Sky Lake-E DMI3 Registers, Memory: 378GB, Disk: 280GB INTEL SSDPED1D280GA, Graphics: llvmpipe, Monitor: VE228, Network: 2 x Intel X722 for 1GbE + 2 x QLogic FastLinQ QL41000 10/25/40/50GbE

OS: Ubuntu 20.04, Kernel: 5.4.0-18-generic (x86_64), Desktop: GNOME Shell 3.36.0, Display Server: X Server 1.20.7, Display Driver: modesetting 1.20.7, OpenGL: 3.3 Mesa 20.0.2 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1920x1080

Compiler Notes: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,gm2 --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v
Processor Notes: Scaling Governor: intel_pstate powersave - CPU Microcode: 0x500002c
Python Notes: Python 3.8.2
Security Notes: itlb_multihit: KVM: Mitigation of Split huge pages + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling + tsx_async_abort: Mitigation of TSX disabled

Testing initiated at 11 December 2020 18:10 by user phoronix.