xeon okt Intel Xeon E5-2609 v4 testing with a MSI X99A RAIDER (MS-7885) v5.0 (P.50 BIOS) and llvmpipe on Ubuntu 20.04 via the Phoronix Test Suite. A: Processor: Intel Xeon E5-2609 v4 @ 1.70GHz (8 Cores), Motherboard: MSI X99A RAIDER (MS-7885) v5.0 (P.50 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 16GB, Disk: 256GB CORSAIR FORCE LX, Graphics: llvmpipe, Audio: Realtek ALC892, Network: Intel I218-V OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc6daily20200926-generic (x86_64) 20200925, Desktop: GNOME Shell 3.36.2, Display Server: X Server 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 B: Processor: Intel Xeon E5-2609 v4 @ 1.70GHz (8 Cores), Motherboard: MSI X99A RAIDER (MS-7885) v5.0 (P.50 BIOS), Chipset: Intel Xeon E7 v4/Xeon, Memory: 16GB, Disk: 256GB CORSAIR FORCE LX, Graphics: llvmpipe, Audio: Realtek ALC892, Network: Intel I218-V OS: Ubuntu 20.04, Kernel: 5.9.0-050900rc6daily20200926-generic (x86_64) 20200925, Desktop: GNOME Shell 3.36.2, Display Server: X Server 1.20.8, OpenGL: 3.3 Mesa 20.0.4 (LLVM 9.0.1 256 bits), Compiler: GCC 9.3.0, File-System: ext4, Screen Resolution: 1024x768 Glibc Benchmarks Benchmark: cos ns < Lower Is Better A . 102.65 |=================================================================== B . 102.63 |=================================================================== Glibc Benchmarks Benchmark: exp ns < Lower Is Better A . 27.79 |==================================================================== B . 27.73 |==================================================================== Glibc Benchmarks Benchmark: ffs ns < Lower Is Better A . 6.02894 |================================================================== B . 6.03090 |================================================================== Glibc Benchmarks Benchmark: sin ns < Lower Is Better A . 88.68 |==================================================================== B . 88.68 |==================================================================== Glibc Benchmarks Benchmark: log2 ns < Lower Is Better A . 30.67 |==================================================================== B . 30.66 |==================================================================== Glibc Benchmarks Benchmark: modf ns < Lower Is Better A . 11.00 |==================================================================== B . 11.00 |==================================================================== Glibc Benchmarks Benchmark: sinh ns < Lower Is Better A . 36.51 |==================================================================== B . 36.51 |==================================================================== Glibc Benchmarks Benchmark: sqrt ns < Lower Is Better A . 8.03159 |================================================================== B . 8.03153 |================================================================== Glibc Benchmarks Benchmark: tanh ns < Lower Is Better A . 46.75 |==================================================================== B . 46.76 |==================================================================== Glibc Benchmarks Benchmark: asinh ns < Lower Is Better A . 41.69 |==================================================================== B . 41.62 |==================================================================== Glibc Benchmarks Benchmark: atanh ns < Lower Is Better A . 50.25 |==================================================================== B . 50.23 |==================================================================== Glibc Benchmarks Benchmark: ffsll ns < Lower Is Better A . 6.02400 |================================================================== B . 6.03178 |================================================================== Glibc Benchmarks Benchmark: sincos ns < Lower Is Better A . 54.12 |==================================================================== B . 54.13 |==================================================================== Glibc Benchmarks Benchmark: pthread_once ns < Lower Is Better A . 7.00595 |================================================================== B . 7.00562 |================================================================== LAMMPS Molecular Dynamics Simulator 23Jun2022 Model: Rhodopsin Protein ns/day > Higher Is Better A . 2.699 |==================================================================== B . 2.713 |==================================================================== Chia Blockchain VDF 1.0.7 Test: Square Plain C++ IPS > Higher Is Better A . 54200 |==================================================================== B . 54100 |==================================================================== Chia Blockchain VDF 1.0.7 Test: Square Assembly Optimized IPS > Higher Is Better A . 77800 |=================================================================== B . 78500 |==================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 80 MP/s > Higher Is Better A . 3.45 |===================================================================== B . 3.45 |===================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 90 MP/s > Higher Is Better A . 3.35 |==================================================================== B . 3.38 |===================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 80 MP/s > Higher Is Better A . 3.33 |===================================================================== B . 3.33 |===================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 MP/s > Higher Is Better A . 3.24 |===================================================================== B . 3.26 |===================================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 100 MP/s > Higher Is Better A . 0.27 |===================================================================== B . 0.27 |===================================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 MP/s > Higher Is Better A . 0.27 |===================================================================== B . 0.27 |===================================================================== JPEG XL Decoding libjxl 0.7 CPU Threads: 1 MP/s > Higher Is Better A . 15.28 |=================================================================== B . 15.45 |==================================================================== JPEG XL Decoding libjxl 0.7 CPU Threads: All MP/s > Higher Is Better A . 93.25 |=================================================================== B . 94.94 |==================================================================== GraphicsMagick 1.3.38 Operation: Swirl Iterations Per Minute > Higher Is Better A . 104 |====================================================================== B . 104 |====================================================================== GraphicsMagick 1.3.38 Operation: Rotate Iterations Per Minute > Higher Is Better A . 335 |==================================================================== B . 345 |====================================================================== GraphicsMagick 1.3.38 Operation: Sharpen Iterations Per Minute > Higher Is Better A . 43 |======================================================================= B . 43 |======================================================================= GraphicsMagick 1.3.38 Operation: Enhanced Iterations Per Minute > Higher Is Better A . 71 |======================================================================= B . 71 |======================================================================= GraphicsMagick 1.3.38 Operation: Resizing Iterations Per Minute > Higher Is Better A . 312 |===================================================================== B . 315 |====================================================================== GraphicsMagick 1.3.38 Operation: Noise-Gaussian Iterations Per Minute > Higher Is Better A . 78 |======================================================================= B . 77 |====================================================================== GraphicsMagick 1.3.38 Operation: HWB Color Space Iterations Per Minute > Higher Is Better A . 371 |==================================================================== B . 384 |====================================================================== AOM AV1 3.5 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 0.05 |===================================================================== B . 0.05 |===================================================================== AOM AV1 3.5 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 1.84 |===================================================================== B . 1.85 |===================================================================== AOM AV1 3.5 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 9.60 |==================================================================== B . 9.81 |===================================================================== AOM AV1 3.5 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 3.38 |===================================================================== B . 3.36 |===================================================================== AOM AV1 3.5 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 16.73 |==================================================================== B . 16.63 |==================================================================== AOM AV1 3.5 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 23.51 |==================================================================== B . 23.41 |==================================================================== AOM AV1 3.5 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better A . 24.34 |==================================================================== B . 24.23 |==================================================================== AOM AV1 3.5 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 0.15 |===================================================================== B . 0.15 |===================================================================== AOM AV1 3.5 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 4.40 |===================================================================== B . 4.41 |===================================================================== AOM AV1 3.5 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 21.44 |==================================================================== B . 21.19 |=================================================================== AOM AV1 3.5 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 10.82 |==================================================================== B . 10.73 |=================================================================== AOM AV1 3.5 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 47.75 |==================================================================== B . 48.10 |==================================================================== AOM AV1 3.5 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 62.36 |==================================================================== B . 62.74 |==================================================================== AOM AV1 3.5 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better A . 65.56 |=================================================================== B . 66.17 |==================================================================== Kvazaar 2.1 Video Input: Bosphorus 4K - Video Preset: Very Fast Frames Per Second > Higher Is Better A . 5.12 |==================================================================== B . 5.17 |===================================================================== Kvazaar 2.1 Video Input: Bosphorus 4K - Video Preset: Ultra Fast Frames Per Second > Higher Is Better A . 8.97 |===================================================================== B . 8.99 |===================================================================== Kvazaar 2.1 Video Input: Bosphorus 1080p - Video Preset: Very Fast Frames Per Second > Higher Is Better A . 22.90 |==================================================================== B . 22.94 |==================================================================== Kvazaar 2.1 Video Input: Bosphorus 1080p - Video Preset: Ultra Fast Frames Per Second > Higher Is Better A . 38.73 |=================================================================== B . 39.08 |==================================================================== 7-Zip Compression 22.01 Test: Compression Rating MIPS > Higher Is Better A . 22928 |==================================================================== B . 22984 |==================================================================== 7-Zip Compression 22.01 Test: Decompression Rating MIPS > Higher Is Better A . 15114 |==================================================================== B . 15213 |==================================================================== libavif avifenc 0.11 Encoder Speed: 0 Seconds < Lower Is Better A . 579.16 |================================================================== B . 588.84 |=================================================================== libavif avifenc 0.11 Encoder Speed: 2 Seconds < Lower Is Better A . 270.48 |================================================================== B . 272.75 |=================================================================== libavif avifenc 0.11 Encoder Speed: 6 Seconds < Lower Is Better A . 26.99 |==================================================================== B . 27.16 |==================================================================== libavif avifenc 0.11 Encoder Speed: 6, Lossless Seconds < Lower Is Better A . 40.03 |==================================================================== B . 39.84 |==================================================================== libavif avifenc 0.11 Encoder Speed: 10, Lossless Seconds < Lower Is Better A . 18.16 |==================================================================== B . 18.08 |==================================================================== Timed Gem5 Compilation 21.2 Time To Compile Seconds < Lower Is Better A . 1396.87 |================================================================== B . 1397.05 |================================================================== Timed Linux Kernel Compilation 5.18 Build: defconfig Seconds < Lower Is Better A . 311.83 |=================================================================== B . 311.55 |=================================================================== Timed Linux Kernel Compilation 5.18 Build: allmodconfig Seconds < Lower Is Better A . 3885.79 |================================================================== B . 3881.58 |================================================================== Timed MPlayer Compilation 1.5 Time To Compile Seconds < Lower Is Better A . 119.90 |=================================================================== B . 119.70 |=================================================================== Timed Node.js Compilation 18.8 Time To Compile Seconds < Lower Is Better A . 2040.12 |================================================================== B . 2039.40 |================================================================== Timed PHP Compilation 8.1.9 Time To Compile Seconds < Lower Is Better A . 202.30 |=================================================================== B . 202.53 |=================================================================== Timed CPython Compilation 3.10.6 Build Configuration: Default Seconds < Lower Is Better A . 55.47 |==================================================================== B . 55.34 |==================================================================== Timed CPython Compilation 3.10.6 Build Configuration: Released Build, PGO + LTO Optimized Seconds < Lower Is Better A . 878.60 |=================================================================== B . 877.31 |=================================================================== Parallel BZIP2 Compression 1.1.13 FreeBSD-13.0-RELEASE-amd64-memstick.img Compression Seconds < Lower Is Better A . 32.31 |==================================================================== B . 32.23 |==================================================================== oneDNN 2.7 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 8.12857 |================================================================== B . 8.17729 |================================================================== oneDNN 2.7 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 8.17122 |================================================================== B . 8.05773 |================================================================= oneDNN 2.7 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 5.66887 |================================================================== B . 5.66947 |================================================================== oneDNN 2.7 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 3.84180 |================================================================== B . 3.85965 |================================================================== oneDNN 2.7 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 14.17 |==================================================================== B . 14.15 |==================================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 15.99 |==================================================================== B . 15.97 |==================================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 14.65 |==================================================================== B . 14.67 |==================================================================== oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 17.12 |==================================================================== B . 17.11 |==================================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 8.39234 |================================================================== B . 8.34261 |================================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 11.47 |==================================================================== B . 11.45 |==================================================================== oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 7868.71 |================================================================== B . 7890.48 |================================================================== oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 4341.02 |================================================================== B . 4112.59 |=============================================================== oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 7874.27 |================================================================== B . 7866.79 |================================================================== oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 4077.01 |================================================================== B . 4098.73 |================================================================== oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better A . 4.34039 |================================================================== B . 4.26921 |================================================================= oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better A . 7894.49 |================================================================== B . 7935.85 |================================================================== oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better A . 4083.82 |================================================================== B . 4081.60 |================================================================== oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better A . 3.50581 |================================================================== B . 3.52560 |================================================================== oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Timed Erlang/OTP Compilation 25.0 Time To Compile Seconds < Lower Is Better A . 293.82 |=================================================================== B . 293.51 |=================================================================== FLAC Audio Encoding 1.4 WAV To FLAC Seconds < Lower Is Better A . 52.62 |==================================================================== B . 52.85 |==================================================================== Node.js V8 Web Tooling Benchmark runs/s > Higher Is Better A . 5.04 |===================================================================== B . 5.00 |==================================================================== ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, First Run / Cold Cache Queries Per Minute, Geo Mean > Higher Is Better A . 44.69 |==================================================================== B . 43.80 |=================================================================== ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, Second Run Queries Per Minute, Geo Mean > Higher Is Better A . 49.86 |==================================================================== B . 49.68 |==================================================================== ClickHouse 22.5.4.19 100M Rows Web Analytics Dataset, Third Run Queries Per Minute, Geo Mean > Higher Is Better A . 50.33 |=================================================================== B . 50.82 |==================================================================== ASTC Encoder 4.0 Preset: Fast MT/s > Higher Is Better A . 40.45 |==================================================================== B . 40.47 |==================================================================== ASTC Encoder 4.0 Preset: Medium MT/s > Higher Is Better A . 14.80 |==================================================================== B . 14.82 |==================================================================== ASTC Encoder 4.0 Preset: Thorough MT/s > Higher Is Better A . 1.8866 |=================================================================== B . 1.8842 |=================================================================== ASTC Encoder 4.0 Preset: Exhaustive MT/s > Higher Is Better A . 0.1856 |=================================================================== B . 0.1857 |=================================================================== Graph500 3.0 Scale: 26 BFS median_TEPS > Higher Is Better Graph500 3.0 Scale: 29 BFS median_TEPS > Higher Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare Ns Per Day > Higher Is Better A . 0.456 |==================================================================== B . 0.456 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 2.6413 |=================================================================== B . 2.6054 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 1497.94 |================================================================== B . 1503.50 |================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 2.6027 |=================================================================== B . 2.6078 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 384.21 |=================================================================== B . 383.45 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 10.86 |==================================================================== B . 10.83 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 367.56 |=================================================================== B . 368.57 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 9.9280 |=================================================================== B . 9.9442 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 100.71 |=================================================================== B . 100.54 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 16.83 |==================================================================== B . 16.82 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 237.49 |=================================================================== B . 237.72 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 16.33 |==================================================================== B . 16.31 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 61.22 |==================================================================== B . 61.29 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 33.80 |==================================================================== B . 33.75 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 118.00 |=================================================================== B . 118.29 |=================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 30.54 |==================================================================== B . 30.57 |==================================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 32.73 |==================================================================== B . 32.70 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 23.11 |==================================================================== B . 23.21 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 172.69 |=================================================================== B . 172.28 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 19.94 |==================================================================== B . 20.00 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 50.13 |==================================================================== B . 49.99 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 11.67 |==================================================================== B . 11.66 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 342.54 |=================================================================== B . 341.94 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 10.03 |==================================================================== B . 10.01 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 99.66 |==================================================================== B . 99.92 |==================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better A . 2.6288 |================================================================== B . 2.6644 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better A . 1512.78 |================================================================== B . 1501.10 |================================================================= Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better A . 2.5933 |=================================================================== B . 2.5917 |=================================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better A . 385.60 |=================================================================== B . 385.84 |=================================================================== Mobile Neural Network 2.1 Model: nasnet ms < Lower Is Better A . 21.52 |==================================================================== B . 21.55 |==================================================================== Mobile Neural Network 2.1 Model: mobilenetV3 ms < Lower Is Better A . 2.799 |==================================================================== B . 2.811 |==================================================================== Mobile Neural Network 2.1 Model: squeezenetv1.1 ms < Lower Is Better A . 5.328 |==================================================================== B . 5.337 |==================================================================== Mobile Neural Network 2.1 Model: resnet-v2-50 ms < Lower Is Better A . 40.68 |==================================================================== B . 40.49 |==================================================================== Mobile Neural Network 2.1 Model: SqueezeNetV1.0 ms < Lower Is Better A . 7.646 |==================================================================== B . 7.640 |==================================================================== Mobile Neural Network 2.1 Model: MobileNetV2_224 ms < Lower Is Better A . 5.300 |==================================================================== B . 5.287 |==================================================================== Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 ms < Lower Is Better A . 5.773 |==================================================================== B . 5.771 |==================================================================== Mobile Neural Network 2.1 Model: inception-v3 ms < Lower Is Better A . 54.10 |==================================================================== B . 53.99 |==================================================================== NCNN 20220729 Target: CPU - Model: mobilenet ms < Lower Is Better A . 23.87 |==================================================================== B . 23.98 |==================================================================== NCNN 20220729 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better A . 7.04 |===================================================================== B . 7.06 |===================================================================== NCNN 20220729 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better A . 6.23 |===================================================================== B . 6.24 |===================================================================== NCNN 20220729 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better A . 6.81 |===================================================================== B . 6.77 |===================================================================== NCNN 20220729 Target: CPU - Model: mnasnet ms < Lower Is Better A . 6.68 |===================================================================== B . 6.67 |===================================================================== NCNN 20220729 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better A . 13.53 |==================================================================== B . 13.54 |==================================================================== NCNN 20220729 Target: CPU - Model: blazeface ms < Lower Is Better A . 2.07 |===================================================================== B . 2.07 |===================================================================== NCNN 20220729 Target: CPU - Model: googlenet ms < Lower Is Better A . 17.16 |==================================================================== B . 17.16 |==================================================================== NCNN 20220729 Target: CPU - Model: vgg16 ms < Lower Is Better A . 55.89 |==================================================================== B . 56.05 |==================================================================== NCNN 20220729 Target: CPU - Model: resnet18 ms < Lower Is Better A . 11.76 |==================================================================== B . 11.68 |==================================================================== NCNN 20220729 Target: CPU - Model: alexnet ms < Lower Is Better A . 9.69 |===================================================================== B . 9.67 |===================================================================== NCNN 20220729 Target: CPU - Model: resnet50 ms < Lower Is Better A . 27.45 |=================================================================== B . 27.99 |==================================================================== NCNN 20220729 Target: CPU - Model: yolov4-tiny ms < Lower Is Better A . 35.17 |=================================================================== B . 35.61 |==================================================================== NCNN 20220729 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better A . 21.59 |==================================================================== B . 21.67 |==================================================================== NCNN 20220729 Target: CPU - Model: regnety_400m ms < Lower Is Better A . 20.48 |==================================================================== B . 20.59 |==================================================================== NCNN 20220729 Target: CPU - Model: vision_transformer ms < Lower Is Better A . 761.24 |=================================================================== B . 760.24 |=================================================================== NCNN 20220729 Target: CPU - Model: FastestDet ms < Lower Is Better A . 8.41 |===================================================================== B . 8.44 |===================================================================== Blender 3.3 Blend File: BMW27 - Compute: CPU-Only Seconds < Lower Is Better A . 479.30 |=================================================================== B . 479.79 |=================================================================== Natron 2.4.3 Input: Spaceship FPS > Higher Is Better A . 0.9 |====================================================================== B . 0.9 |====================================================================== BRL-CAD 7.32.6 VGR Performance Metric VGR Performance Metric > Higher Is Better A . 40981 |=================================================================== B . 41465 |====================================================================