2023-02-25-0937 Docker testing on Ubuntu 20.04.4 LTS via the Phoronix Test Suite. ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores: Processor: AMD Ryzen Threadripper PRO 3955WX 16-Cores @ 3.90GHz (16 Cores / 32 Threads), Motherboard: ASUS Pro WS WRX80E-SAGE SE WIFI (0602 BIOS), Chipset: AMD Starship/Matisse, Memory: 256GB, Disk: 4 x 2000GB Samsung SSD 970 EVO Plus 2TB + 1000GB Samsung SSD 970 EVO Plus 1TB + 500GB Western Digital WDS500G2B0B, Graphics: ASPEED 16GB (2450MHz), Audio: Intel Device 4f92, Monitor: 2 x DELL U2312HM + 28E850, Network: 2 x Intel 10G X550T OS: Ubuntu 20.04.4 LTS, Kernel: 6.2.0-1275.native (x86_64), OpenCL: OpenCL 2.1 AMD-APP (3513.0), Vulkan: 1.2.182, Compiler: GCC 9.4.0, File-System: overlayfs, Screen Resolution: 1920x1080, System Layer: Docker PlaidML FP16: No - Mode: Inference - Network: VGG16 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 32.09 |================== PlaidML FP16: No - Mode: Inference - Network: ResNet 50 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 6.97 |=================== OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.12 |=================== OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 3.42 |=================== OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 3.38 |=================== OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 440.86 |================= OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.88 |=================== OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 495.20 |================= OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 485.02 |================= OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 53.70 |================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 582.32 |================= OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 694.03 |================= OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 14801.73 |=============== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 16201.40 |=============== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Triad GB/s > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 12.62 |================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Reduction GB/s > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 309.97 |================= SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Download GB/s > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 13.89 |================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Bus Speed Readback GB/s > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 14.11 |================== SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Texture Read Bandwidth GB/s > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 447.31 |================= SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: S3D GFLOPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 286.98 |================= SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: FFT SP GFLOPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2417.73 |================ SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: GEMM SGEMM_N GFLOPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5888.79 |================ SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: Max SP Flops GFLOPS > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 8078773 |================ SHOC Scalable HeterOgeneous Computing 2020-04-17 Target: OpenCL - Benchmark: MD5 Hash GHash/s > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 16.84 |================== TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: VGG-16 images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: VGG-16 images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: VGG-16 images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: VGG-16 images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: AlexNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: VGG-16 images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: AlexNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: GoogLeNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: ResNet-50 images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: GoogLeNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: ResNet-50 images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet images/sec > Higher Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: ResNet-50 images/sec > Higher Is Better ONNX Runtime 1.14 Model: GPT-2 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: GPT-2 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: yolov4 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: yolov4 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: bertsquad-12 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: bertsquad-12 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: CaffeNet 12-int8 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: fcn-resnet101-11 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: fcn-resnet101-11 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: ArcFace ResNet-100 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: super-resolution-10 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: super-resolution-10 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Parallel Inferences Per Second > Higher Is Better ONNX Runtime 1.14 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard Inferences Per Second > Higher Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 14.07 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 10.35 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 158.89 |================= Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 65.71 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 55.60 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 26.61 |================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 79.17 |================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 50.21 |================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 169.13 |================= Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 110.00 |================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 113.61 |================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 76.37 |================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 18.17 |================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 14.60 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 57.59 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 38.96 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 14.07 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 10.33 |================== LeelaChessZero 0.28 Backend: BLAS Nodes Per Second > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1237 |=================== Numpy Benchmark Score > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 428.19 |================= AI Benchmark Alpha 0.1.2 Score > Higher Is Better spaCy 3.4.1 Model: en_core_web_lg tokens/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 12737 |================== spaCy 3.4.1 Model: en_core_web_trf tokens/sec > Higher Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1183 |=================== Caffe 2020-02-13 Model: AlexNet - Acceleration: CPU - Iterations: 100 Milli-Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 60942 |================== Caffe 2020-02-13 Model: AlexNet - Acceleration: CPU - Iterations: 200 Milli-Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 121450 |================= Caffe 2020-02-13 Model: AlexNet - Acceleration: CPU - Iterations: 1000 Milli-Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 603284 |================= Caffe 2020-02-13 Model: GoogleNet - Acceleration: CPU - Iterations: 100 Milli-Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 151515 |================= Caffe 2020-02-13 Model: GoogleNet - Acceleration: CPU - Iterations: 200 Milli-Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 302462 |================= Caffe 2020-02-13 Model: GoogleNet - Acceleration: CPU - Iterations: 1000 Milli-Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1507037 |================ oneDNN 3.0 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2.60515 |================ oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 3.78993 |================ oneDNN 3.0 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1.32730 |================ oneDNN 3.0 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 0.465860 |=============== oneDNN 3.0 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.09864 |================ oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 4.06826 |================ oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 3.61081 |================ oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.93109 |================ oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1.88525 |================ oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2.54283 |================ oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2284.14 |================ oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1408.74 |================ oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2287.00 |================ oneDNN 3.0 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1398.04 |================ oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 0.893774 |=============== oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2287.07 |================ oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1399.20 |================ oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 0.888573 |=============== oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Mobile Neural Network 2.1 Model: nasnet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 17.25 |================== Mobile Neural Network 2.1 Model: mobilenetV3 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2.769 |================== Mobile Neural Network 2.1 Model: squeezenetv1.1 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 4.709 |================== Mobile Neural Network 2.1 Model: resnet-v2-50 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 24.74 |================== Mobile Neural Network 2.1 Model: SqueezeNetV1.0 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 7.375 |================== Mobile Neural Network 2.1 Model: MobileNetV2_224 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 4.985 |================== Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 3.339 |================== Mobile Neural Network 2.1 Model: inception-v3 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 27.34 |================== NCNN 20220729 Target: CPU - Model: mobilenet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 14.27 |================== NCNN 20220729 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.66 |=================== NCNN 20220729 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.03 |=================== NCNN 20220729 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 6.38 |=================== NCNN 20220729 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 7.77 |=================== NCNN 20220729 Target: CPU - Model: blazeface ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2.77 |=================== NCNN 20220729 Target: CPU - Model: googlenet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 13.47 |================== NCNN 20220729 Target: CPU - Model: vgg16 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 28.08 |================== NCNN 20220729 Target: CPU - Model: resnet18 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 8.99 |=================== NCNN 20220729 Target: CPU - Model: alexnet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 6.43 |=================== NCNN 20220729 Target: CPU - Model: resnet50 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 16.70 |================== NCNN 20220729 Target: CPU - Model: yolov4-tiny ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 20.66 |================== NCNN 20220729 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 15.37 |================== NCNN 20220729 Target: CPU - Model: regnety_400m ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 19.57 |================== NCNN 20220729 Target: CPU - Model: vision_transformer ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 149.35 |================= NCNN 20220729 Target: CPU - Model: FastestDet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 8.00 |=================== NCNN 20220729 Target: CPU - Model: mnasnet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 4.98 |=================== NCNN 20220729 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 8.54 |=================== NCNN 20220729 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2.46 |=================== NCNN 20220729 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 3.27 |=================== NCNN 20220729 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2.74 |=================== NCNN 20220729 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 8.71 |=================== NCNN 20220729 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1.81 |=================== NCNN 20220729 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.95 |=================== NCNN 20220729 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 4.79 |=================== NCNN 20220729 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2.74 |=================== NCNN 20220729 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1.98 |=================== NCNN 20220729 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.45 |=================== NCNN 20220729 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 10.09 |================== NCNN 20220729 Target: Vulkan GPU - Model: squeezenet_ssd ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.79 |=================== NCNN 20220729 Target: Vulkan GPU - Model: regnety_400m ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 4.67 |=================== NCNN 20220729 Target: Vulkan GPU - Model: vision_transformer ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 166.51 |================= NCNN 20220729 Target: Vulkan GPU - Model: FastestDet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 3.11 |=================== NCNN 20220729 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2.39 |=================== TNN 0.3 Target: CPU - Model: DenseNet ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2551.15 |================ TNN 0.3 Target: CPU - Model: MobileNet v2 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 255.67 |================= TNN 0.3 Target: CPU - Model: SqueezeNet v2 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 64.26 |================== TNN 0.3 Target: CPU - Model: SqueezeNet v1.1 ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 233.17 |================= OpenVINO 2022.3 Model: Face Detection FP16 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1548.99 |================ OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2312.14 |================ OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 2329.14 |================ OpenVINO 2022.3 Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 18.13 |================== OpenVINO 2022.3 Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1353.76 |================ OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 16.15 |================== OpenVINO 2022.3 Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 16.48 |================== OpenVINO 2022.3 Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 148.88 |================= OpenVINO 2022.3 Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 27.46 |================== OpenVINO 2022.3 Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 11.51 |================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1.07 |=================== OpenVINO 2022.3 Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 0.98 |=================== OpenCV 4.6 Test: DNN - Deep Neural Network ms < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 7037 |=================== Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 566.95 |================= Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 96.62 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 50.29 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 15.21 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 143.66 |================= Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 37.57 |================== Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 100.91 |================= Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 19.90 |================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 47.25 |================== Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 9.0813 |================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 70.34 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 13.09 |================== Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 439.43 |================= Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 68.47 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 138.73 |================= Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 25.66 |================== Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 568.03 |================= Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 96.81 |================== DeepSpeech 0.6 Acceleration: CPU Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 57.59 |================== R Benchmark Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 0.2012 |================= RNNoise 2020-06-28 Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 17.87 |================== ECP-CANDLE 0.4 Benchmark: P1B2 Seconds < Lower Is Better ECP-CANDLE 0.4 Benchmark: P3B1 Seconds < Lower Is Better ECP-CANDLE 0.4 Benchmark: P3B2 Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: KNN CAD Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 118.71 |================= Numenta Anomaly Benchmark 1.1 Detector: Relative Entropy Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 5.019 |================== Numenta Anomaly Benchmark 1.1 Detector: Earthgecko Skyline Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 73.58 |================== Numenta Anomaly Benchmark 1.1 Detector: Bayesian Changepoint Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Contextual Anomaly Detector OSE Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 43.18 |================== Mlpack Benchmark Benchmark: scikit_ica Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 50.86 |================== Mlpack Benchmark Benchmark: scikit_qda Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 37.36 |================== Mlpack Benchmark Benchmark: scikit_svm Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 19.96 |================== Mlpack Benchmark Benchmark: scikit_linearridgeregression Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 1.51 |=================== Scikit-Learn 1.1.3 Benchmark: MNIST Dataset Seconds < Lower Is Better Scikit-Learn 1.1.3 Benchmark: TSNE MNIST Dataset Seconds < Lower Is Better Scikit-Learn 1.1.3 Benchmark: Sparse Random Projections, 100 Iterations Seconds < Lower Is Better ASPEED - AMD Ryzen Threadripper PRO 3955WX 16-Cores . 159.01 |=================