MBP M1 Max Machine Learning Apple M1 Max testing with a Apple MacBook Pro and Apple M1 Max on macOS 12.1 via the Phoronix Test Suite. MBP M1 Max Machine Learning: Processor: Apple M1 Max (10 Cores), Motherboard: Apple MacBook Pro, Memory: 64GB, Disk: 1859GB, Graphics: Apple M1 Max, Monitor: Color LCD OS: macOS 12.1, Kernel: 21.2.0 (arm64), OpenCL: OpenCL 1.2 (Nov 13 2021 00:45:09), Compiler: GCC 13.0.0 + Clang 13.0.0, File-System: APFS, Screen Resolution: 3456x2234 oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better oneDNN 2.1.2 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Numpy Benchmark Score > Higher Is Better DeepSpeech 0.6 Acceleration: CPU Seconds < Lower Is Better Mobile Neural Network 1.2 Model: mobilenetV3 ms < Lower Is Better MBP M1 Max Machine Learning . 9.152 |========================================== Mobile Neural Network 1.2 Model: squeezenetv1.1 ms < Lower Is Better MBP M1 Max Machine Learning . 7.274 |========================================== Mobile Neural Network 1.2 Model: resnet-v2-50 ms < Lower Is Better MBP M1 Max Machine Learning . 42.43 |========================================== Mobile Neural Network 1.2 Model: SqueezeNetV1.0 ms < Lower Is Better MBP M1 Max Machine Learning . 9.967 |========================================== Mobile Neural Network 1.2 Model: MobileNetV2_224 ms < Lower Is Better MBP M1 Max Machine Learning . 10.68 |========================================== Mobile Neural Network 1.2 Model: mobilenet-v1-1.0 ms < Lower Is Better MBP M1 Max Machine Learning . 8.205 |========================================== Mobile Neural Network 1.2 Model: inception-v3 ms < Lower Is Better MBP M1 Max Machine Learning . 58.25 |========================================== NCNN 20210720 Target: CPU - Model: mobilenet ms < Lower Is Better MBP M1 Max Machine Learning . 20.32 |========================================== NCNN 20210720 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better MBP M1 Max Machine Learning . 5.33 |=========================================== NCNN 20210720 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better MBP M1 Max Machine Learning . 4.36 |=========================================== NCNN 20210720 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better MBP M1 Max Machine Learning . 3.47 |=========================================== NCNN 20210720 Target: CPU - Model: mnasnet ms < Lower Is Better MBP M1 Max Machine Learning . 5.40 |=========================================== NCNN 20210720 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better MBP M1 Max Machine Learning . 8.69 |=========================================== NCNN 20210720 Target: CPU - Model: blazeface ms < Lower Is Better MBP M1 Max Machine Learning . 1.65 |=========================================== NCNN 20210720 Target: CPU - Model: googlenet ms < Lower Is Better MBP M1 Max Machine Learning . 24.96 |========================================== NCNN 20210720 Target: CPU - Model: vgg16 ms < Lower Is Better MBP M1 Max Machine Learning . 71.01 |========================================== NCNN 20210720 Target: CPU - Model: resnet18 ms < Lower Is Better MBP M1 Max Machine Learning . 16.82 |========================================== NCNN 20210720 Target: CPU - Model: alexnet ms < Lower Is Better MBP M1 Max Machine Learning . 29.93 |========================================== NCNN 20210720 Target: CPU - Model: resnet50 ms < Lower Is Better MBP M1 Max Machine Learning . 43.16 |========================================== NCNN 20210720 Target: CPU - Model: yolov4-tiny ms < Lower Is Better MBP M1 Max Machine Learning . 30.24 |========================================== NCNN 20210720 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better MBP M1 Max Machine Learning . 20.53 |========================================== NCNN 20210720 Target: CPU - Model: regnety_400m ms < Lower Is Better MBP M1 Max Machine Learning . 7.18 |=========================================== NCNN 20210720 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better MBP M1 Max Machine Learning . 20.30 |========================================== NCNN 20210720 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better MBP M1 Max Machine Learning . 5.30 |=========================================== NCNN 20210720 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better MBP M1 Max Machine Learning . 4.35 |=========================================== NCNN 20210720 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better MBP M1 Max Machine Learning . 3.46 |=========================================== NCNN 20210720 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better MBP M1 Max Machine Learning . 5.37 |=========================================== NCNN 20210720 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better MBP M1 Max Machine Learning . 8.71 |=========================================== NCNN 20210720 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better MBP M1 Max Machine Learning . 1.64 |=========================================== NCNN 20210720 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better MBP M1 Max Machine Learning . 24.9 |=========================================== NCNN 20210720 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better MBP M1 Max Machine Learning . 70.89 |========================================== NCNN 20210720 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better MBP M1 Max Machine Learning . 16.80 |========================================== NCNN 20210720 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better MBP M1 Max Machine Learning . 29.89 |========================================== NCNN 20210720 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better MBP M1 Max Machine Learning . 43.08 |========================================== NCNN 20210720 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better MBP M1 Max Machine Learning . 30.33 |========================================== NCNN 20210720 Target: Vulkan GPU - Model: squeezenet_ssd ms < Lower Is Better MBP M1 Max Machine Learning . 20.55 |========================================== NCNN 20210720 Target: Vulkan GPU - Model: regnety_400m ms < Lower Is Better MBP M1 Max Machine Learning . 7.19 |=========================================== Numenta Anomaly Benchmark 1.1 Detector: EXPoSE Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Relative Entropy Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Windowed Gaussian Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Earthgecko Skyline Seconds < Lower Is Better Numenta Anomaly Benchmark 1.1 Detector: Bayesian Changepoint Seconds < Lower Is Better AI Benchmark Alpha 0.1.2 Score > Higher Is Better