minervatensorflowNOHT 2 x Intel Xeon Silver 4314 testing with a Intel M20NTP2SB (SE5C620.86B.0021.D02.2204261106 BIOS) and ASPEED on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2305031-NE-MINERVATE46 .
minervatensorflowNOHT Processor Motherboard Chipset Memory Disk Graphics Monitor Network OS Kernel Vulkan Compiler File-System Screen Resolution minerva sin HT 2 x Intel Xeon Silver 4314 @ 3.40GHz (32 Cores) Intel M20NTP2SB (SE5C620.86B.0021.D02.2204261106 BIOS) Intel Device 0998 128GB 2 x 1920GB KINGSTON SEDC1500M1920G + 2 x 6001GB Western Digital WD6003FFBX-6 ASPEED Smart Cable 2 x Intel I210 Ubuntu 22.04 5.15.0-71-generic (x86_64) 1.3.224 GCC 11.3.0 ext4 1024x768 OpenBenchmarking.org - Transparent Huge Pages: madvise - DEBUG=0 - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xd000389 - Python 3.10.6 - itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Mitigation of Clear buffers; SMT disabled + retbleed: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected
minervatensorflowNOHT tensorflow: CPU - 16 - VGG-16 tensorflow: CPU - 32 - VGG-16 tensorflow: CPU - 64 - VGG-16 tensorflow: CPU - 16 - AlexNet tensorflow: CPU - 256 - VGG-16 tensorflow: CPU - 32 - AlexNet tensorflow: CPU - 512 - VGG-16 tensorflow: CPU - 64 - AlexNet tensorflow: CPU - 256 - AlexNet tensorflow: CPU - 512 - AlexNet tensorflow: CPU - 16 - GoogLeNet tensorflow: CPU - 16 - ResNet-50 tensorflow: CPU - 32 - GoogLeNet tensorflow: CPU - 32 - ResNet-50 tensorflow: CPU - 64 - GoogLeNet tensorflow: CPU - 64 - ResNet-50 tensorflow: CPU - 256 - GoogLeNet tensorflow: CPU - 256 - ResNet-50 tensorflow: CPU - 512 - GoogLeNet tensorflow: CPU - 512 - ResNet-50 minerva sin HT 14.70 16.97 18.95 143.93 20.69 206.65 20.85 250.10 357.11 407.59 95.37 26.07 98.96 28.40 105.67 30.71 118.02 33.04 116.42 33.91 OpenBenchmarking.org
TensorFlow Device: CPU - Batch Size: 16 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: VGG-16 minerva sin HT 4 8 12 16 20 SE +/- 0.04, N = 3 14.70
TensorFlow Device: CPU - Batch Size: 32 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: VGG-16 minerva sin HT 4 8 12 16 20 SE +/- 0.21, N = 3 16.97
TensorFlow Device: CPU - Batch Size: 64 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: VGG-16 minerva sin HT 5 10 15 20 25 SE +/- 0.14, N = 3 18.95
TensorFlow Device: CPU - Batch Size: 16 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: AlexNet minerva sin HT 30 60 90 120 150 SE +/- 1.22, N = 3 143.93
TensorFlow Device: CPU - Batch Size: 256 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: VGG-16 minerva sin HT 5 10 15 20 25 SE +/- 0.26, N = 9 20.69
TensorFlow Device: CPU - Batch Size: 32 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: AlexNet minerva sin HT 50 100 150 200 250 SE +/- 0.98, N = 3 206.65
TensorFlow Device: CPU - Batch Size: 512 - Model: VGG-16 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: VGG-16 minerva sin HT 5 10 15 20 25 SE +/- 0.22, N = 9 20.85
TensorFlow Device: CPU - Batch Size: 64 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: AlexNet minerva sin HT 50 100 150 200 250 SE +/- 1.26, N = 3 250.10
TensorFlow Device: CPU - Batch Size: 256 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: AlexNet minerva sin HT 80 160 240 320 400 SE +/- 0.23, N = 3 357.11
TensorFlow Device: CPU - Batch Size: 512 - Model: AlexNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: AlexNet minerva sin HT 90 180 270 360 450 SE +/- 0.85, N = 3 407.59
TensorFlow Device: CPU - Batch Size: 16 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: GoogLeNet minerva sin HT 20 40 60 80 100 SE +/- 0.39, N = 3 95.37
TensorFlow Device: CPU - Batch Size: 16 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: ResNet-50 minerva sin HT 6 12 18 24 30 SE +/- 0.10, N = 3 26.07
TensorFlow Device: CPU - Batch Size: 32 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: GoogLeNet minerva sin HT 20 40 60 80 100 SE +/- 0.30, N = 3 98.96
TensorFlow Device: CPU - Batch Size: 32 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: ResNet-50 minerva sin HT 7 14 21 28 35 SE +/- 0.10, N = 3 28.40
TensorFlow Device: CPU - Batch Size: 64 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: GoogLeNet minerva sin HT 20 40 60 80 100 SE +/- 0.14, N = 3 105.67
TensorFlow Device: CPU - Batch Size: 64 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: ResNet-50 minerva sin HT 7 14 21 28 35 SE +/- 0.06, N = 3 30.71
TensorFlow Device: CPU - Batch Size: 256 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: GoogLeNet minerva sin HT 30 60 90 120 150 SE +/- 0.32, N = 3 118.02
TensorFlow Device: CPU - Batch Size: 256 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: ResNet-50 minerva sin HT 8 16 24 32 40 SE +/- 0.33, N = 6 33.04
TensorFlow Device: CPU - Batch Size: 512 - Model: GoogLeNet OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: GoogLeNet minerva sin HT 30 60 90 120 150 SE +/- 0.93, N = 3 116.42
TensorFlow Device: CPU - Batch Size: 512 - Model: ResNet-50 OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: ResNet-50 minerva sin HT 8 16 24 32 40 SE +/- 0.33, N = 3 33.91
Phoronix Test Suite v10.8.5