eptc-7f32 AMD EPYC 7F32 8-Core testing with a ASRockRack EPYCD8 (P2.40 BIOS) and ASPEED on Debian 11 via the Phoronix Test Suite. EPYC 7F32: Processor: AMD EPYC 7F32 8-Core @ 3.70GHz (8 Cores / 16 Threads), Motherboard: ASRockRack EPYCD8 (P2.40 BIOS), Chipset: AMD Starship/Matisse, Memory: 28GB, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: ASPEED, Network: 2 x Intel I350 OS: Debian 11, Kernel: 5.10.0-10-amd64 (x86_64), Desktop: GNOME Shell 3.38.6, Display Server: X Server, Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768 AMD EPYC 7F32: Processor: AMD EPYC 7F32 8-Core @ 3.70GHz (8 Cores / 16 Threads), Motherboard: ASRockRack EPYCD8 (P2.40 BIOS), Chipset: AMD Starship/Matisse, Memory: 28GB, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: ASPEED, Network: 2 x Intel I350 OS: Debian 11, Kernel: 5.10.0-10-amd64 (x86_64), Desktop: GNOME Shell 3.38.6, Display Server: X Server, Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768 7F32: Processor: AMD EPYC 7F32 8-Core @ 3.70GHz (8 Cores / 16 Threads), Motherboard: ASRockRack EPYCD8 (P2.40 BIOS), Chipset: AMD Starship/Matisse, Memory: 28GB, Disk: Samsung SSD 970 EVO Plus 250GB, Graphics: ASPEED, Network: 2 x Intel I350 OS: Debian 11, Kernel: 5.10.0-10-amd64 (x86_64), Desktop: GNOME Shell 3.38.6, Display Server: X Server, Compiler: GCC 10.2.1 20210110, File-System: ext4, Screen Resolution: 1024x768 miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 Billion Interactions/s > Higher Is Better EPYC 7F32 ..... 10.83 |======================================================== AMD EPYC 7F32 . 10.78 |======================================================== 7F32 .......... 10.77 |======================================================== miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 Billion Interactions/s > Higher Is Better EPYC 7F32 ..... 10.84 |======================================================== AMD EPYC 7F32 . 10.80 |======================================================== 7F32 .......... 10.84 |======================================================== Stress-NG 0.14.06 Test: MMAP Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 141.82 |====================================================== 7F32 .......... 144.76 |======================================================= Stress-NG 0.14.06 Test: NUMA Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 236.71 |======================================================= 7F32 .......... 236.87 |======================================================= Stress-NG 0.14.06 Test: Futex Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 2310980.46 |================================================= 7F32 .......... 2404426.48 |=================================================== Stress-NG 0.14.06 Test: MEMFD Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 371.54 |===================================================== 7F32 .......... 385.73 |======================================================= Stress-NG 0.14.06 Test: Mutex Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 5679683.10 |=================================================== 7F32 .......... 5617446.16 |================================================== Stress-NG 0.14.06 Test: Atomic Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 392425.59 |==================================================== 7F32 .......... 392155.78 |==================================================== Stress-NG 0.14.06 Test: Crypto Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 13693.66 |===================================================== 7F32 .......... 13609.36 |===================================================== Stress-NG 0.14.06 Test: Malloc Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 8923251.96 |=================================================== 7F32 .......... 8973004.75 |=================================================== Stress-NG 0.14.06 Test: Forking Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 22867.22 |=================================================== 7F32 .......... 23802.41 |===================================================== Stress-NG 0.14.06 Test: IO_uring Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 4364.73 |===================================================== 7F32 .......... 4451.96 |====================================================== Stress-NG 0.14.06 Test: SENDFILE Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 150426.21 |==================================================== 7F32 .......... 149917.15 |==================================================== Stress-NG 0.14.06 Test: CPU Cache Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 85.33 |================================================= 7F32 .......... 96.63 |======================================================== Stress-NG 0.14.06 Test: CPU Stress Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 18122.93 |=================================================== 7F32 .......... 18710.29 |===================================================== Stress-NG 0.14.06 Test: Semaphores Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 1194194.95 |=================================================== 7F32 .......... 1192572.08 |=================================================== Stress-NG 0.14.06 Test: Matrix Math Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 35043.73 |==================================================== 7F32 .......... 35439.82 |===================================================== Stress-NG 0.14.06 Test: Vector Math Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 39578.06 |===================================================== 7F32 .......... 39495.75 |===================================================== Stress-NG 0.14.06 Test: Memory Copying Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 1918.98 |==================================================== 7F32 .......... 1983.24 |====================================================== Stress-NG 0.14.06 Test: Socket Activity Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 5664.93 |===================================================== 7F32 .......... 5728.29 |====================================================== Stress-NG 0.14.06 Test: Context Switching Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 5247399.0 |==================================================== 7F32 .......... 5036770.9 |================================================== Stress-NG 0.14.06 Test: Glibc C String Functions Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 1327261.30 |=================================================== 7F32 .......... 1299519.63 |================================================== Stress-NG 0.14.06 Test: Glibc Qsort Data Sorting Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 134.03 |======================================================= 7F32 .......... 132.57 |====================================================== Stress-NG 0.14.06 Test: System V Message Passing Bogo Ops/s > Higher Is Better AMD EPYC 7F32 . 3150570.51 |=================================================== 7F32 .......... 3167586.04 |=================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM eNb Mb/s > Higher Is Better EPYC 7F32 ..... 328.5 |======================================================== AMD EPYC 7F32 . 327.5 |======================================================== 7F32 .......... 327.7 |======================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM eNb Mb/s > Higher Is Better EPYC 7F32 ..... 328.3 |======================================================== AMD EPYC 7F32 . 329.5 |======================================================== 7F32 .......... 328.8 |======================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM eNb Mb/s > Higher Is Better EPYC 7F32 ..... 353.7 |======================================================== AMD EPYC 7F32 . 355.1 |======================================================== 7F32 .......... 354.9 |======================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM eNb Mb/s > Higher Is Better EPYC 7F32 ..... 353.7 |======================================================== AMD EPYC 7F32 . 354.0 |======================================================== 7F32 .......... 354.0 |======================================================== srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM eNb Mb/s > Higher Is Better EPYC 7F32 ..... 95.1 |========================================================= AMD EPYC 7F32 . 95.3 |========================================================= 7F32 .......... 95.4 |========================================================= nekRS 22.0 Input: TurboPipe Periodic FLOP/s > Higher Is Better FFmpeg 5.1.2 Encoder: libx264 - Scenario: Live FPS > Higher Is Better EPYC 7F32 ..... 177.00 |====================================================== AMD EPYC 7F32 . 179.34 |======================================================= 7F32 .......... 176.34 |====================================================== FFmpeg 5.1.2 Encoder: libx265 - Scenario: Live FPS > Higher Is Better EPYC 7F32 ..... 73.77 |======================================================== AMD EPYC 7F32 . 74.10 |======================================================== 7F32 .......... 73.29 |======================================================= FFmpeg 5.1.2 Encoder: libx264 - Scenario: Upload FPS > Higher Is Better EPYC 7F32 ..... 11.09 |======================================================== AMD EPYC 7F32 . 11.07 |======================================================== 7F32 .......... 11.03 |======================================================== FFmpeg 5.1.2 Encoder: libx265 - Scenario: Upload FPS > Higher Is Better EPYC 7F32 ..... 14.32 |======================================================== AMD EPYC 7F32 . 14.38 |======================================================== 7F32 .......... 14.32 |======================================================== FFmpeg 5.1.2 Encoder: libx264 - Scenario: Platform FPS > Higher Is Better EPYC 7F32 ..... 42.05 |======================================================== AMD EPYC 7F32 . 42.14 |======================================================== 7F32 .......... 42.03 |======================================================== FFmpeg 5.1.2 Encoder: libx265 - Scenario: Platform FPS > Higher Is Better EPYC 7F32 ..... 29.88 |======================================================== AMD EPYC 7F32 . 30.04 |======================================================== 7F32 .......... 29.85 |======================================================== FFmpeg 5.1.2 Encoder: libx264 - Scenario: Video On Demand FPS > Higher Is Better EPYC 7F32 ..... 41.93 |======================================================== AMD EPYC 7F32 . 41.96 |======================================================== 7F32 .......... 41.94 |======================================================== FFmpeg 5.1.2 Encoder: libx265 - Scenario: Video On Demand FPS > Higher Is Better EPYC 7F32 ..... 29.88 |======================================================== AMD EPYC 7F32 . 29.97 |======================================================== 7F32 .......... 29.86 |======================================================== OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 2.03 |========================================================= 7F32 .......... 2.04 |========================================================= OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 1.55 |======================================================= 7F32 .......... 1.60 |========================================================= OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 1.53 |====================================================== 7F32 .......... 1.62 |========================================================= OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 162.30 |====================================================== 7F32 .......... 165.72 |======================================================= OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 2.71 |========================================================= 7F32 .......... 2.73 |========================================================= OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 219.40 |======================================================= 7F32 .......... 220.62 |======================================================= OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 212.74 |====================================================== 7F32 .......... 215.66 |======================================================= OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 24.00 |====================================================== 7F32 .......... 24.91 |======================================================== OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 267.05 |======================================================= 7F32 .......... 268.87 |======================================================= OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 224.93 |===================================================== 7F32 .......... 232.94 |======================================================= OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 5762.94 |====================================================== 7F32 .......... 5811.67 |====================================================== OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU FPS > Higher Is Better AMD EPYC 7F32 . 6432.39 |====================================================== 7F32 .......... 6443.59 |====================================================== Natron 2.4.3 Input: Spaceship FPS > Higher Is Better AMD EPYC 7F32 . 2.1 |============================================ 7F32 .......... 2.8 |========================================================== AOM AV1 3.5 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better EPYC 7F32 ..... 0.19 |========================================================= AMD EPYC 7F32 . 0.19 |========================================================= 7F32 .......... 0.19 |========================================================= AOM AV1 3.5 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better EPYC 7F32 ..... 5.56 |======================================================== AMD EPYC 7F32 . 5.67 |========================================================= 7F32 .......... 5.51 |======================================================= AOM AV1 3.5 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better EPYC 7F32 ..... 20.97 |======================================================= AMD EPYC 7F32 . 21.44 |======================================================== 7F32 .......... 21.33 |======================================================== AOM AV1 3.5 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 4K Frames Per Second > Higher Is Better EPYC 7F32 ..... 9.74 |======================================================== AMD EPYC 7F32 . 9.89 |========================================================= 7F32 .......... 9.45 |====================================================== AOM AV1 3.5 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better EPYC 7F32 ..... 30.22 |======================================================= AMD EPYC 7F32 . 30.97 |======================================================== 7F32 .......... 30.82 |======================================================== AOM AV1 3.5 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better EPYC 7F32 ..... 41.56 |====================================================== AMD EPYC 7F32 . 42.81 |======================================================== 7F32 .......... 42.42 |======================================================= AOM AV1 3.5 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 4K Frames Per Second > Higher Is Better EPYC 7F32 ..... 42.08 |====================================================== AMD EPYC 7F32 . 43.34 |======================================================== 7F32 .......... 42.49 |======================================================= AOM AV1 3.5 Encoder Mode: Speed 0 Two-Pass - Input: Bosphorus 1080p Frames Per Second > Higher Is Better EPYC 7F32 ..... 0.54 |========================================================= AMD EPYC 7F32 . 0.54 |========================================================= 7F32 .......... 0.54 |========================================================= AOM AV1 3.5 Encoder Mode: Speed 4 Two-Pass - Input: Bosphorus 1080p Frames Per Second > Higher Is Better EPYC 7F32 ..... 12.26 |======================================================= AMD EPYC 7F32 . 12.51 |======================================================== 7F32 .......... 12.34 |======================================================= AOM AV1 3.5 Encoder Mode: Speed 6 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better EPYC 7F32 ..... 43.34 |======================================================== AMD EPYC 7F32 . 42.43 |======================================================= 7F32 .......... 42.89 |======================================================= AOM AV1 3.5 Encoder Mode: Speed 6 Two-Pass - Input: Bosphorus 1080p Frames Per Second > Higher Is Better EPYC 7F32 ..... 28.29 |======================================================== AMD EPYC 7F32 . 28.46 |======================================================== 7F32 .......... 27.87 |======================================================= AOM AV1 3.5 Encoder Mode: Speed 8 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better EPYC 7F32 ..... 75.10 |======================================================= AMD EPYC 7F32 . 76.92 |======================================================== 7F32 .......... 76.16 |======================================================= AOM AV1 3.5 Encoder Mode: Speed 9 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better EPYC 7F32 ..... 97.35 |===================================================== AMD EPYC 7F32 . 100.17 |======================================================= 7F32 .......... 99.91 |======================================================= AOM AV1 3.5 Encoder Mode: Speed 10 Realtime - Input: Bosphorus 1080p Frames Per Second > Higher Is Better EPYC 7F32 ..... 107.35 |======================================================= AMD EPYC 7F32 . 102.07 |==================================================== 7F32 .......... 108.32 |======================================================= miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM1 GFInst/s > Higher Is Better EPYC 7F32 ..... 270.67 |======================================================= AMD EPYC 7F32 . 269.52 |======================================================= 7F32 .......... 269.32 |======================================================= miniBUDE 20210901 Implementation: OpenMP - Input Deck: BM2 GFInst/s > Higher Is Better EPYC 7F32 ..... 271.09 |======================================================= AMD EPYC 7F32 . 270.07 |======================================================= 7F32 .......... 270.91 |======================================================= Xmrig 6.18.1 Variant: Monero - Hash Count: 1M H/s > Higher Is Better EPYC 7F32 ..... 7090.0 |===================================================== AMD EPYC 7F32 . 7304.0 |======================================================= 7F32 .......... 7299.2 |======================================================= Xmrig 6.18.1 Variant: Wownero - Hash Count: 1M H/s > Higher Is Better EPYC 7F32 ..... 7488.2 |====================================================== AMD EPYC 7F32 . 7636.1 |======================================================= 7F32 .......... 7618.9 |======================================================= TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet images/sec > Higher Is Better EPYC 7F32 . 53.09 |============================================================ 7F32 ...... 50.79 |========================================================= TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: AlexNet images/sec > Higher Is Better EPYC 7F32 . 65.36 |============================================================ 7F32 ...... 59.61 |======================================================= TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: AlexNet images/sec > Higher Is Better EPYC 7F32 . 74.80 |============================================================ 7F32 ...... 70.71 |========================================================= TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet images/sec > Higher Is Better EPYC 7F32 . 82.48 |============================================================ 7F32 ...... 78.62 |========================================================= TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet images/sec > Higher Is Better EPYC 7F32 . 83.98 |============================================================ 7F32 ...... 80.98 |========================================================== TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet images/sec > Higher Is Better EPYC 7F32 . 32.89 |============================================================ 7F32 ...... 29.73 |====================================================== TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 images/sec > Higher Is Better EPYC 7F32 . 9.98 |============================================================= 7F32 ...... 9.12 |======================================================== TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: GoogLeNet images/sec > Higher Is Better EPYC 7F32 . 32.58 |============================================================ 7F32 ...... 30.75 |========================================================= TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: ResNet-50 images/sec > Higher Is Better EPYC 7F32 . 10.22 |============================================================ 7F32 ...... 9.40 |======================================================= TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: GoogLeNet images/sec > Higher Is Better EPYC 7F32 . 32.75 |============================================================ 7F32 ...... 31.39 |========================================================== TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: ResNet-50 images/sec > Higher Is Better EPYC 7F32 . 11.08 |============================================================ 7F32 ...... 10.36 |======================================================== TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet images/sec > Higher Is Better EPYC 7F32 . 34.99 |============================================================ 7F32 ...... 33.15 |========================================================= TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 images/sec > Higher Is Better EPYC 7F32 . 12.67 |============================================================ 7F32 ...... 12.57 |============================================================ Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 6.4357 |======================================================= 7F32 .......... 6.3025 |====================================================== Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 5.3725 |======================================================= 7F32 .......... 5.1633 |===================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 22.60 |======================================================== 7F32 .......... 22.57 |======================================================== Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 13.11 |======================================================== 7F32 .......... 12.90 |======================================================= Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 36.80 |======================================================== 7F32 .......... 36.20 |======================================================= Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 26.98 |======================================================== 7F32 .......... 26.71 |======================================================= Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 70.02 |======================================================== 7F32 .......... 69.48 |======================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 50.80 |======================================================== 7F32 .......... 49.66 |======================================================= Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 49.91 |======================================================== 7F32 .......... 49.62 |======================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 36.76 |======================================================== 7F32 .......... 35.51 |====================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 25.22 |======================================================== 7F32 .......... 25.12 |======================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 18.22 |======================================================== 7F32 .......... 18.20 |======================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 6.3581 |======================================================= 7F32 .......... 6.3119 |======================================================= Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream items/sec > Higher Is Better AMD EPYC 7F32 . 5.3593 |======================================================= 7F32 .......... 5.0800 |==================================================== GraphicsMagick 1.3.38 Operation: Swirl Iterations Per Minute > Higher Is Better EPYC 7F32 ..... 444 |========================================================== AMD EPYC 7F32 . 443 |========================================================== 7F32 .......... 444 |========================================================== GraphicsMagick 1.3.38 Operation: Rotate Iterations Per Minute > Higher Is Better EPYC 7F32 ..... 739 |========================================================== AMD EPYC 7F32 . 739 |========================================================== 7F32 .......... 729 |========================================================= GraphicsMagick 1.3.38 Operation: Sharpen Iterations Per Minute > Higher Is Better EPYC 7F32 ..... 129 |========================================================== AMD EPYC 7F32 . 130 |========================================================== 7F32 .......... 130 |========================================================== GraphicsMagick 1.3.38 Operation: Enhanced Iterations Per Minute > Higher Is Better EPYC 7F32 ..... 205 |========================================================== AMD EPYC 7F32 . 206 |========================================================== 7F32 .......... 206 |========================================================== GraphicsMagick 1.3.38 Operation: Resizing Iterations Per Minute > Higher Is Better EPYC 7F32 ..... 1028 |======================================================== AMD EPYC 7F32 . 1046 |========================================================= 7F32 .......... 1049 |========================================================= GraphicsMagick 1.3.38 Operation: Noise-Gaussian Iterations Per Minute > Higher Is Better EPYC 7F32 ..... 271 |========================================================== AMD EPYC 7F32 . 271 |========================================================== 7F32 .......... 272 |========================================================== GraphicsMagick 1.3.38 Operation: HWB Color Space Iterations Per Minute > Higher Is Better EPYC 7F32 ..... 1184 |======================================================= AMD EPYC 7F32 . 1195 |======================================================== 7F32 .......... 1226 |========================================================= Cpuminer-Opt 3.20.3 Algorithm: Magi kH/s > Higher Is Better EPYC 7F32 ..... 413.80 |====================================================== AMD EPYC 7F32 . 423.63 |======================================================= 7F32 .......... 422.47 |======================================================= Cpuminer-Opt 3.20.3 Algorithm: x25x kH/s > Higher Is Better EPYC 7F32 ..... 401.99 |====================================================== AMD EPYC 7F32 . 387.05 |==================================================== 7F32 .......... 410.38 |======================================================= Cpuminer-Opt 3.20.3 Algorithm: scrypt kH/s > Higher Is Better EPYC 7F32 ..... 145.88 |======================================================= AMD EPYC 7F32 . 146.09 |======================================================= 7F32 .......... 145.69 |======================================================= Cpuminer-Opt 3.20.3 Algorithm: Deepcoin kH/s > Higher Is Better EPYC 7F32 ..... 7494.50 |====================================================== AMD EPYC 7F32 . 7487.49 |====================================================== 7F32 .......... 7488.34 |====================================================== Cpuminer-Opt 3.20.3 Algorithm: Ringcoin kH/s > Higher Is Better EPYC 7F32 ..... 1566.83 |==================================================== AMD EPYC 7F32 . 1612.04 |====================================================== 7F32 .......... 1575.59 |===================================================== Cpuminer-Opt 3.20.3 Algorithm: Blake-2 S kH/s > Higher Is Better EPYC 7F32 ..... 349500 |======================================================= AMD EPYC 7F32 . 348760 |======================================================= 7F32 .......... 324270 |=================================================== Cpuminer-Opt 3.20.3 Algorithm: Garlicoin kH/s > Higher Is Better EPYC 7F32 ..... 2139.28 |====================================================== AMD EPYC 7F32 . 2123.04 |===================================================== 7F32 .......... 2147.80 |====================================================== Cpuminer-Opt 3.20.3 Algorithm: Skeincoin kH/s > Higher Is Better EPYC 7F32 ..... 68290 |======================================================== AMD EPYC 7F32 . 68130 |======================================================== 7F32 .......... 68400 |======================================================== Cpuminer-Opt 3.20.3 Algorithm: Myriad-Groestl kH/s > Higher Is Better EPYC 7F32 ..... 12640 |======================================================== AMD EPYC 7F32 . 12640 |======================================================== 7F32 .......... 12630 |======================================================== Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits kH/s > Higher Is Better EPYC 7F32 ..... 20140 |======================================================== AMD EPYC 7F32 . 20260 |======================================================== 7F32 .......... 20250 |======================================================== Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite kH/s > Higher Is Better EPYC 7F32 ..... 66230 |======================================================== AMD EPYC 7F32 . 66230 |======================================================== 7F32 .......... 66260 |======================================================== Cpuminer-Opt 3.20.3 Algorithm: Triple SHA-256, Onecoin kH/s > Higher Is Better EPYC 7F32 ..... 132280 |======================================================= AMD EPYC 7F32 . 132340 |======================================================= 7F32 .......... 132610 |======================================================= C-Blosc 2.3 Test: blosclz shuffle MB/s > Higher Is Better EPYC 7F32 ..... 15057.9 |====================================================== AMD EPYC 7F32 . 15048.7 |====================================================== 7F32 .......... 14437.4 |==================================================== C-Blosc 2.3 Test: blosclz bitshuffle MB/s > Higher Is Better EPYC 7F32 ..... 5662.8 |======================================================= AMD EPYC 7F32 . 5399.4 |==================================================== 7F32 .......... 4579.4 |============================================ SMHasher 2022-08-22 Hash: wyhash MiB/sec > Higher Is Better EPYC 7F32 ..... 21044.04 |===================================================== AMD EPYC 7F32 . 21040.94 |===================================================== 7F32 .......... 21041.15 |===================================================== SMHasher 2022-08-22 Hash: SHA3-256 MiB/sec > Higher Is Better EPYC 7F32 ..... 136.17 |======================================================= AMD EPYC 7F32 . 136.22 |======================================================= 7F32 .......... 136.24 |======================================================= SMHasher 2022-08-22 Hash: Spooky32 MiB/sec > Higher Is Better EPYC 7F32 ..... 13214.70 |===================================================== AMD EPYC 7F32 . 13216.41 |===================================================== 7F32 .......... 13220.33 |===================================================== SMHasher 2022-08-22 Hash: fasthash32 MiB/sec > Higher Is Better EPYC 7F32 ..... 6027.75 |====================================================== AMD EPYC 7F32 . 6027.73 |====================================================== 7F32 .......... 6027.12 |====================================================== SMHasher 2022-08-22 Hash: FarmHash128 MiB/sec > Higher Is Better EPYC 7F32 ..... 14311.97 |===================================================== AMD EPYC 7F32 . 14312.80 |===================================================== 7F32 .......... 14307.94 |===================================================== SMHasher 2022-08-22 Hash: t1ha2_atonce MiB/sec > Higher Is Better EPYC 7F32 ..... 14595.36 |===================================================== AMD EPYC 7F32 . 14583.40 |===================================================== 7F32 .......... 14594.36 |===================================================== SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX MiB/sec > Higher Is Better EPYC 7F32 ..... 24494.95 |===================================================== AMD EPYC 7F32 . 24384.85 |===================================================== 7F32 .......... 24497.14 |===================================================== SMHasher 2022-08-22 Hash: t1ha0_aes_avx2 x86_64 MiB/sec > Higher Is Better EPYC 7F32 ..... 59489.50 |==================================================== AMD EPYC 7F32 . 59287.09 |==================================================== 7F32 .......... 60752.57 |===================================================== SMHasher 2022-08-22 Hash: MeowHash x86_64 AES-NI MiB/sec > Higher Is Better EPYC 7F32 ..... 34313.46 |===================================================== AMD EPYC 7F32 . 34206.07 |===================================================== 7F32 .......... 34310.93 |===================================================== 7-Zip Compression 22.01 Test: Compression Rating MIPS > Higher Is Better EPYC 7F32 ..... 73076 |======================================================= AMD EPYC 7F32 . 74973 |======================================================== 7F32 .......... 71377 |===================================================== 7-Zip Compression 22.01 Test: Decompression Rating MIPS > Higher Is Better EPYC 7F32 ..... 58662 |======================================================== AMD EPYC 7F32 . 58704 |======================================================== 7F32 .......... 58881 |======================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 80 MP/s > Higher Is Better EPYC 7F32 ..... 8.44 |======================================================= AMD EPYC 7F32 . 8.71 |========================================================= 7F32 .......... 8.63 |======================================================== JPEG XL libjxl 0.7 Input: PNG - Quality: 90 MP/s > Higher Is Better EPYC 7F32 ..... 8.26 |======================================================= AMD EPYC 7F32 . 8.54 |========================================================= 7F32 .......... 8.52 |========================================================= JPEG XL libjxl 0.7 Input: JPEG - Quality: 80 MP/s > Higher Is Better EPYC 7F32 ..... 8.15 |======================================================= AMD EPYC 7F32 . 8.43 |========================================================= 7F32 .......... 8.35 |======================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 90 MP/s > Higher Is Better EPYC 7F32 ..... 8.03 |======================================================= AMD EPYC 7F32 . 8.25 |========================================================= 7F32 .......... 8.22 |========================================================= JPEG XL libjxl 0.7 Input: PNG - Quality: 100 MP/s > Higher Is Better EPYC 7F32 ..... 0.59 |========================================================= AMD EPYC 7F32 . 0.59 |========================================================= 7F32 .......... 0.58 |======================================================== JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 MP/s > Higher Is Better EPYC 7F32 ..... 0.58 |========================================================= AMD EPYC 7F32 . 0.58 |========================================================= 7F32 .......... 0.58 |========================================================= JPEG XL Decoding libjxl 0.7 CPU Threads: 1 MP/s > Higher Is Better EPYC 7F32 ..... 43.36 |======================================================== AMD EPYC 7F32 . 43.72 |======================================================== 7F32 .......... 43.24 |======================================================= JPEG XL Decoding libjxl 0.7 CPU Threads: All MP/s > Higher Is Better EPYC 7F32 ..... 198.76 |============================================ AMD EPYC 7F32 . 246.32 |======================================================= 7F32 .......... 222.05 |================================================== WebP Image Encode 1.2.4 Encode Settings: Default MP/s > Higher Is Better EPYC 7F32 ..... 15.80 |======================================================== AMD EPYC 7F32 . 15.83 |======================================================== 7F32 .......... 15.81 |======================================================== WebP Image Encode 1.2.4 Encode Settings: Quality 100 MP/s > Higher Is Better EPYC 7F32 ..... 9.90 |========================================================= AMD EPYC 7F32 . 9.93 |========================================================= 7F32 .......... 9.92 |========================================================= WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless MP/s > Higher Is Better EPYC 7F32 ..... 1.46 |========================================================= AMD EPYC 7F32 . 1.46 |========================================================= 7F32 .......... 1.45 |========================================================= WebP Image Encode 1.2.4 Encode Settings: Quality 100, Highest Compression MP/s > Higher Is Better EPYC 7F32 ..... 3.18 |========================================================= AMD EPYC 7F32 . 3.18 |========================================================= 7F32 .......... 3.19 |========================================================= WebP Image Encode 1.2.4 Encode Settings: Quality 100, Lossless, Highest Compression MP/s > Higher Is Better EPYC 7F32 ..... 0.58 |========================================================= AMD EPYC 7F32 . 0.58 |========================================================= 7F32 .......... 0.58 |========================================================= WebP2 Image Encode 20220823 Encode Settings: Default MP/s > Higher Is Better EPYC 7F32 ..... 6.29 |========================================================= AMD EPYC 7F32 . 6.22 |======================================================== 7F32 .......... 6.25 |========================================================= WebP2 Image Encode 20220823 Encode Settings: Quality 75, Compression Effort 7 MP/s > Higher Is Better EPYC 7F32 ..... 0.12 |========================================================= AMD EPYC 7F32 . 0.12 |========================================================= 7F32 .......... 0.12 |========================================================= WebP2 Image Encode 20220823 Encode Settings: Quality 95, Compression Effort 7 MP/s > Higher Is Better EPYC 7F32 ..... 0.05 |========================================================= AMD EPYC 7F32 . 0.05 |========================================================= 7F32 .......... 0.05 |========================================================= WebP2 Image Encode 20220823 Encode Settings: Quality 100, Compression Effort 5 MP/s > Higher Is Better EPYC 7F32 ..... 3.25 |========================================================= AMD EPYC 7F32 . 3.25 |========================================================= 7F32 .......... 3.25 |========================================================= WebP2 Image Encode 20220823 Encode Settings: Quality 100, Lossless Compression MP/s > Higher Is Better EPYC 7F32 ..... 0.01 |========================================================= AMD EPYC 7F32 . 0.01 |========================================================= 7F32 .......... 0.01 |========================================================= Facebook RocksDB 7.5.3 Test: Random Read Op/s > Higher Is Better AMD EPYC 7F32 . 39007583 |===================================================== 7F32 .......... 38208038 |==================================================== Facebook RocksDB 7.5.3 Test: Update Random Op/s > Higher Is Better AMD EPYC 7F32 . 352075 |======================================================= 7F32 .......... 352648 |======================================================= Facebook RocksDB 7.5.3 Test: Read While Writing Op/s > Higher Is Better AMD EPYC 7F32 . 1565360 |====================================================== 7F32 .......... 1527948 |===================================================== Facebook RocksDB 7.5.3 Test: Read Random Write Random Op/s > Higher Is Better AMD EPYC 7F32 . 1196904 |====================================================== 7F32 .......... 1195887 |====================================================== nginx 1.23.2 Connections: 1 Requests Per Second > Higher Is Better nginx 1.23.2 Connections: 20 Requests Per Second > Higher Is Better AMD EPYC 7F32 . 46605.09 |===================================================== 7F32 .......... 46953.57 |===================================================== nginx 1.23.2 Connections: 100 Requests Per Second > Higher Is Better AMD EPYC 7F32 . 51130.85 |===================================================== 7F32 .......... 50822.30 |===================================================== nginx 1.23.2 Connections: 200 Requests Per Second > Higher Is Better AMD EPYC 7F32 . 51950.16 |===================================================== 7F32 .......... 52189.35 |===================================================== nginx 1.23.2 Connections: 500 Requests Per Second > Higher Is Better AMD EPYC 7F32 . 52055.66 |==================================================== 7F32 .......... 52630.51 |===================================================== nginx 1.23.2 Connections: 1000 Requests Per Second > Higher Is Better AMD EPYC 7F32 . 50516.45 |==================================================== 7F32 .......... 51272.35 |===================================================== nginx 1.23.2 Connections: 4000 Requests Per Second > Higher Is Better srsRAN 22.04.1 Test: OFDM_Test Samples / Second > Higher Is Better EPYC 7F32 ..... 115600000 |==================================================== AMD EPYC 7F32 . 116100000 |==================================================== 7F32 .......... 115900000 |==================================================== spaCy 3.4.1 Model: en_core_web_lg tokens/sec > Higher Is Better AMD EPYC 7F32 . 11288 |======================================================== 7F32 .......... 11197 |======================================================== spaCy 3.4.1 Model: en_core_web_trf tokens/sec > Higher Is Better AMD EPYC 7F32 . 618 |========================================================= 7F32 .......... 632 |========================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM UE Mb/s > Higher Is Better EPYC 7F32 ..... 133.3 |======================================================== AMD EPYC 7F32 . 133.4 |======================================================== 7F32 .......... 132.6 |======================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM UE Mb/s > Higher Is Better EPYC 7F32 ..... 144.6 |======================================================== AMD EPYC 7F32 . 144.4 |======================================================== 7F32 .......... 143.3 |======================================================= srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM UE Mb/s > Higher Is Better EPYC 7F32 ..... 143.3 |======================================================== AMD EPYC 7F32 . 143.3 |======================================================== 7F32 .......... 142.5 |======================================================== srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM UE Mb/s > Higher Is Better EPYC 7F32 ..... 152.3 |======================================================== AMD EPYC 7F32 . 152.5 |======================================================== 7F32 .......... 151.5 |======================================================== srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM UE Mb/s > Higher Is Better EPYC 7F32 ..... 53.5 |========================================================= AMD EPYC 7F32 . 53.6 |========================================================= 7F32 .......... 53.6 |========================================================= BRL-CAD 7.32.6 VGR Performance Metric VGR Performance Metric > Higher Is Better AMD EPYC 7F32 . 124747 |======================================================= 7F32 .......... 125073 |======================================================= SMHasher 2022-08-22 Hash: wyhash cycles/hash < Lower Is Better EPYC 7F32 ..... 28.39 |======================================================== AMD EPYC 7F32 . 28.39 |======================================================== 7F32 .......... 28.39 |======================================================== SMHasher 2022-08-22 Hash: SHA3-256 cycles/hash < Lower Is Better EPYC 7F32 ..... 2843.50 |====================================================== AMD EPYC 7F32 . 2848.54 |====================================================== 7F32 .......... 2840.32 |====================================================== SMHasher 2022-08-22 Hash: Spooky32 cycles/hash < Lower Is Better EPYC 7F32 ..... 56.22 |======================================================== AMD EPYC 7F32 . 55.92 |======================================================== 7F32 .......... 56.14 |======================================================== SMHasher 2022-08-22 Hash: fasthash32 cycles/hash < Lower Is Better EPYC 7F32 ..... 40.68 |======================================================== AMD EPYC 7F32 . 40.68 |======================================================== 7F32 .......... 40.69 |======================================================== SMHasher 2022-08-22 Hash: FarmHash128 cycles/hash < Lower Is Better EPYC 7F32 ..... 70.29 |======================================================== AMD EPYC 7F32 . 70.29 |======================================================== 7F32 .......... 70.39 |======================================================== SMHasher 2022-08-22 Hash: t1ha2_atonce cycles/hash < Lower Is Better EPYC 7F32 ..... 38.50 |======================================================== AMD EPYC 7F32 . 38.50 |======================================================== 7F32 .......... 38.50 |======================================================== SMHasher 2022-08-22 Hash: FarmHash32 x86_64 AVX cycles/hash < Lower Is Better EPYC 7F32 ..... 47.68 |======================================================== AMD EPYC 7F32 . 47.68 |======================================================== 7F32 .......... 47.68 |======================================================== SMHasher 2022-08-22 Hash: t1ha0_aes_avx2 x86_64 cycles/hash < Lower Is Better EPYC 7F32 ..... 37.77 |======================================================== AMD EPYC 7F32 . 37.77 |======================================================== 7F32 .......... 37.77 |======================================================== SMHasher 2022-08-22 Hash: MeowHash x86_64 AES-NI cycles/hash < Lower Is Better EPYC 7F32 ..... 63.12 |======================================================== AMD EPYC 7F32 . 63.07 |======================================================== 7F32 .......... 63.11 |======================================================== oneDNN 2.7 Harness: IP Shapes 1D - Data Type: f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 ..... 3.48079 |====================================================== AMD EPYC 7F32 . 3.49229 |====================================================== 7F32 .......... 3.48771 |====================================================== oneDNN 2.7 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 ..... 8.67144 |======================================== AMD EPYC 7F32 . 7.35671 |================================== 7F32 .......... 11.36500 |===================================================== oneDNN 2.7 Harness: IP Shapes 1D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 2.93735 |========================================================== 7F32 ...... 2.70369 |===================================================== oneDNN 2.7 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 0.790351 |========================================================= 7F32 ...... 0.775961 |======================================================== oneDNN 2.7 Harness: IP Shapes 1D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: IP Shapes 3D - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 ..... 9.55502 |====================================== AMD EPYC 7F32 . 8.11567 |================================ 7F32 .......... 13.48190 |===================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 ..... 9.60921 |=================================================== AMD EPYC 7F32 . 9.76820 |==================================================== 7F32 .......... 10.03980 |===================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 ..... 6.50887 |====================================================== AMD EPYC 7F32 . 6.54697 |====================================================== 7F32 .......... 6.54145 |====================================================== oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 12.28 |================================================== 7F32 ...... 14.68 |============================================================ oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 3.93432 |========================================================== 7F32 ...... 3.94084 |========================================================== oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 4.85806 |========================================================== 7F32 ...... 4.86267 |========================================================== oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 ..... 5083.34 |========================================== AMD EPYC 7F32 . 4813.42 |======================================== 7F32 .......... 6477.34 |====================================================== oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 ..... 1921.08 |================================================== AMD EPYC 7F32 . 1891.98 |================================================= 7F32 .......... 2084.23 |====================================================== oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 5251.89 |================================================ 7F32 ...... 6350.11 |========================================================== oneDNN 2.7 Harness: Convolution Batch Shapes Auto - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_1d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Deconvolution Batch shapes_3d - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 1881.32 |================================================== 7F32 ...... 2184.27 |========================================================== oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 ..... 1.28000 |====================================================== AMD EPYC 7F32 . 1.26884 |====================================================== 7F32 .......... 1.26277 |===================================================== oneDNN 2.7 Harness: Recurrent Neural Network Training - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 5154.61 |=========================================== 7F32 ...... 6967.79 |========================================================== oneDNN 2.7 Harness: Recurrent Neural Network Inference - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 1864.92 |===================================================== 7F32 ...... 2027.82 |========================================================== oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU ms < Lower Is Better EPYC 7F32 . 1.42225 |========================================================== 7F32 ...... 1.38568 |========================================================= oneDNN 2.7 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: bf16bf16bf16 - Engine: CPU ms < Lower Is Better Mobile Neural Network 2.1 Model: nasnet ms < Lower Is Better AMD EPYC 7F32 . 23.65 |======================================================== 7F32 .......... 23.65 |======================================================== Mobile Neural Network 2.1 Model: mobilenetV3 ms < Lower Is Better AMD EPYC 7F32 . 3.370 |======================================================== 7F32 .......... 3.201 |===================================================== Mobile Neural Network 2.1 Model: squeezenetv1.1 ms < Lower Is Better AMD EPYC 7F32 . 5.780 |================================================ 7F32 .......... 6.713 |======================================================== Mobile Neural Network 2.1 Model: resnet-v2-50 ms < Lower Is Better AMD EPYC 7F32 . 29.53 |===================================================== 7F32 .......... 31.29 |======================================================== Mobile Neural Network 2.1 Model: SqueezeNetV1.0 ms < Lower Is Better AMD EPYC 7F32 . 9.200 |================================================= 7F32 .......... 10.361 |======================================================= Mobile Neural Network 2.1 Model: MobileNetV2_224 ms < Lower Is Better AMD EPYC 7F32 . 5.523 |=============================================== 7F32 .......... 6.602 |======================================================== Mobile Neural Network 2.1 Model: mobilenet-v1-1.0 ms < Lower Is Better AMD EPYC 7F32 . 4.510 |======================================== 7F32 .......... 6.361 |======================================================== Mobile Neural Network 2.1 Model: inception-v3 ms < Lower Is Better AMD EPYC 7F32 . 38.69 |======================================================== 7F32 .......... 38.88 |======================================================== OpenVINO 2022.2.dev Model: Face Detection FP16 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 1957.78 |====================================================== 7F32 .......... 1953.96 |====================================================== OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 2554.02 |====================================================== 7F32 .......... 2490.51 |===================================================== OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 2583.15 |====================================================== 7F32 .......... 2456.02 |=================================================== OpenVINO 2022.2.dev Model: Vehicle Detection FP16 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 24.63 |======================================================== 7F32 .......... 24.12 |======================================================= OpenVINO 2022.2.dev Model: Face Detection FP16-INT8 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 1468.22 |====================================================== 7F32 .......... 1461.33 |====================================================== OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 18.22 |======================================================== 7F32 .......... 18.12 |======================================================== OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 18.79 |======================================================== 7F32 .......... 18.53 |======================================================= OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 166.48 |======================================================= 7F32 .......... 160.49 |===================================================== OpenVINO 2022.2.dev Model: Weld Porosity Detection FP16-INT8 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 29.95 |======================================================== 7F32 .......... 29.74 |======================================================== OpenVINO 2022.2.dev Model: Person Vehicle Bike Detection FP16 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 17.77 |======================================================== 7F32 .......... 17.15 |====================================================== OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 1.38 |========================================================= 7F32 .......... 1.37 |========================================================= OpenVINO 2022.2.dev Model: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPU ms < Lower Is Better AMD EPYC 7F32 . 1.24 |========================================================= 7F32 .......... 1.23 |========================================================= Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 619.20 |====================================================== 7F32 .......... 627.24 |======================================================= Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 186.12 |===================================================== 7F32 .......... 193.66 |======================================================= Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 176.84 |======================================================= 7F32 .......... 176.85 |======================================================= Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 76.26 |======================================================= 7F32 .......... 77.51 |======================================================== Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 108.57 |====================================================== 7F32 .......... 110.42 |======================================================= Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 37.05 |======================================================= 7F32 .......... 37.43 |======================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 57.07 |======================================================== 7F32 .......... 57.51 |======================================================== Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 19.67 |======================================================= 7F32 .......... 20.13 |======================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 80.03 |======================================================== 7F32 .......... 80.52 |======================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 27.19 |====================================================== 7F32 .......... 28.15 |======================================================== Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 158.39 |======================================================= 7F32 .......... 159.06 |======================================================= Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 54.87 |======================================================== 7F32 .......... 54.95 |======================================================== Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 623.11 |======================================================= 7F32 .......... 627.00 |======================================================= Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream ms/batch < Lower Is Better AMD EPYC 7F32 . 186.58 |==================================================== 7F32 .......... 196.84 |======================================================= Unpacking The Linux Kernel 5.19 linux-5.19.tar.xz Seconds < Lower Is Better EPYC 7F32 ..... 7.832 |======================================================== AMD EPYC 7F32 . 7.814 |======================================================= 7F32 .......... 7.896 |======================================================== OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Seconds < Lower Is Better EPYC 7F32 ..... 42.03 |===================================================== AMD EPYC 7F32 . 41.19 |==================================================== 7F32 .......... 44.37 |======================================================== OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Seconds < Lower Is Better EPYC 7F32 ..... 212.63 |=========================================== AMD EPYC 7F32 . 184.11 |====================================== 7F32 .......... 269.88 |======================================================= OpenRadioss 2022.10.13 Model: Bumper Beam Seconds < Lower Is Better EPYC 7F32 ..... 173.95 |======================================================= AMD EPYC 7F32 . 174.04 |======================================================= 7F32 .......... 173.25 |======================================================= OpenRadioss 2022.10.13 Model: Cell Phone Drop Test Seconds < Lower Is Better EPYC 7F32 ..... 130.17 |===================================================== AMD EPYC 7F32 . 122.99 |================================================== 7F32 .......... 135.80 |======================================================= OpenRadioss 2022.10.13 Model: Bird Strike on Windshield Seconds < Lower Is Better EPYC 7F32 ..... 330.91 |====================================================== AMD EPYC 7F32 . 331.32 |====================================================== 7F32 .......... 334.58 |======================================================= OpenRadioss 2022.10.13 Model: Rubber O-Ring Seal Installation Seconds < Lower Is Better EPYC 7F32 ..... 187.50 |======================================================= AMD EPYC 7F32 . 188.19 |======================================================= 7F32 .......... 186.74 |======================================================= OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container Seconds < Lower Is Better EPYC 7F32 ..... 638.29 |===================================================== AMD EPYC 7F32 . 627.35 |==================================================== 7F32 .......... 659.67 |======================================================= libavif avifenc 0.11 Encoder Speed: 0 Seconds < Lower Is Better EPYC 7F32 ..... 169.54 |======================================================= AMD EPYC 7F32 . 169.31 |======================================================= 7F32 .......... 167.98 |====================================================== libavif avifenc 0.11 Encoder Speed: 2 Seconds < Lower Is Better EPYC 7F32 ..... 80.97 |======================================================== AMD EPYC 7F32 . 80.89 |======================================================== 7F32 .......... 80.50 |======================================================== libavif avifenc 0.11 Encoder Speed: 6 Seconds < Lower Is Better EPYC 7F32 ..... 7.893 |======================================================== AMD EPYC 7F32 . 7.856 |======================================================== 7F32 .......... 7.802 |======================================================= libavif avifenc 0.11 Encoder Speed: 6, Lossless Seconds < Lower Is Better EPYC 7F32 ..... 12.43 |======================================================== AMD EPYC 7F32 . 12.29 |======================================================= 7F32 .......... 12.24 |======================================================= libavif avifenc 0.11 Encoder Speed: 10, Lossless Seconds < Lower Is Better EPYC 7F32 ..... 6.421 |======================================================== AMD EPYC 7F32 . 6.206 |====================================================== 7F32 .......... 6.252 |======================================================= Timed Node.js Compilation 18.8 Time To Compile Seconds < Lower Is Better EPYC 7F32 ..... 550.81 |======================================================= AMD EPYC 7F32 . 549.98 |======================================================= 7F32 .......... 554.10 |======================================================= Timed PHP Compilation 8.1.9 Time To Compile Seconds < Lower Is Better EPYC 7F32 ..... 65.04 |======================================================== AMD EPYC 7F32 . 65.20 |======================================================== 7F32 .......... 65.10 |======================================================== Timed CPython Compilation 3.10.6 Build Configuration: Default Seconds < Lower Is Better EPYC 7F32 ..... 19.15 |======================================================== AMD EPYC 7F32 . 19.03 |======================================================== 7F32 .......... 19.15 |======================================================== Timed CPython Compilation 3.10.6 Build Configuration: Released Build, PGO + LTO Optimized Seconds < Lower Is Better EPYC 7F32 ..... 337.77 |======================================================= AMD EPYC 7F32 . 338.98 |======================================================= 7F32 .......... 340.30 |======================================================= Y-Cruncher 0.7.10.9513 Pi Digits To Calculate: 1B Seconds < Lower Is Better EPYC 7F32 ..... 45.22 |====================================================== AMD EPYC 7F32 . 46.21 |======================================================== 7F32 .......... 46.50 |======================================================== Y-Cruncher 0.7.10.9513 Pi Digits To Calculate: 500M Seconds < Lower Is Better EPYC 7F32 ..... 22.89 |======================================================== AMD EPYC 7F32 . 21.63 |===================================================== 7F32 .......... 21.77 |===================================================== Timed Erlang/OTP Compilation 25.0 Time To Compile Seconds < Lower Is Better EPYC 7F32 ..... 120.66 |======================================================= AMD EPYC 7F32 . 118.86 |====================================================== 7F32 .......... 119.79 |======================================================= FLAC Audio Encoding 1.4 WAV To FLAC Seconds < Lower Is Better EPYC 7F32 ..... 21.34 |======================================================== AMD EPYC 7F32 . 21.28 |======================================================== 7F32 .......... 21.32 |======================================================== FFmpeg 5.1.2 Encoder: libx264 - Scenario: Live Seconds < Lower Is Better EPYC 7F32 ..... 28.53 |======================================================== AMD EPYC 7F32 . 28.16 |======================================================= 7F32 .......... 28.64 |======================================================== FFmpeg 5.1.2 Encoder: libx265 - Scenario: Live Seconds < Lower Is Better EPYC 7F32 ..... 68.46 |======================================================== AMD EPYC 7F32 . 68.15 |======================================================= 7F32 .......... 68.90 |======================================================== FFmpeg 5.1.2 Encoder: libx264 - Scenario: Upload Seconds < Lower Is Better EPYC 7F32 ..... 227.67 |======================================================= AMD EPYC 7F32 . 228.16 |======================================================= 7F32 .......... 228.97 |======================================================= FFmpeg 5.1.2 Encoder: libx265 - Scenario: Upload Seconds < Lower Is Better EPYC 7F32 ..... 176.33 |======================================================= AMD EPYC 7F32 . 175.58 |======================================================= 7F32 .......... 176.34 |======================================================= FFmpeg 5.1.2 Encoder: libx264 - Scenario: Platform Seconds < Lower Is Better EPYC 7F32 ..... 180.15 |======================================================= AMD EPYC 7F32 . 179.76 |======================================================= 7F32 .......... 180.21 |======================================================= FFmpeg 5.1.2 Encoder: libx265 - Scenario: Platform Seconds < Lower Is Better EPYC 7F32 ..... 253.47 |======================================================= AMD EPYC 7F32 . 252.19 |======================================================= 7F32 .......... 253.81 |======================================================= FFmpeg 5.1.2 Encoder: libx264 - Scenario: Video On Demand Seconds < Lower Is Better EPYC 7F32 ..... 180.64 |======================================================= AMD EPYC 7F32 . 180.54 |======================================================= 7F32 .......... 180.62 |======================================================= FFmpeg 5.1.2 Encoder: libx265 - Scenario: Video On Demand Seconds < Lower Is Better EPYC 7F32 ..... 253.56 |======================================================= AMD EPYC 7F32 . 252.74 |======================================================= 7F32 .......... 253.64 |======================================================= Blender 3.3 Blend File: BMW27 - Compute: CPU-Only Seconds < Lower Is Better AMD EPYC 7F32 . 149.11 |======================================================= 7F32 .......... 148.42 |======================================================= EnCodec 0.1.1 Target Bandwidth: 3 kbps Seconds < Lower Is Better AMD EPYC 7F32 . 36.20 |======================================================== 7F32 .......... 35.80 |======================================================= EnCodec 0.1.1 Target Bandwidth: 6 kbps Seconds < Lower Is Better AMD EPYC 7F32 . 34.99 |======================================================== 7F32 .......... 34.58 |======================================================= EnCodec 0.1.1 Target Bandwidth: 24 kbps Seconds < Lower Is Better AMD EPYC 7F32 . 39.87 |======================================================== 7F32 .......... 39.82 |======================================================== EnCodec 0.1.1 Target Bandwidth: 1.5 kbps Seconds < Lower Is Better AMD EPYC 7F32 . 33.97 |======================================================== 7F32 .......... 33.42 |======================================================= Scikit-Learn 1.1.3 Benchmark: MNIST Dataset Seconds < Lower Is Better AMD EPYC 7F32 . 119.57 |======================================================= 7F32 .......... 119.78 |======================================================= Scikit-Learn 1.1.3 Benchmark: TSNE MNIST Dataset Seconds < Lower Is Better AMD EPYC 7F32 . 38.60 |======================================================= 7F32 .......... 39.07 |======================================================== Scikit-Learn 1.1.3 Benchmark: Sparse Random Projections, 100 Iterations Seconds < Lower Is Better AMD EPYC 7F32 . 185.09 |======================================================= 7F32 .......... 186.35 |=======================================================