Intel Xeon E3-1505M v6 testing with a Dell 06X96V (1.31.0 BIOS) and NVIDIA Quadro M1200 4GB on Ubuntu 22.04 via the Phoronix Test Suite.
Compare your own system(s) to this result file with the
Phoronix Test Suite by running the command:
phoronix-test-suite benchmark 2302026-NE-HH568983576 hh - Phoronix Test Suite hh Intel Xeon E3-1505M v6 testing with a Dell 06X96V (1.31.0 BIOS) and NVIDIA Quadro M1200 4GB on Ubuntu 22.04 via the Phoronix Test Suite.
HTML result view exported from: https://openbenchmarking.org/result/2302026-NE-HH568983576&grw .
hh Processor Motherboard Chipset Memory Disk Graphics Audio Network OS Kernel Desktop Display Server Display Driver OpenGL OpenCL Vulkan Compiler File-System Screen Resolution hhy Intel Xeon E3-1505M v6 @ 3.00GHz (4 Cores / 8 Threads) Dell 06X96V (1.31.0 BIOS) Intel Xeon E3-1200 v6/7th 32GB 1000GB Samsung SSD 970 EVO 1TB NVIDIA Quadro M1200 4GB Realtek ALC3266 Intel 8265 / 8275 Ubuntu 22.04 5.15.0-58-generic (x86_64) GNOME Shell 42.5 X Server NVIDIA 525.78.01 4.6.0 OpenCL 3.0 CUDA 12.0.133 1.3.224 GCC 11.3.0 zfs 1920x1080 OpenBenchmarking.org - Transparent Huge Pages: madvise - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xf0 - Thermald 2.4.9 - Python 3.10.6 - itlb_multihit: KVM: Mitigation of VMX disabled + l1tf: Mitigation of PTE Inversion; VMX: conditional cache flushes SMT vulnerable + mds: Mitigation of Clear buffers; SMT vulnerable + meltdown: Mitigation of PTI + mmio_stale_data: Mitigation of Clear buffers; SMT vulnerable + retbleed: Mitigation of IBRS + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of IBRS IBPB: conditional RSB filling PBRSB-eIBRS: Not affected + srbds: Mitigation of Microcode + tsx_async_abort: Mitigation of TSX disabled
hh deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Asynchronous Multi-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream deepsparse: NLP Text Classification, BERT base uncased SST2 - Synchronous Single-Stream hhy 9.1641 218.0697 8.2956 120.5414 OpenBenchmarking.org
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream hhy 3 6 9 12 15 SE +/- 0.0965, N = 3 9.1641
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream hhy 50 100 150 200 250 SE +/- 2.37, N = 3 218.07
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream hhy 2 4 6 8 10 SE +/- 0.0363, N = 3 8.2956
Neural Magic DeepSparse Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream hhy 30 60 90 120 150 SE +/- 0.53, N = 3 120.54
Phoronix Test Suite v10.8.4