llamatest

Intel 0000% testing with a ASUS Pro WS W790E-SAGE SE (0215 BIOS) and ASPEED on Fedora 39 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2403182-NE-LLAMATEST04.

llamatestProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelOpenCLCompilerFile-SystemScreen Resolution4800_4ch_llIntel 0000% @ 3.30GHz (48 Cores / 96 Threads)ASUS Pro WS W790E-SAGE SE (0215 BIOS)Intel Alder Lake-S PCH64GB4001GB CT4000P3SSD8 + 0GB Virtual HDisk0ASPEEDRealtek ALC12202 x Intel X710 for 10GBASE-TFedora 396.7.7-200.fc39.x86_64 (x86_64)OpenCL 3.0 + OpenCL 1.2 Intel FPGA SDK for OpenCL 20.3 + OpenCL 3.0 LINUX + OpenCL 1.2 Intel FPGA SDK for OpenCL 20.3GCC 13.2.1 20231205 + Clang 17.0.6 + LLVM 17.0.6xfs1920x1200OpenBenchmarking.org- Transparent Huge Pages: madvise- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xd0004b1- SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

llamateststream: Copystream: Scalestream: Triadstream: Addllama-cpp-7b: llama-2-7b.Q4_0.gguf4800_4ch_ll89753.289343.093851.193610.519.81OpenBenchmarking.org

Stream

Type: Copy

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Copy4800_4ch_ll20K40K60K80K100KSE +/- 75.10, N = 589753.21. (CC) gcc options: -mcmodel=medium -O3 -march=native -fopenmp

Stream

Type: Scale

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Scale4800_4ch_ll20K40K60K80K100KSE +/- 86.26, N = 589343.01. (CC) gcc options: -mcmodel=medium -O3 -march=native -fopenmp

Stream

Type: Triad

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Triad4800_4ch_ll20K40K60K80K100KSE +/- 72.45, N = 593851.11. (CC) gcc options: -mcmodel=medium -O3 -march=native -fopenmp

Stream

Type: Add

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Add4800_4ch_ll20K40K60K80K100KSE +/- 58.69, N = 593610.51. (CC) gcc options: -mcmodel=medium -O3 -march=native -fopenmp

Llama.cpp

Model: llama-2-7b.Q4_0.gguf

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.gguf4800_4ch_ll510152025SE +/- 0.20, N = 519.811. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native

Phoronix Test Suite v10.8.4