llamatest

Intel 0000% testing with a ASUS Pro WS W790E-SAGE SE (0215 BIOS) and ASPEED on Fedora 39 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2403182-NE-LLAMATEST04
Jump To Table - Results

Statistics

Remove Outliers Before Calculating Averages

Graph Settings

Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
4800_4ch_ll
March 18
  5 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

4800_4ch_ll

Processor: Intel 0000% @ 3.30GHz (48 Cores / 96 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0215 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 64GB, Disk: 4001GB CT4000P3SSD8 + 0GB Virtual HDisk0, Graphics: ASPEED, Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T

OS: Fedora 39, Kernel: 6.7.7-200.fc39.x86_64 (x86_64), OpenCL: OpenCL 3.0 + OpenCL 1.2 Intel FPGA SDK for OpenCL 20.3 + OpenCL 3.0 LINUX + OpenCL 1.2 Intel FPGA SDK for OpenCL 20.3, Compiler: GCC 13.2.1 20231205 + Clang 17.0.6 + LLVM 17.0.6, File-System: xfs, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver
Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xd0004b1
Security Notes: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

llamatestOpenBenchmarking.orgPhoronix Test SuiteIntel 0000% @ 3.30GHz (48 Cores / 96 Threads)ASUS Pro WS W790E-SAGE SE (0215 BIOS)Intel Alder Lake-S PCH64GB4001GB CT4000P3SSD8 + 0GB Virtual HDisk0ASPEEDRealtek ALC12202 x Intel X710 for 10GBASE-TFedora 396.7.7-200.fc39.x86_64 (x86_64)OpenCL 3.0 + OpenCL 1.2 Intel FPGA SDK for OpenCL 20.3 + OpenCL 3.0 LINUX + OpenCL 1.2 Intel FPGA SDK for OpenCL 20.3GCC 13.2.1 20231205 + Clang 17.0.6 + LLVM 17.0.6xfs1920x1200ProcessorMotherboardChipsetMemoryDiskGraphicsAudioNetworkOSKernelOpenCLCompilerFile-SystemScreen ResolutionLlamatest BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver - Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xd0004b1- SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

llamateststream: Copystream: Scalestream: Triadstream: Addllama-cpp-7b: llama-2-7b.Q4_0.gguf4800_4ch_ll89753.289343.093851.193610.519.81OpenBenchmarking.org

Stream

This is a benchmark of Stream, the popular system memory (RAM) benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Copy4800_4ch_ll20K40K60K80K100KSE +/- 75.10, N = 589753.21. (CC) gcc options: -mcmodel=medium -O3 -march=native -fopenmp

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Scale4800_4ch_ll20K40K60K80K100KSE +/- 86.26, N = 589343.01. (CC) gcc options: -mcmodel=medium -O3 -march=native -fopenmp

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Triad4800_4ch_ll20K40K60K80K100KSE +/- 72.45, N = 593851.11. (CC) gcc options: -mcmodel=medium -O3 -march=native -fopenmp

OpenBenchmarking.orgMB/s, More Is BetterStream 2013-01-17Type: Add4800_4ch_ll20K40K60K80K100KSE +/- 58.69, N = 593610.51. (CC) gcc options: -mcmodel=medium -O3 -march=native -fopenmp

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.gguf4800_4ch_ll510152025SE +/- 0.20, N = 519.811. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native

4800_4ch_ll

Processor: Intel 0000% @ 3.30GHz (48 Cores / 96 Threads), Motherboard: ASUS Pro WS W790E-SAGE SE (0215 BIOS), Chipset: Intel Alder Lake-S PCH, Memory: 64GB, Disk: 4001GB CT4000P3SSD8 + 0GB Virtual HDisk0, Graphics: ASPEED, Audio: Realtek ALC1220, Network: 2 x Intel X710 for 10GBASE-T

OS: Fedora 39, Kernel: 6.7.7-200.fc39.x86_64 (x86_64), OpenCL: OpenCL 3.0 + OpenCL 1.2 Intel FPGA SDK for OpenCL 20.3 + OpenCL 3.0 LINUX + OpenCL 1.2 Intel FPGA SDK for OpenCL 20.3, Compiler: GCC 13.2.1 20231205 + Clang 17.0.6 + LLVM 17.0.6, File-System: xfs, Screen Resolution: 1920x1200

Kernel Notes: Transparent Huge Pages: madvise
Compiler Notes: --build=x86_64-redhat-linux --disable-libunwind-exceptions --enable-__cxa_atexit --enable-bootstrap --enable-cet --enable-checking=release --enable-gnu-indirect-function --enable-gnu-unique-object --enable-initfini-array --enable-languages=c,c++,fortran,objc,obj-c++,ada,go,d,m2,lto --enable-libstdcxx-backtrace --enable-link-serialization=1 --enable-multilib --enable-offload-defaulted --enable-offload-targets=nvptx-none --enable-plugin --enable-shared --enable-threads=posix --mandir=/usr/share/man --with-arch_32=i686 --with-build-config=bootstrap-lto --with-gcc-major-version-only --with-libstdcxx-zoneinfo=/usr/share/zoneinfo --with-linker-hash-style=gnu --with-tune=generic --without-cuda-driver
Processor Notes: Scaling Governor: intel_pstate powersave (EPP: balance_performance) - CPU Microcode: 0xd0004b1
Security Notes: SELinux + gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional RSB filling PBRSB-eIBRS: SW sequence + srbds: Not affected + tsx_async_abort: Not affected

Testing initiated at 18 March 2024 19:15 by user mgolub2.