new 2025

AMD EPYC 9655P 96-Core testing with a Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS) and ASPEED on Ubuntu 24.10 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2501190-NE-NEW20253068&grr.

new 2025ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionabcdeAMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads)Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS)AMD 1Ah12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 24.106.13.0-rc4-phx-stock (x86_64)GNOME Shell 47.0X ServerGCC 14.2.0ext41024x768OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xb002116 Security Details- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

new 2025stress-ng: CPU Cachestress-ng: Cryptollama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048stress-ng: Pipencnn: CPU - FastestDetncnn: CPU - vision_transformerncnn: CPU - regnety_400mncnn: CPU - squeezenet_ssdncnn: CPU - yolov4-tinyncnn: CPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3ncnn: CPU - resnet50ncnn: CPU - alexnetncnn: CPU - resnet18ncnn: CPU - vgg16ncnn: CPU - googlenetncnn: CPU - blazefacencnn: CPU - efficientnet-b0ncnn: CPU - mnasnetncnn: CPU - shufflenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU - mobilenetstress-ng: Exponential Mathstress-ng: Cloningstress-ng: Semaphoresllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024stress-ng: Matrix 3D Mathstress-ng: Bessel Math Operationsstress-ng: Mixed Schedulerstress-ng: Floating Pointstress-ng: Function Callstress-ng: AVL Treestress-ng: Integer Mathstress-ng: Radix String Sortstress-ng: Vector Floating Pointstress-ng: Trigonometric Mathstress-ng: Vector Shufflestress-ng: Power Mathstress-ng: Context Switchingstress-ng: Jpeg Compressionstress-ng: SENDFILEstress-ng: x86_64 RdRandstress-ng: AVX-512 VNNIstress-ng: Matrix Mathstress-ng: CPU Stressstress-ng: Integer Bit Operationsstress-ng: Fractal Generatorstress-ng: Logarithmic Mathstress-ng: Socket Activitystress-ng: Vector Mathstress-ng: Bitonic Integer Sortstress-ng: Fused Multiply-Addstress-ng: Wide Vector Mathstress-ng: Memory Copyingstress-ng: IO_uringstress-ng: Atomicstress-ng: Pthreadstress-ng: Zlibstress-ng: Forkingstress-ng: NUMAstress-ng: Mallocstress-ng: Hashstress-ng: Futexstress-ng: MEMFDstress-ng: MMAPstress-ng: Pollstress-ng: Mutexllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048stress-ng: Glibc Qsort Data Sortingstress-ng: Glibc C String Functionsstress-ng: POSIX Regular Expressionsstress-ng: Hyperbolic Trigonometric Mathstress-ng: System V Message Passingllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128abcde1692665.99899403404.99112.55111.4393409969.848.3528.8330.9313.1415.5711.6613.593.656.7825.312.713.668.785.566.516.275.7511.66383630.4417095.96308990236.83105.26110.1717150.1360411.47122963.0819070.5786214.781160.228891028.491564.7379135.34244291.1184138.45224273.3263915053.0388326.042154952.6943519846.0914960065.56502535.38248390.7523056228.01693.4716302.0540702.336729501044.4138497783.116924089.9631375.321174584.73309.28302128.6711768.97108842.422481.51284239015.2624396187.673638855.981919.7910428.3310784198.153532986.47351.862548.19107612437.81661780.5593312.6847541326.12109.12111.83373.1945.7247.43371.193.231628433.01770723548.74110.41111.2286342322.238.3731.1530.1113.3116.1112.2614.463.6310.4228.3611.493.658.825.636.427.055.7212.26398930.7417134.67316698667.93112.48107.8717168.2860356.62119811.3619039.7086322.561162.538864583.161568.14379291.15243089.8484762.10224447.9564954321.2889241.182246589.2243509192.0615009286.86502617.42250283.9822934130.22688.12715277.2940726.66672523.571046.97138796151.416924707.0631364.541158950.96309.50302585.2911766.10107808.842497.58286876085.5624359044.613760562.781900.429912.9410723492.7852886531.75358.352568.76116765511.69658699.92593034.2347921020.68113.29115.39363.3845.5847.6373.6893.091758101.66904442086.58109.76113.3494350773.078.0235.0730.513.215.5111.7112.433.698.0829.8511.223.598.685.556.416.235.7611.71389486.0517504.83304269865.57112.48109.4217161.9360345.1119458.9119000.2486162.291161.978841688.11567.3378253.2242366.6384482.6223750.1163768508.7588010.392197431.3143497875.2314917255.99501693.42249308.7822766908.87684.29716894.7540788.38672908.811045.53138579068.096921682.4931565.711159544.85308.81302063.5911767.97108924.022489.47286437650.0524386852.133709094.161901.119853.4110308236.1653398638.82358.792554.43121505178.26660034.85593368.4146473032.42113.24112.67370.9445.8147.61364.0393.51685503.52904135820.16111.8111.2980625187.958.0627.630.1713.115.9911.7212.533.79.0137.1514.343.618.975.667.186.245.7611.72404064.5318352.08311249205.79106.51111.117176.6560304.13119549.1219014.2786399.131158.998897966.821567.32379655.69242558.2584525.31223675.3764355743.8689337.32168580.6743522600.1114905295.1501990.13250245.1923049501.32691.63718105.0140689.5672816.391045.96138573633.556926027.0931095.351151684.3309.49301801.1511769.34110596.052499.31285984682.2324350902.073675306.131902.379889.7710651633.7653247347.78363.162568.33121109562.7660725.51593440.1847987577.93109.2107.16366.9345.8547.75373.6294.08276965.1377385407.3317774.04309.34302111.1811768.36109992.732511.91288021758.6924400600.123676509.081888.59716.7110421659.7251459083.9OpenBenchmarking.org

Stress-NG

Test: CPU Cache

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: CPU Cacheabcd400K800K1200K1600K2000KSE +/- 34826.19, N = 151692665.991628433.011758101.661685503.521. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Crypto

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Cryptoabcde200M400M600M800M1000MSE +/- 108830554.05, N = 15899403404.99770723548.74904442086.58904135820.16276965.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048abcd306090120150112.55110.41109.76111.801. (CXX) g++ options: -O3

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048abcd306090120150111.43111.22113.34111.291. (CXX) g++ options: -O3

Stress-NG

Test: Pipe

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pipeabcde20M40M60M80M100MSE +/- 1320514.40, N = 1293409969.8486342322.2394350773.0780625187.9577385407.331. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

Target: CPU - Model: FastestDet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: FastestDetabcd2468108.358.378.028.06MIN: 8.22 / MAX: 9.19MIN: 8.21 / MAX: 10.94MIN: 7.85 / MAX: 8.91MIN: 7.94 / MAX: 8.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vision_transformer

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: vision_transformerabcd81624324028.8331.1535.0727.60MIN: 27.44 / MAX: 145.29MIN: 27.65 / MAX: 419.66MIN: 27.34 / MAX: 470.93MIN: 27.29 / MAX: 30.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: regnety_400m

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: regnety_400mabcd71421283530.9330.1130.5030.17MIN: 30.33 / MAX: 129.22MIN: 29.92 / MAX: 32.78MIN: 30.05 / MAX: 66.6MIN: 29.93 / MAX: 32.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: squeezenet_ssd

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: squeezenet_ssdabcd369121513.1413.3113.2013.10MIN: 12.98 / MAX: 13.61MIN: 13.17 / MAX: 15.89MIN: 12.76 / MAX: 15.13MIN: 12.73 / MAX: 22.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: yolov4-tiny

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: yolov4-tinyabcd4812162015.5716.1115.5115.99MIN: 15.34 / MAX: 17.56MIN: 15.6 / MAX: 79.48MIN: 15.32 / MAX: 20.25MIN: 15.01 / MAX: 2051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3abcd369121511.6612.2611.7111.72MIN: 11.45 / MAX: 12.13MIN: 11.83 / MAX: 38.58MIN: 11.51 / MAX: 11.88MIN: 11.52 / MAX: 12.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet50

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: resnet50abcd4812162013.5914.4612.4312.53MIN: 12.47 / MAX: 203.53MIN: 12.6 / MAX: 236.39MIN: 12.07 / MAX: 13.04MIN: 12.27 / MAX: 14.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: alexnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: alexnetabcd0.83251.6652.49753.334.16253.653.633.693.70MIN: 3.56 / MAX: 4.02MIN: 3.56 / MAX: 3.96MIN: 3.57 / MAX: 5.69MIN: 3.6 / MAX: 3.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: resnet18

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: resnet18abcd36912156.7810.428.089.01MIN: 6.57 / MAX: 7.45MIN: 6.5 / MAX: 500.3MIN: 6.59 / MAX: 143.39MIN: 6.6 / MAX: 197.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: vgg16

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: vgg16abcd91827364525.3028.3629.8537.15MIN: 18.81 / MAX: 398.66MIN: 18.62 / MAX: 395.65MIN: 18.57 / MAX: 491.56MIN: 19 / MAX: 553.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: googlenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: googlenetabcd4812162012.7111.4911.2214.34MIN: 10.95 / MAX: 204.69MIN: 11.27 / MAX: 11.81MIN: 10.84 / MAX: 13.82MIN: 11.33 / MAX: 392.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: blazeface

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: blazefaceabcd0.82351.6472.47053.2944.11753.663.653.593.61MIN: 3.58 / MAX: 3.74MIN: 3.55 / MAX: 3.8MIN: 3.52 / MAX: 3.72MIN: 3.54 / MAX: 4.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: efficientnet-b0

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: efficientnet-b0abcd36912158.788.828.688.97MIN: 8.63 / MAX: 9.09MIN: 8.63 / MAX: 15.62MIN: 8.54 / MAX: 8.97MIN: 8.79 / MAX: 9.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mnasnet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: mnasnetabcd1.27352.5473.82055.0946.36755.565.635.555.66MIN: 5.45 / MAX: 5.69MIN: 5.56 / MAX: 5.81MIN: 5.46 / MAX: 7.51MIN: 5.57 / MAX: 5.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: shufflenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: shufflenet-v2abcd2468106.516.426.417.18MIN: 6.43 / MAX: 8.49MIN: 6.37 / MAX: 6.67MIN: 6.34 / MAX: 6.7MIN: 6.33 / MAX: 199.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v3-v3 - Model: mobilenet-v3

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU-v3-v3 - Model: mobilenet-v3abcd2468106.277.056.236.24MIN: 6.19 / MAX: 6.64MIN: 6.19 / MAX: 157.63MIN: 6.15 / MAX: 6.61MIN: 6.16 / MAX: 6.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU-v2-v2 - Model: mobilenet-v2

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU-v2-v2 - Model: mobilenet-v2abcd1.2962.5923.8885.1846.485.755.725.765.76MIN: 5.65 / MAX: 6.15MIN: 5.61 / MAX: 6.14MIN: 5.66 / MAX: 5.97MIN: 5.65 / MAX: 7.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

NCNN

Target: CPU - Model: mobilenet

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: mobilenetabcd369121511.6612.2611.7111.72MIN: 11.45 / MAX: 12.13MIN: 11.83 / MAX: 38.58MIN: 11.51 / MAX: 11.88MIN: 11.52 / MAX: 12.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

Test: Exponential Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Exponential Mathabcd90K180K270K360K450KSE +/- 3969.34, N = 6383630.44398930.74389486.05404064.531. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Cloning

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Cloningabcde4K8K12K16K20KSE +/- 172.38, N = 617095.9617134.6717504.8318352.0817774.041. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Semaphores

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Semaphoresabcd70M140M210M280M350MSE +/- 3510501.49, N = 5308990236.83316698667.93304269865.57311249205.791. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024abcd306090120150105.26112.48112.48106.511. (CXX) g++ options: -O3

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024abcd20406080100110.17107.87109.42111.101. (CXX) g++ options: -O3

Stress-NG

Test: Matrix 3D Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Matrix 3D Mathabcd4K8K12K16K20KSE +/- 5.61, N = 317150.1317168.2817161.9317176.651. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Bessel Math Operations

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Bessel Math Operationsabcd13K26K39K52K65KSE +/- 3.51, N = 360411.4760356.6260345.1060304.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Mixed Scheduler

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mixed Schedulerabcd30K60K90K120K150KSE +/- 60.64, N = 3122963.08119811.36119458.91119549.121. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Floating Pointabcd4K8K12K16K20KSE +/- 30.59, N = 319070.5719039.7019000.2419014.271. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Function Call

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Function Callabcd20K40K60K80K100KSE +/- 75.87, N = 386214.7886322.5686162.2986399.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: AVL Tree

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: AVL Treeabcd30060090012001500SE +/- 2.09, N = 31160.221162.531161.971158.991. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Integer Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Integer Mathabcd2M4M6M8M10MSE +/- 12411.99, N = 38891028.498864583.168841688.108897966.821. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Radix String Sort

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Radix String Sortabcd30060090012001500SE +/- 0.60, N = 31564.701568.141567.301567.321. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Vector Floating Point

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Floating Pointabcd80K160K240K320K400KSE +/- 955.04, N = 3379135.34379291.15378253.20379655.691. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Trigonometric Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Trigonometric Mathabcd50K100K150K200K250KSE +/- 407.29, N = 3244291.11243089.84242366.63242558.251. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Vector Shuffle

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Shuffleabcd20K40K60K80K100KSE +/- 192.26, N = 384138.4584762.1084482.6084525.311. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Power Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Power Mathabcd50K100K150K200K250KSE +/- 36.82, N = 3224273.32224447.95223750.11223675.371. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Context Switching

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Context Switchingabcd14M28M42M56M70MSE +/- 279870.92, N = 363915053.0364954321.2863768508.7564355743.861. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Jpeg Compression

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Jpeg Compressionabcd20K40K60K80K100KSE +/- 336.69, N = 388326.0489241.1888010.3989337.301. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: SENDFILE

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: SENDFILEabcd500K1000K1500K2000K2500KSE +/- 12520.19, N = 32154952.692246589.222197431.312168580.671. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: x86_64 RdRand

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: x86_64 RdRandabcd9M18M27M36M45MSE +/- 8715.59, N = 343519846.0943509192.0643497875.2343522600.111. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: AVX-512 VNNI

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: AVX-512 VNNIabcd3M6M9M12M15MSE +/- 15958.95, N = 314960065.5615009286.8614917255.9914905295.101. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Matrix Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Matrix Mathabcd110K220K330K440K550KSE +/- 182.19, N = 3502535.38502617.42501693.42501990.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: CPU Stress

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: CPU Stressabcd50K100K150K200K250KSE +/- 717.08, N = 3248390.75250283.98249308.78250245.191. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Integer Bit Operations

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Integer Bit Operationsabcd5M10M15M20M25MSE +/- 79034.91, N = 323056228.0122934130.2222766908.8723049501.321. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Fractal Generator

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Fractal Generatorabcd150300450600750SE +/- 2.15, N = 3693.40688.12684.29691.631. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Logarithmic Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Logarithmic Mathabcd150K300K450K600K750KSE +/- 1549.57, N = 3716302.05715277.29716894.75718105.011. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Socket Activity

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Socket Activityabcd9K18K27K36K45KSE +/- 40.26, N = 340702.3340726.6640788.3840689.501. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Mathabcd140K280K420K560K700KSE +/- 131.15, N = 3672950.00672523.57672908.81672816.391. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Bitonic Integer Sort

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Bitonic Integer Sortabcd2004006008001000SE +/- 1.18, N = 31044.401046.971045.531045.961. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Fused Multiply-Add

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Fused Multiply-Addabcd30M60M90M120M150MSE +/- 40538.03, N = 3138497783.11138796151.41138579068.09138573633.551. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Wide Vector Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Wide Vector Mathabcd1.5M3M4.5M6M7.5MSE +/- 1026.05, N = 36924089.966924707.066921682.496926027.091. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Memory Copying

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Memory Copyingabcd7K14K21K28K35KSE +/- 50.08, N = 331375.3231364.5431565.7131095.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: IO_uring

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: IO_uringabcd300K600K900K1200K1500KSE +/- 7669.66, N = 31174584.731158950.961159544.851151684.301. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Atomic

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Atomicabcde70140210280350SE +/- 0.10, N = 3309.28309.50308.81309.49309.341. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Pthread

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pthreadabcde60K120K180K240K300KSE +/- 570.54, N = 3302128.67302585.29302063.59301801.15302111.181. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Zlib

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Zlibabcde3K6K9K12K15KSE +/- 5.26, N = 311768.9711766.1011767.9711769.3411768.361. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Forking

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Forkingabcde20K40K60K80K100KSE +/- 1165.09, N = 3108842.42107808.84108924.02110596.05109992.731. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: NUMA

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: NUMAabcde5001000150020002500SE +/- 10.73, N = 32481.512497.582489.472499.312511.911. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Malloc

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mallocabcde60M120M180M240M300MSE +/- 2355922.46, N = 3284239015.26286876085.56286437650.05285984682.23288021758.691. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Hash

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Hashabcde5M10M15M20M25MSE +/- 21888.88, N = 324396187.6724359044.6124386852.1324350902.0724400600.121. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Futex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Futexabcde800K1600K2400K3200K4000KSE +/- 30393.34, N = 33638855.983760562.783709094.163675306.133676509.081. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: MEMFD

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: MEMFDabcde400800120016002000SE +/- 2.61, N = 31919.791900.421901.111902.371888.501. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: MMAP

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: MMAPabcde2K4K6K8K10KSE +/- 9.81, N = 310428.339912.949853.419889.779716.711. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Poll

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pollabcde2M4M6M8M10MSE +/- 81527.82, N = 310784198.1010723492.7810308236.1610651633.7610421659.721. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Mutex

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mutexabcde11M22M33M44M55MSE +/- 30126.63, N = 353532986.4752886531.7553398638.8253247347.7851459083.901. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048abcd80160240320400351.86358.35358.79363.161. (CXX) g++ options: -O3

Stress-NG

Test: Glibc Qsort Data Sorting

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Glibc Qsort Data Sortingabcd60012001800240030002548.192568.762554.432568.331. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Glibc C String Functions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Glibc C String Functionsabcd30M60M90M120M150M107612437.81116765511.69121505178.26121109562.701. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: POSIX Regular Expressions

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: POSIX Regular Expressionsabcd140K280K420K560K700K661780.50658699.92660034.85660725.511. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: Hyperbolic Trigonometric Math

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Hyperbolic Trigonometric Mathabcd130K260K390K520K650K593312.68593034.23593368.41593440.181. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Stress-NG

Test: System V Message Passing

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: System V Message Passingabcd10M20M30M40M50M47541326.1247921020.6846473032.4247987577.931. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512abcd306090120150109.12113.29113.24109.201. (CXX) g++ options: -O3

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512abcd306090120150111.83115.39112.67107.161. (CXX) g++ options: -O3

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024abcd80160240320400373.19363.38370.94366.931. (CXX) g++ options: -O3

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128abcd102030405045.7245.5845.8145.851. (CXX) g++ options: -O3

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128abcd112233445547.4347.6047.6147.751. (CXX) g++ options: -O3

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512abcd80160240320400371.10373.68364.03373.621. (CXX) g++ options: -O3

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128abcd2040608010093.2393.0993.5094.081. (CXX) g++ options: -O3


Phoronix Test Suite v10.8.5