new 2025

AMD EPYC 9655P 96-Core testing with a Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS) and ASPEED on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2501190-NE-NEW20253068
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
January 19
  1 Hour
b
January 19
  2 Hours, 9 Minutes
c
January 19
  1 Hour, 1 Minute
d
January 19
  1 Hour, 1 Minute
e
January 19
  8 Minutes
Invert Behavior (Only Show Selected Data)
  1 Hour, 4 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


new 2025OpenBenchmarking.orgPhoronix Test SuiteAMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads)Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS)AMD 1Ah12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 24.106.13.0-rc4-phx-stock (x86_64)GNOME Shell 47.0X ServerGCC 14.2.0ext41024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionNew 2025 BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xb002116 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

abcdeLogarithmic Result OverviewPhoronix Test SuiteStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGCryptoPipeCloningMMAPPollMutexFutexForkingMEMFDMallocNUMAPthreadAtomicHashZlib

new 2025ncnn: CPU - resnet18ncnn: CPU - vgg16ncnn: CPU - googlenetncnn: CPU - vision_transformerstress-ng: Pipencnn: CPU - resnet50ncnn: CPU-v3-v3 - mobilenet-v3stress-ng: Glibc C String Functionsncnn: CPU - shufflenet-v2llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512stress-ng: Cloningstress-ng: MMAPllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024stress-ng: Exponential Mathncnn: CPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3ncnn: CPU - mobilenetstress-ng: Pollncnn: CPU - FastestDetstress-ng: SENDFILEstress-ng: Semaphoresstress-ng: Mutexncnn: CPU - yolov4-tinyllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512stress-ng: Futexncnn: CPU - efficientnet-b0stress-ng: System V Message Passingllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024stress-ng: Mixed Schedulerncnn: CPU - regnety_400mllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512stress-ng: Forkingllama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048stress-ng: IO_uringncnn: CPU - mnasnetncnn: CPU - blazefacencnn: CPU - alexnetllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048stress-ng: Context Switchingstress-ng: MEMFDncnn: CPU - squeezenet_ssdstress-ng: Memory Copyingstress-ng: Jpeg Compressionstress-ng: Fractal Generatorstress-ng: Mallocstress-ng: Integer Bit Operationsstress-ng: NUMAllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128stress-ng: Glibc Qsort Data Sortingstress-ng: Trigonometric Mathstress-ng: CPU Stressstress-ng: Vector Shufflencnn: CPU-v2-v2 - mobilenet-v2stress-ng: AVX-512 VNNIllama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128stress-ng: Integer Mathllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128stress-ng: POSIX Regular Expressionsstress-ng: Logarithmic Mathstress-ng: Vector Floating Pointstress-ng: Floating Pointstress-ng: Power Mathstress-ng: AVL Treestress-ng: Function Callstress-ng: Pthreadstress-ng: Bitonic Integer Sortstress-ng: Socket Activitystress-ng: Atomicstress-ng: Radix String Sortstress-ng: Fused Multiply-Addstress-ng: Hashstress-ng: Matrix Mathstress-ng: Bessel Math Operationsstress-ng: Matrix 3D Mathstress-ng: Hyperbolic Trigonometric Mathstress-ng: Vector Mathstress-ng: Wide Vector Mathstress-ng: x86_64 RdRandstress-ng: Zlibstress-ng: CPU Cachestress-ng: Cryptoabcde6.7825.312.7128.8393409969.8413.596.27107612437.816.51111.8317095.9610428.33105.26383630.4411.6611.6610784198.18.352154952.69308990236.8353532986.4715.57109.123638855.988.7847541326.12351.86110.17122963.0830.93373.19371.1108842.42112.551174584.735.563.663.65111.4363915053.031919.7913.1431375.3288326.04693.4284239015.2623056228.012481.5193.232548.19244291.11248390.7584138.455.7514960065.5647.438891028.4945.72661780.5716302.05379135.3419070.57224273.321160.2286214.78302128.671044.440702.33309.281564.7138497783.1124396187.67502535.3860411.4717150.13593312.686729506924089.9643519846.0911768.971692665.99899403404.9910.4228.3611.4931.1586342322.2314.467.05116765511.696.42115.3917134.679912.94112.48398930.7412.2612.2610723492.788.372246589.22316698667.9352886531.7516.11113.293760562.788.8247921020.68358.35107.87119811.3630.11363.38373.68107808.84110.411158950.965.633.653.63111.2264954321.281900.4213.3131364.5489241.18688.12286876085.5622934130.222497.5893.092568.76243089.84250283.9884762.105.7215009286.8647.68864583.1645.58658699.92715277.29379291.1519039.70224447.951162.5386322.56302585.291046.9740726.66309.501568.14138796151.4124359044.61502617.4260356.6217168.28593034.23672523.576924707.0643509192.0611766.101628433.01770723548.748.0829.8511.2235.0794350773.0712.436.23121505178.266.41112.6717504.839853.41112.48389486.0511.7111.7110308236.168.022197431.31304269865.5753398638.8215.51113.243709094.168.6846473032.42358.79109.42119458.9130.5370.94364.03108924.02109.761159544.855.553.593.69113.3463768508.751901.1113.231565.7188010.39684.29286437650.0522766908.872489.4793.52554.43242366.63249308.7884482.65.7614917255.9947.618841688.145.81660034.85716894.75378253.219000.24223750.111161.9786162.29302063.591045.5340788.38308.811567.3138579068.0924386852.13501693.4260345.117161.93593368.41672908.816921682.4943497875.2311767.971758101.66904442086.589.0137.1514.3427.680625187.9512.536.24121109562.77.18107.1618352.089889.77106.51404064.5311.7211.7210651633.768.062168580.67311249205.7953247347.7815.99109.23675306.138.9747987577.93363.16111.1119549.1230.17366.93373.62110596.05111.81151684.35.663.613.7111.2964355743.861902.3713.131095.3589337.3691.63285984682.2323049501.322499.3194.082568.33242558.25250245.1984525.315.7614905295.147.758897966.8245.85660725.51718105.01379655.6919014.27223675.371158.9986399.13301801.151045.9640689.5309.491567.32138573633.5524350902.07501990.1360304.1317176.65593440.18672816.396926027.0943522600.1111769.341685503.52904135820.1677385407.3317774.049716.7110421659.7251459083.93676509.08109992.731888.5288021758.692511.91302111.18309.3424400600.1211768.36276965.13OpenBenchmarking.org

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: resnet18abcd36912156.7810.428.089.01MIN: 6.57 / MAX: 7.45MIN: 6.5 / MAX: 500.3MIN: 6.59 / MAX: 143.39MIN: 6.6 / MAX: 197.681. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: vgg16abcd91827364525.3028.3629.8537.15MIN: 18.81 / MAX: 398.66MIN: 18.62 / MAX: 395.65MIN: 18.57 / MAX: 491.56MIN: 19 / MAX: 553.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: googlenetabcd4812162012.7111.4911.2214.34MIN: 10.95 / MAX: 204.69MIN: 11.27 / MAX: 11.81MIN: 10.84 / MAX: 13.82MIN: 11.33 / MAX: 392.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: vision_transformerabcd81624324028.8331.1535.0727.60MIN: 27.44 / MAX: 145.29MIN: 27.65 / MAX: 419.66MIN: 27.34 / MAX: 470.93MIN: 27.29 / MAX: 30.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pipeabcde20M40M60M80M100MSE +/- 1320514.40, N = 1293409969.8486342322.2394350773.0780625187.9577385407.331. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: resnet50abcd4812162013.5914.4612.4312.53MIN: 12.47 / MAX: 203.53MIN: 12.6 / MAX: 236.39MIN: 12.07 / MAX: 13.04MIN: 12.27 / MAX: 14.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU-v3-v3 - Model: mobilenet-v3abcd2468106.277.056.236.24MIN: 6.19 / MAX: 6.64MIN: 6.19 / MAX: 157.63MIN: 6.15 / MAX: 6.61MIN: 6.16 / MAX: 6.651. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Glibc C String Functionsabcd30M60M90M120M150M107612437.81116765511.69121505178.26121109562.701. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: shufflenet-v2abcd2468106.516.426.417.18MIN: 6.43 / MAX: 8.49MIN: 6.37 / MAX: 6.67MIN: 6.34 / MAX: 6.7MIN: 6.33 / MAX: 199.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512abcd306090120150111.83115.39112.67107.161. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Cloningabcde4K8K12K16K20KSE +/- 172.38, N = 617095.9617134.6717504.8318352.0817774.041. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: MMAPabcde2K4K6K8K10KSE +/- 9.81, N = 310428.339912.949853.419889.779716.711. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024abcd306090120150105.26112.48112.48106.511. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Exponential Mathabcd90K180K270K360K450KSE +/- 3969.34, N = 6383630.44398930.74389486.05404064.531. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3abcd369121511.6612.2611.7111.72MIN: 11.45 / MAX: 12.13MIN: 11.83 / MAX: 38.58MIN: 11.51 / MAX: 11.88MIN: 11.52 / MAX: 12.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: mobilenetabcd369121511.6612.2611.7111.72MIN: 11.45 / MAX: 12.13MIN: 11.83 / MAX: 38.58MIN: 11.51 / MAX: 11.88MIN: 11.52 / MAX: 12.061. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pollabcde2M4M6M8M10MSE +/- 81527.82, N = 310784198.1010723492.7810308236.1610651633.7610421659.721. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: FastestDetabcd2468108.358.378.028.06MIN: 8.22 / MAX: 9.19MIN: 8.21 / MAX: 10.94MIN: 7.85 / MAX: 8.91MIN: 7.94 / MAX: 8.641. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: SENDFILEabcd500K1000K1500K2000K2500KSE +/- 12520.19, N = 32154952.692246589.222197431.312168580.671. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Semaphoresabcd70M140M210M280M350MSE +/- 3510501.49, N = 5308990236.83316698667.93304269865.57311249205.791. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mutexabcde11M22M33M44M55MSE +/- 30126.63, N = 353532986.4752886531.7553398638.8253247347.7851459083.901. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: yolov4-tinyabcd4812162015.5716.1115.5115.99MIN: 15.34 / MAX: 17.56MIN: 15.6 / MAX: 79.48MIN: 15.32 / MAX: 20.25MIN: 15.01 / MAX: 2051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512abcd306090120150109.12113.29113.24109.201. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Futexabcde800K1600K2400K3200K4000KSE +/- 30393.34, N = 33638855.983760562.783709094.163675306.133676509.081. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: efficientnet-b0abcd36912158.788.828.688.97MIN: 8.63 / MAX: 9.09MIN: 8.63 / MAX: 15.62MIN: 8.54 / MAX: 8.97MIN: 8.79 / MAX: 9.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: System V Message Passingabcd10M20M30M40M50M47541326.1247921020.6846473032.4247987577.931. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048abcd80160240320400351.86358.35358.79363.161. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024abcd20406080100110.17107.87109.42111.101. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mixed Schedulerabcd30K60K90K120K150KSE +/- 60.64, N = 3122963.08119811.36119458.91119549.121. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: regnety_400mabcd71421283530.9330.1130.5030.17MIN: 30.33 / MAX: 129.22MIN: 29.92 / MAX: 32.78MIN: 30.05 / MAX: 66.6MIN: 29.93 / MAX: 32.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024abcd80160240320400373.19363.38370.94366.931. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512abcd80160240320400371.10373.68364.03373.621. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Forkingabcde20K40K60K80K100KSE +/- 1165.09, N = 3108842.42107808.84108924.02110596.05109992.731. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048abcd306090120150112.55110.41109.76111.801. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: IO_uringabcd300K600K900K1200K1500KSE +/- 7669.66, N = 31174584.731158950.961159544.851151684.301. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: mnasnetabcd1.27352.5473.82055.0946.36755.565.635.555.66MIN: 5.45 / MAX: 5.69MIN: 5.56 / MAX: 5.81MIN: 5.46 / MAX: 7.51MIN: 5.57 / MAX: 5.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: blazefaceabcd0.82351.6472.47053.2944.11753.663.653.593.61MIN: 3.58 / MAX: 3.74MIN: 3.55 / MAX: 3.8MIN: 3.52 / MAX: 3.72MIN: 3.54 / MAX: 4.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: alexnetabcd0.83251.6652.49753.334.16253.653.633.693.70MIN: 3.56 / MAX: 4.02MIN: 3.56 / MAX: 3.96MIN: 3.57 / MAX: 5.69MIN: 3.6 / MAX: 3.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048abcd306090120150111.43111.22113.34111.291. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Context Switchingabcd14M28M42M56M70MSE +/- 279870.92, N = 363915053.0364954321.2863768508.7564355743.861. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: MEMFDabcde400800120016002000SE +/- 2.61, N = 31919.791900.421901.111902.371888.501. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: squeezenet_ssdabcd369121513.1413.3113.2013.10MIN: 12.98 / MAX: 13.61MIN: 13.17 / MAX: 15.89MIN: 12.76 / MAX: 15.13MIN: 12.73 / MAX: 22.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Memory Copyingabcd7K14K21K28K35KSE +/- 50.08, N = 331375.3231364.5431565.7131095.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Jpeg Compressionabcd20K40K60K80K100KSE +/- 336.69, N = 388326.0489241.1888010.3989337.301. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Fractal Generatorabcd150300450600750SE +/- 2.15, N = 3693.40688.12684.29691.631. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mallocabcde60M120M180M240M300MSE +/- 2355922.46, N = 3284239015.26286876085.56286437650.05285984682.23288021758.691. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Integer Bit Operationsabcd5M10M15M20M25MSE +/- 79034.91, N = 323056228.0122934130.2222766908.8723049501.321. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: NUMAabcde5001000150020002500SE +/- 10.73, N = 32481.512497.582489.472499.312511.911. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128abcd2040608010093.2393.0993.5094.081. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Glibc Qsort Data Sortingabcd60012001800240030002548.192568.762554.432568.331. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Trigonometric Mathabcd50K100K150K200K250KSE +/- 407.29, N = 3244291.11243089.84242366.63242558.251. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: CPU Stressabcd50K100K150K200K250KSE +/- 717.08, N = 3248390.75250283.98249308.78250245.191. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Shuffleabcd20K40K60K80K100KSE +/- 192.26, N = 384138.4584762.1084482.6084525.311. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU-v2-v2 - Model: mobilenet-v2abcd1.2962.5923.8885.1846.485.755.725.765.76MIN: 5.65 / MAX: 6.15MIN: 5.61 / MAX: 6.14MIN: 5.66 / MAX: 5.97MIN: 5.65 / MAX: 7.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: AVX-512 VNNIabcd3M6M9M12M15MSE +/- 15958.95, N = 314960065.5615009286.8614917255.9914905295.101. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128abcd112233445547.4347.6047.6147.751. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Integer Mathabcd2M4M6M8M10MSE +/- 12411.99, N = 38891028.498864583.168841688.108897966.821. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128abcd102030405045.7245.5845.8145.851. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: POSIX Regular Expressionsabcd140K280K420K560K700K661780.50658699.92660034.85660725.511. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Logarithmic Mathabcd150K300K450K600K750KSE +/- 1549.57, N = 3716302.05715277.29716894.75718105.011. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Floating Pointabcd80K160K240K320K400KSE +/- 955.04, N = 3379135.34379291.15378253.20379655.691. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Floating Pointabcd4K8K12K16K20KSE +/- 30.59, N = 319070.5719039.7019000.2419014.271. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Power Mathabcd50K100K150K200K250KSE +/- 36.82, N = 3224273.32224447.95223750.11223675.371. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: AVL Treeabcd30060090012001500SE +/- 2.09, N = 31160.221162.531161.971158.991. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Function Callabcd20K40K60K80K100KSE +/- 75.87, N = 386214.7886322.5686162.2986399.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pthreadabcde60K120K180K240K300KSE +/- 570.54, N = 3302128.67302585.29302063.59301801.15302111.181. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Bitonic Integer Sortabcd2004006008001000SE +/- 1.18, N = 31044.401046.971045.531045.961. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Socket Activityabcd9K18K27K36K45KSE +/- 40.26, N = 340702.3340726.6640788.3840689.501. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Atomicabcde70140210280350SE +/- 0.10, N = 3309.28309.50308.81309.49309.341. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Radix String Sortabcd30060090012001500SE +/- 0.60, N = 31564.701568.141567.301567.321. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Fused Multiply-Addabcd30M60M90M120M150MSE +/- 40538.03, N = 3138497783.11138796151.41138579068.09138573633.551. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Hashabcde5M10M15M20M25MSE +/- 21888.88, N = 324396187.6724359044.6124386852.1324350902.0724400600.121. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Matrix Mathabcd110K220K330K440K550KSE +/- 182.19, N = 3502535.38502617.42501693.42501990.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Bessel Math Operationsabcd13K26K39K52K65KSE +/- 3.51, N = 360411.4760356.6260345.1060304.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Matrix 3D Mathabcd4K8K12K16K20KSE +/- 5.61, N = 317150.1317168.2817161.9317176.651. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Hyperbolic Trigonometric Mathabcd130K260K390K520K650K593312.68593034.23593368.41593440.181. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Mathabcd140K280K420K560K700KSE +/- 131.15, N = 3672950.00672523.57672908.81672816.391. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Wide Vector Mathabcd1.5M3M4.5M6M7.5MSE +/- 1026.05, N = 36924089.966924707.066921682.496926027.091. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: x86_64 RdRandabcd9M18M27M36M45MSE +/- 8715.59, N = 343519846.0943509192.0643497875.2343522600.111. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Zlibabcde3K6K9K12K15KSE +/- 5.26, N = 311768.9711766.1011767.9711769.3411768.361. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: CPU Cacheabcd400K800K1200K1600K2000KSE +/- 34826.19, N = 151692665.991628433.011758101.661685503.521. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Cryptoabcde200M400M600M800M1000MSE +/- 108830554.05, N = 15899403404.99770723548.74904442086.58904135820.16276965.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

82 Results Shown

NCNN:
  CPU - resnet18
  CPU - vgg16
  CPU - googlenet
  CPU - vision_transformer
Stress-NG
NCNN:
  CPU - resnet50
  CPU-v3-v3 - mobilenet-v3
Stress-NG
NCNN
Llama.cpp
Stress-NG:
  Cloning
  MMAP
Llama.cpp
Stress-NG
NCNN:
  CPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3
  CPU - mobilenet
Stress-NG
NCNN
Stress-NG:
  SENDFILE
  Semaphores
  Mutex
NCNN
Llama.cpp
Stress-NG
NCNN
Stress-NG
Llama.cpp:
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024
Stress-NG
NCNN
Llama.cpp:
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512
Stress-NG
Llama.cpp
Stress-NG
NCNN:
  CPU - mnasnet
  CPU - blazeface
  CPU - alexnet
Llama.cpp
Stress-NG:
  Context Switching
  MEMFD
NCNN
Stress-NG:
  Memory Copying
  Jpeg Compression
  Fractal Generator
  Malloc
  Integer Bit Operations
  NUMA
Llama.cpp
Stress-NG:
  Glibc Qsort Data Sorting
  Trigonometric Math
  CPU Stress
  Vector Shuffle
NCNN
Stress-NG
Llama.cpp
Stress-NG
Llama.cpp
Stress-NG:
  POSIX Regular Expressions
  Logarithmic Math
  Vector Floating Point
  Floating Point
  Power Math
  AVL Tree
  Function Call
  Pthread
  Bitonic Integer Sort
  Socket Activity
  Atomic
  Radix String Sort
  Fused Multiply-Add
  Hash
  Matrix Math
  Bessel Math Operations
  Matrix 3D Math
  Hyperbolic Trigonometric Math
  Vector Math
  Wide Vector Math
  x86_64 RdRand
  Zlib
  CPU Cache
  Crypto