new 2025

AMD EPYC 9655P 96-Core testing with a Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS) and ASPEED on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2501190-NE-NEW20253068
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
January 19
  1 Hour
b
January 19
  2 Hours, 9 Minutes
c
January 19
  1 Hour, 1 Minute
d
January 19
  1 Hour, 1 Minute
e
January 19
  8 Minutes
Invert Behavior (Only Show Selected Data)
  1 Hour, 4 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


new 2025OpenBenchmarking.orgPhoronix Test SuiteAMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads)Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS)AMD 1Ah12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 24.106.13.0-rc4-phx-stock (x86_64)GNOME Shell 47.0X ServerGCC 14.2.0ext41024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionNew 2025 BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xb002116 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

abcdeLogarithmic Result OverviewPhoronix Test SuiteStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGCryptoPipeCloningMMAPPollMutexFutexForkingMEMFDMallocNUMAPthreadAtomicHashZlib

new 2025ncnn: CPU - resnet18ncnn: CPU - vgg16ncnn: CPU - googlenetncnn: CPU - vision_transformerstress-ng: Pipencnn: CPU - resnet50ncnn: CPU-v3-v3 - mobilenet-v3stress-ng: Glibc C String Functionsncnn: CPU - shufflenet-v2llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512stress-ng: Cloningstress-ng: MMAPllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024stress-ng: Exponential Mathncnn: CPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3ncnn: CPU - mobilenetstress-ng: Pollncnn: CPU - FastestDetstress-ng: SENDFILEstress-ng: Semaphoresstress-ng: Mutexncnn: CPU - yolov4-tinyllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512stress-ng: Futexncnn: CPU - efficientnet-b0stress-ng: System V Message Passingllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024stress-ng: Mixed Schedulerncnn: CPU - regnety_400mllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512stress-ng: Forkingllama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048stress-ng: IO_uringncnn: CPU - mnasnetncnn: CPU - blazefacencnn: CPU - alexnetllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048stress-ng: Context Switchingstress-ng: MEMFDncnn: CPU - squeezenet_ssdstress-ng: Memory Copyingstress-ng: Jpeg Compressionstress-ng: Fractal Generatorstress-ng: Mallocstress-ng: Integer Bit Operationsstress-ng: NUMAllama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128stress-ng: Glibc Qsort Data Sortingstress-ng: Trigonometric Mathstress-ng: CPU Stressstress-ng: Vector Shufflencnn: CPU-v2-v2 - mobilenet-v2stress-ng: AVX-512 VNNIllama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128stress-ng: Integer Mathllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128stress-ng: POSIX Regular Expressionsstress-ng: Logarithmic Mathstress-ng: Vector Floating Pointstress-ng: Floating Pointstress-ng: Power Mathstress-ng: AVL Treestress-ng: Function Callstress-ng: Pthreadstress-ng: Bitonic Integer Sortstress-ng: Socket Activitystress-ng: Atomicstress-ng: Radix String Sortstress-ng: Fused Multiply-Addstress-ng: Hashstress-ng: Matrix Mathstress-ng: Bessel Math Operationsstress-ng: Matrix 3D Mathstress-ng: Hyperbolic Trigonometric Mathstress-ng: Vector Mathstress-ng: Wide Vector Mathstress-ng: x86_64 RdRandstress-ng: Zlibstress-ng: CPU Cachestress-ng: Cryptoabcde6.7825.312.7128.8393409969.8413.596.27107612437.816.51111.8317095.9610428.33105.26383630.4411.6611.6610784198.18.352154952.69308990236.8353532986.4715.57109.123638855.988.7847541326.12351.86110.17122963.0830.93373.19371.1108842.42112.551174584.735.563.663.65111.4363915053.031919.7913.1431375.3288326.04693.4284239015.2623056228.012481.5193.232548.19244291.11248390.7584138.455.7514960065.5647.438891028.4945.72661780.5716302.05379135.3419070.57224273.321160.2286214.78302128.671044.440702.33309.281564.7138497783.1124396187.67502535.3860411.4717150.13593312.686729506924089.9643519846.0911768.971692665.99899403404.9910.4228.3611.4931.1586342322.2314.467.05116765511.696.42115.3917134.679912.94112.48398930.7412.2612.2610723492.788.372246589.22316698667.9352886531.7516.11113.293760562.788.8247921020.68358.35107.87119811.3630.11363.38373.68107808.84110.411158950.965.633.653.63111.2264954321.281900.4213.3131364.5489241.18688.12286876085.5622934130.222497.5893.092568.76243089.84250283.9884762.105.7215009286.8647.68864583.1645.58658699.92715277.29379291.1519039.70224447.951162.5386322.56302585.291046.9740726.66309.501568.14138796151.4124359044.61502617.4260356.6217168.28593034.23672523.576924707.0643509192.0611766.101628433.01770723548.748.0829.8511.2235.0794350773.0712.436.23121505178.266.41112.6717504.839853.41112.48389486.0511.7111.7110308236.168.022197431.31304269865.5753398638.8215.51113.243709094.168.6846473032.42358.79109.42119458.9130.5370.94364.03108924.02109.761159544.855.553.593.69113.3463768508.751901.1113.231565.7188010.39684.29286437650.0522766908.872489.4793.52554.43242366.63249308.7884482.65.7614917255.9947.618841688.145.81660034.85716894.75378253.219000.24223750.111161.9786162.29302063.591045.5340788.38308.811567.3138579068.0924386852.13501693.4260345.117161.93593368.41672908.816921682.4943497875.2311767.971758101.66904442086.589.0137.1514.3427.680625187.9512.536.24121109562.77.18107.1618352.089889.77106.51404064.5311.7211.7210651633.768.062168580.67311249205.7953247347.7815.99109.23675306.138.9747987577.93363.16111.1119549.1230.17366.93373.62110596.05111.81151684.35.663.613.7111.2964355743.861902.3713.131095.3589337.3691.63285984682.2323049501.322499.3194.082568.33242558.25250245.1984525.315.7614905295.147.758897966.8245.85660725.51718105.01379655.6919014.27223675.371158.9986399.13301801.151045.9640689.5309.491567.32138573633.5524350902.07501990.1360304.1317176.65593440.18672816.396926027.0943522600.1111769.341685503.52904135820.1677385407.3317774.049716.7110421659.7251459083.93676509.08109992.731888.5288021758.692511.91302111.18309.3424400600.1211768.36276965.13OpenBenchmarking.org

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: resnet18acdb36912156.788.089.0110.42MIN: 6.57 / MAX: 7.45MIN: 6.59 / MAX: 143.39MIN: 6.6 / MAX: 197.68MIN: 6.5 / MAX: 500.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: vgg16abcd91827364525.3028.3629.8537.15MIN: 18.81 / MAX: 398.66MIN: 18.62 / MAX: 395.65MIN: 18.57 / MAX: 491.56MIN: 19 / MAX: 553.551. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: googlenetcbad4812162011.2211.4912.7114.34MIN: 10.84 / MAX: 13.82MIN: 11.27 / MAX: 11.81MIN: 10.95 / MAX: 204.69MIN: 11.33 / MAX: 392.851. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: vision_transformerdabc81624324027.6028.8331.1535.07MIN: 27.29 / MAX: 30.05MIN: 27.44 / MAX: 145.29MIN: 27.65 / MAX: 419.66MIN: 27.34 / MAX: 470.931. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pipecabde20M40M60M80M100MSE +/- 1320514.40, N = 1294350773.0793409969.8486342322.2380625187.9577385407.331. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: resnet50cdab4812162012.4312.5313.5914.46MIN: 12.07 / MAX: 13.04MIN: 12.27 / MAX: 14.64MIN: 12.47 / MAX: 203.53MIN: 12.6 / MAX: 236.391. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU-v3-v3 - Model: mobilenet-v3cdab2468106.236.246.277.05MIN: 6.15 / MAX: 6.61MIN: 6.16 / MAX: 6.65MIN: 6.19 / MAX: 6.64MIN: 6.19 / MAX: 157.631. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Glibc C String Functionscdba30M60M90M120M150M121505178.26121109562.70116765511.69107612437.811. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: shufflenet-v2cbad2468106.416.426.517.18MIN: 6.34 / MAX: 6.7MIN: 6.37 / MAX: 6.67MIN: 6.43 / MAX: 8.49MIN: 6.33 / MAX: 199.411. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512bcad306090120150115.39112.67111.83107.161. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Cloningdecba4K8K12K16K20KSE +/- 172.38, N = 618352.0817774.0417504.8317134.6717095.961. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: MMAPabdce2K4K6K8K10KSE +/- 9.81, N = 310428.339912.949889.779853.419716.711. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024cbda306090120150112.48112.48106.51105.261. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Exponential Mathdbca90K180K270K360K450KSE +/- 3969.34, N = 6404064.53398930.74389486.05383630.441. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3acdb369121511.6611.7111.7212.26MIN: 11.45 / MAX: 12.13MIN: 11.51 / MAX: 11.88MIN: 11.52 / MAX: 12.06MIN: 11.83 / MAX: 38.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: mobilenetacdb369121511.6611.7111.7212.26MIN: 11.45 / MAX: 12.13MIN: 11.51 / MAX: 11.88MIN: 11.52 / MAX: 12.06MIN: 11.83 / MAX: 38.581. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pollabdec2M4M6M8M10MSE +/- 81527.82, N = 310784198.1010723492.7810651633.7610421659.7210308236.161. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: FastestDetcdab2468108.028.068.358.37MIN: 7.85 / MAX: 8.91MIN: 7.94 / MAX: 8.64MIN: 8.22 / MAX: 9.19MIN: 8.21 / MAX: 10.941. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: SENDFILEbcda500K1000K1500K2000K2500KSE +/- 12520.19, N = 32246589.222197431.312168580.672154952.691. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Semaphoresbdac70M140M210M280M350MSE +/- 3510501.49, N = 5316698667.93311249205.79308990236.83304269865.571. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mutexacdbe11M22M33M44M55MSE +/- 30126.63, N = 353532986.4753398638.8253247347.7852886531.7551459083.901. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: yolov4-tinycadb4812162015.5115.5715.9916.11MIN: 15.32 / MAX: 20.25MIN: 15.34 / MAX: 17.56MIN: 15.01 / MAX: 205MIN: 15.6 / MAX: 79.481. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512bcda306090120150113.29113.24109.20109.121. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Futexbceda800K1600K2400K3200K4000KSE +/- 30393.34, N = 33760562.783709094.163676509.083675306.133638855.981. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: efficientnet-b0cabd36912158.688.788.828.97MIN: 8.54 / MAX: 8.97MIN: 8.63 / MAX: 9.09MIN: 8.63 / MAX: 15.62MIN: 8.79 / MAX: 9.271. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: System V Message Passingdbac10M20M30M40M50M47987577.9347921020.6847541326.1246473032.421. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048dcba80160240320400363.16358.79358.35351.861. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024dacb20406080100111.10110.17109.42107.871. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mixed Schedulerabdc30K60K90K120K150KSE +/- 60.64, N = 3122963.08119811.36119549.12119458.911. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: regnety_400mbdca71421283530.1130.1730.5030.93MIN: 29.92 / MAX: 32.78MIN: 29.93 / MAX: 32.92MIN: 30.05 / MAX: 66.6MIN: 30.33 / MAX: 129.221. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024acdb80160240320400373.19370.94366.93363.381. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512bdac80160240320400373.68373.62371.10364.031. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Forkingdecab20K40K60K80K100KSE +/- 1165.09, N = 3110596.05109992.73108924.02108842.42107808.841. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048adbc306090120150112.55111.80110.41109.761. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: IO_uringacbd300K600K900K1200K1500KSE +/- 7669.66, N = 31174584.731159544.851158950.961151684.301. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: mnasnetcabd1.27352.5473.82055.0946.36755.555.565.635.66MIN: 5.46 / MAX: 7.51MIN: 5.45 / MAX: 5.69MIN: 5.56 / MAX: 5.81MIN: 5.57 / MAX: 5.921. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: blazefacecdba0.82351.6472.47053.2944.11753.593.613.653.66MIN: 3.52 / MAX: 3.72MIN: 3.54 / MAX: 4.58MIN: 3.55 / MAX: 3.8MIN: 3.58 / MAX: 3.741. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: alexnetbacd0.83251.6652.49753.334.16253.633.653.693.70MIN: 3.56 / MAX: 3.96MIN: 3.56 / MAX: 4.02MIN: 3.57 / MAX: 5.69MIN: 3.6 / MAX: 3.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048cadb306090120150113.34111.43111.29111.221. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Context Switchingbdac14M28M42M56M70MSE +/- 279870.92, N = 364954321.2864355743.8663915053.0363768508.751. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: MEMFDadcbe400800120016002000SE +/- 2.61, N = 31919.791902.371901.111900.421888.501. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: squeezenet_ssddacb369121513.1013.1413.2013.31MIN: 12.73 / MAX: 22.51MIN: 12.98 / MAX: 13.61MIN: 12.76 / MAX: 15.13MIN: 13.17 / MAX: 15.891. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Memory Copyingcabd7K14K21K28K35KSE +/- 50.08, N = 331565.7131375.3231364.5431095.351. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Jpeg Compressiondbac20K40K60K80K100KSE +/- 336.69, N = 389337.3089241.1888326.0488010.391. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Fractal Generatoradbc150300450600750SE +/- 2.15, N = 3693.40691.63688.12684.291. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mallocebcda60M120M180M240M300MSE +/- 2355922.46, N = 3288021758.69286876085.56286437650.05285984682.23284239015.261. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Integer Bit Operationsadbc5M10M15M20M25MSE +/- 79034.91, N = 323056228.0123049501.3222934130.2222766908.871. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: NUMAedbca5001000150020002500SE +/- 10.73, N = 32511.912499.312497.582489.472481.511. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128dcab2040608010094.0893.5093.2393.091. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Glibc Qsort Data Sortingbdca60012001800240030002568.762568.332554.432548.191. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Trigonometric Mathabdc50K100K150K200K250KSE +/- 407.29, N = 3244291.11243089.84242558.25242366.631. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: CPU Stressbdca50K100K150K200K250KSE +/- 717.08, N = 3250283.98250245.19249308.78248390.751. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Shufflebdca20K40K60K80K100KSE +/- 192.26, N = 384762.1084525.3184482.6084138.451. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU-v2-v2 - Model: mobilenet-v2bacd1.2962.5923.8885.1846.485.725.755.765.76MIN: 5.61 / MAX: 6.14MIN: 5.65 / MAX: 6.15MIN: 5.66 / MAX: 5.97MIN: 5.65 / MAX: 7.31. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: AVX-512 VNNIbacd3M6M9M12M15MSE +/- 15958.95, N = 315009286.8614960065.5614917255.9914905295.101. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128dcba112233445547.7547.6147.6047.431. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Integer Mathdabc2M4M6M8M10MSE +/- 12411.99, N = 38897966.828891028.498864583.168841688.101. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128dcab102030405045.8545.8145.7245.581. (CXX) g++ options: -O3

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: POSIX Regular Expressionsadcb140K280K420K560K700K661780.50660725.51660034.85658699.921. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Logarithmic Mathdcab150K300K450K600K750KSE +/- 1549.57, N = 3718105.01716894.75716302.05715277.291. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Floating Pointdbac80K160K240K320K400KSE +/- 955.04, N = 3379655.69379291.15379135.34378253.201. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Floating Pointabdc4K8K12K16K20KSE +/- 30.59, N = 319070.5719039.7019014.2719000.241. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Power Mathbacd50K100K150K200K250KSE +/- 36.82, N = 3224447.95224273.32223750.11223675.371. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: AVL Treebcad30060090012001500SE +/- 2.09, N = 31162.531161.971160.221158.991. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Function Calldbac20K40K60K80K100KSE +/- 75.87, N = 386399.1386322.5686214.7886162.291. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pthreadbaecd60K120K180K240K300KSE +/- 570.54, N = 3302585.29302128.67302111.18302063.59301801.151. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Bitonic Integer Sortbdca2004006008001000SE +/- 1.18, N = 31046.971045.961045.531044.401. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Socket Activitycbad9K18K27K36K45KSE +/- 40.26, N = 340788.3840726.6640702.3340689.501. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Atomicbdeac70140210280350SE +/- 0.10, N = 3309.50309.49309.34309.28308.811. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Radix String Sortbdca30060090012001500SE +/- 0.60, N = 31568.141567.321567.301564.701. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Fused Multiply-Addbcda30M60M90M120M150MSE +/- 40538.03, N = 3138796151.41138579068.09138573633.55138497783.111. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Hasheacbd5M10M15M20M25MSE +/- 21888.88, N = 324400600.1224396187.6724386852.1324359044.6124350902.071. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Matrix Mathbadc110K220K330K440K550KSE +/- 182.19, N = 3502617.42502535.38501990.13501693.421. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Bessel Math Operationsabcd13K26K39K52K65KSE +/- 3.51, N = 360411.4760356.6260345.1060304.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Matrix 3D Mathdbca4K8K12K16K20KSE +/- 5.61, N = 317176.6517168.2817161.9317150.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Hyperbolic Trigonometric Mathdcab130K260K390K520K650K593440.18593368.41593312.68593034.231. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Mathacdb140K280K420K560K700KSE +/- 131.15, N = 3672950.00672908.81672816.39672523.571. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Wide Vector Mathdbac1.5M3M4.5M6M7.5MSE +/- 1026.05, N = 36926027.096924707.066924089.966921682.491. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: x86_64 RdRanddabc9M18M27M36M45MSE +/- 8715.59, N = 343522600.1143519846.0943509192.0643497875.231. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Zlibdaecb3K6K9K12K15KSE +/- 5.26, N = 311769.3411768.9711768.3611767.9711766.101. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: CPU Cachecadb400K800K1200K1600K2000KSE +/- 34826.19, N = 151758101.661692665.991685503.521628433.011. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Cryptocdabe200M400M600M800M1000MSE +/- 108830554.05, N = 15904442086.58904135820.16899403404.99770723548.74276965.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

82 Results Shown

NCNN:
  CPU - resnet18
  CPU - vgg16
  CPU - googlenet
  CPU - vision_transformer
Stress-NG
NCNN:
  CPU - resnet50
  CPU-v3-v3 - mobilenet-v3
Stress-NG
NCNN
Llama.cpp
Stress-NG:
  Cloning
  MMAP
Llama.cpp
Stress-NG
NCNN:
  CPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3
  CPU - mobilenet
Stress-NG
NCNN
Stress-NG:
  SENDFILE
  Semaphores
  Mutex
NCNN
Llama.cpp
Stress-NG
NCNN
Stress-NG
Llama.cpp:
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024
Stress-NG
NCNN
Llama.cpp:
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512
Stress-NG
Llama.cpp
Stress-NG
NCNN:
  CPU - mnasnet
  CPU - blazeface
  CPU - alexnet
Llama.cpp
Stress-NG:
  Context Switching
  MEMFD
NCNN
Stress-NG:
  Memory Copying
  Jpeg Compression
  Fractal Generator
  Malloc
  Integer Bit Operations
  NUMA
Llama.cpp
Stress-NG:
  Glibc Qsort Data Sorting
  Trigonometric Math
  CPU Stress
  Vector Shuffle
NCNN
Stress-NG
Llama.cpp
Stress-NG
Llama.cpp
Stress-NG:
  POSIX Regular Expressions
  Logarithmic Math
  Vector Floating Point
  Floating Point
  Power Math
  AVL Tree
  Function Call
  Pthread
  Bitonic Integer Sort
  Socket Activity
  Atomic
  Radix String Sort
  Fused Multiply-Add
  Hash
  Matrix Math
  Bessel Math Operations
  Matrix 3D Math
  Hyperbolic Trigonometric Math
  Vector Math
  Wide Vector Math
  x86_64 RdRand
  Zlib
  CPU Cache
  Crypto