new 2025

AMD EPYC 9655P 96-Core testing with a Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS) and ASPEED on Ubuntu 24.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2501190-NE-NEW20253068
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
a
January 19
  1 Hour
b
January 19
  2 Hours, 9 Minutes
c
January 19
  1 Hour, 1 Minute
d
January 19
  1 Hour, 1 Minute
e
January 19
  8 Minutes
Invert Behavior (Only Show Selected Data)
  1 Hour, 4 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


new 2025OpenBenchmarking.orgPhoronix Test SuiteAMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads)Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS)AMD 1Ah12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF3201GB Micron_7450_MTFDKCB3T2TFSASPEED2 x Broadcom NetXtreme BCM5720 PCIeUbuntu 24.106.13.0-rc4-phx-stock (x86_64)GNOME Shell 47.0X ServerGCC 14.2.0ext41024x768ProcessorMotherboardChipsetMemoryDiskGraphicsNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen ResolutionNew 2025 BenchmarksSystem Logs- Transparent Huge Pages: madvise- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xb002116 - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

abcdeLogarithmic Result OverviewPhoronix Test SuiteStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGStress-NGCryptoPipeCloningMMAPPollMutexFutexForkingMEMFDMallocNUMAPthreadAtomicHashZlib

new 2025stress-ng: Hashstress-ng: MMAPstress-ng: NUMAstress-ng: Pipestress-ng: Pollstress-ng: Zlibstress-ng: Futexstress-ng: MEMFDstress-ng: Mutexstress-ng: Atomicstress-ng: Cryptostress-ng: Mallocstress-ng: Cloningstress-ng: Forkingstress-ng: Pthreadstress-ng: AVL Treestress-ng: IO_uringstress-ng: SENDFILEstress-ng: CPU Cachestress-ng: CPU Stressstress-ng: Power Mathstress-ng: Semaphoresstress-ng: Matrix Mathstress-ng: Vector Mathstress-ng: AVX-512 VNNIstress-ng: Integer Mathstress-ng: Function Callstress-ng: x86_64 RdRandstress-ng: Floating Pointstress-ng: Matrix 3D Mathstress-ng: Memory Copyingstress-ng: Vector Shufflestress-ng: Mixed Schedulerstress-ng: Socket Activitystress-ng: Exponential Mathstress-ng: Jpeg Compressionstress-ng: Logarithmic Mathstress-ng: Wide Vector Mathstress-ng: Context Switchingstress-ng: Fractal Generatorstress-ng: Radix String Sortstress-ng: Fused Multiply-Addstress-ng: Trigonometric Mathstress-ng: Bitonic Integer Sortstress-ng: Vector Floating Pointstress-ng: Bessel Math Operationsstress-ng: Integer Bit Operationsstress-ng: Glibc C String Functionsstress-ng: Glibc Qsort Data Sortingstress-ng: System V Message Passingstress-ng: POSIX Regular Expressionsstress-ng: Hyperbolic Trigonometric Mathncnn: CPU - mobilenetncnn: CPU-v2-v2 - mobilenet-v2ncnn: CPU-v3-v3 - mobilenet-v3ncnn: CPU - shufflenet-v2ncnn: CPU - mnasnetncnn: CPU - efficientnet-b0ncnn: CPU - blazefacencnn: CPU - googlenetncnn: CPU - vgg16ncnn: CPU - resnet18ncnn: CPU - alexnetncnn: CPU - resnet50ncnn: CPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3ncnn: CPU - yolov4-tinyncnn: CPU - squeezenet_ssdncnn: CPU - regnety_400mncnn: CPU - vision_transformerncnn: CPU - FastestDetllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048abcde24396187.6710428.332481.5193409969.8410784198.111768.973638855.981919.7953532986.47309.28899403404.99284239015.2617095.96108842.42302128.671160.221174584.732154952.691692665.99248390.75224273.32308990236.83502535.3867295014960065.568891028.4986214.7843519846.0919070.5717150.1331375.3284138.45122963.0840702.33383630.4488326.04716302.056924089.9663915053.03693.41564.7138497783.11244291.111044.4379135.3460411.4723056228.01107612437.812548.1947541326.12661780.5593312.6811.665.756.276.515.568.783.6612.7125.36.783.6513.5911.6615.5713.1430.9328.838.3545.72109.12105.26111.4347.43111.83110.17112.5593.23371.1373.19351.8624359044.619912.942497.5886342322.2310723492.7811766.103760562.781900.4252886531.75309.50770723548.74286876085.5617134.67107808.84302585.291162.531158950.962246589.221628433.01250283.98224447.95316698667.93502617.42672523.5715009286.868864583.1686322.5643509192.0619039.7017168.2831364.5484762.10119811.3640726.66398930.7489241.18715277.296924707.0664954321.28688.121568.14138796151.41243089.841046.97379291.1560356.6222934130.22116765511.692568.7647921020.68658699.92593034.2312.265.727.056.425.638.823.6511.4928.3610.423.6314.4612.2616.1113.3130.1131.158.3745.58113.29112.48111.2247.6115.39107.87110.4193.09373.68363.38358.3524386852.139853.412489.4794350773.0710308236.1611767.973709094.161901.1153398638.82308.81904442086.58286437650.0517504.83108924.02302063.591161.971159544.852197431.311758101.66249308.78223750.11304269865.57501693.42672908.8114917255.998841688.186162.2943497875.2319000.2417161.9331565.7184482.6119458.9140788.38389486.0588010.39716894.756921682.4963768508.75684.291567.3138579068.09242366.631045.53378253.260345.122766908.87121505178.262554.4346473032.42660034.85593368.4111.715.766.236.415.558.683.5911.2229.858.083.6912.4311.7115.5113.230.535.078.0245.81113.24112.48113.3447.61112.67109.42109.7693.5364.03370.94358.7924350902.079889.772499.3180625187.9510651633.7611769.343675306.131902.3753247347.78309.49904135820.16285984682.2318352.08110596.05301801.151158.991151684.32168580.671685503.52250245.19223675.37311249205.79501990.13672816.3914905295.18897966.8286399.1343522600.1119014.2717176.6531095.3584525.31119549.1240689.5404064.5389337.3718105.016926027.0964355743.86691.631567.32138573633.55242558.251045.96379655.6960304.1323049501.32121109562.72568.3347987577.93660725.51593440.1811.725.766.247.185.668.973.6114.3437.159.013.712.5311.7215.9913.130.1727.68.0645.85109.2106.51111.2947.75107.16111.1111.894.08373.62366.93363.1624400600.129716.712511.9177385407.3310421659.7211768.363676509.081888.551459083.9309.34276965.13288021758.6917774.04109992.73302111.18OpenBenchmarking.org

Stress-NG

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Hashdbcae5M10M15M20M25MSE +/- 21888.88, N = 324350902.0724359044.6124386852.1324396187.6724400600.121. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: MMAPecdba2K4K6K8K10KSE +/- 9.81, N = 39716.719853.419889.779912.9410428.331. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: NUMAacbde5001000150020002500SE +/- 10.73, N = 32481.512489.472497.582499.312511.911. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pipeedbac20M40M60M80M100MSE +/- 1320514.40, N = 1277385407.3380625187.9586342322.2393409969.8494350773.071. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pollcedba2M4M6M8M10MSE +/- 81527.82, N = 310308236.1610421659.7210651633.7610723492.7810784198.101. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Zlibbcead3K6K9K12K15KSE +/- 5.26, N = 311766.1011767.9711768.3611768.9711769.341. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Futexadecb800K1600K2400K3200K4000KSE +/- 30393.34, N = 33638855.983675306.133676509.083709094.163760562.781. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: MEMFDebcda400800120016002000SE +/- 2.61, N = 31888.501900.421901.111902.371919.791. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mutexebdca11M22M33M44M55MSE +/- 30126.63, N = 351459083.9052886531.7553247347.7853398638.8253532986.471. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Atomiccaedb70140210280350SE +/- 0.10, N = 3308.81309.28309.34309.49309.501. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Cryptoebadc200M400M600M800M1000MSE +/- 108830554.05, N = 15276965.13770723548.74899403404.99904135820.16904442086.581. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mallocadcbe60M120M180M240M300MSE +/- 2355922.46, N = 3284239015.26285984682.23286437650.05286876085.56288021758.691. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Cloningabced4K8K12K16K20KSE +/- 172.38, N = 617095.9617134.6717504.8317774.0418352.081. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Forkingbaced20K40K60K80K100KSE +/- 1165.09, N = 3107808.84108842.42108924.02109992.73110596.051. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Pthreaddceab60K120K180K240K300KSE +/- 570.54, N = 3301801.15302063.59302111.18302128.67302585.291. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: AVL Treedacb30060090012001500SE +/- 2.09, N = 31158.991160.221161.971162.531. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: IO_uringdbca300K600K900K1200K1500KSE +/- 7669.66, N = 31151684.301158950.961159544.851174584.731. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: SENDFILEadcb500K1000K1500K2000K2500KSE +/- 12520.19, N = 32154952.692168580.672197431.312246589.221. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: CPU Cachebdac400K800K1200K1600K2000KSE +/- 34826.19, N = 151628433.011685503.521692665.991758101.661. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: CPU Stressacdb50K100K150K200K250KSE +/- 717.08, N = 3248390.75249308.78250245.19250283.981. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Power Mathdcab50K100K150K200K250KSE +/- 36.82, N = 3223675.37223750.11224273.32224447.951. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Semaphorescadb70M140M210M280M350MSE +/- 3510501.49, N = 5304269865.57308990236.83311249205.79316698667.931. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Matrix Mathcdab110K220K330K440K550KSE +/- 182.19, N = 3501693.42501990.13502535.38502617.421. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Mathbdca140K280K420K560K700KSE +/- 131.15, N = 3672523.57672816.39672908.81672950.001. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: AVX-512 VNNIdcab3M6M9M12M15MSE +/- 15958.95, N = 314905295.1014917255.9914960065.5615009286.861. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Integer Mathcbad2M4M6M8M10MSE +/- 12411.99, N = 38841688.108864583.168891028.498897966.821. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Function Callcabd20K40K60K80K100KSE +/- 75.87, N = 386162.2986214.7886322.5686399.131. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: x86_64 RdRandcbad9M18M27M36M45MSE +/- 8715.59, N = 343497875.2343509192.0643519846.0943522600.111. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Floating Pointcdba4K8K12K16K20KSE +/- 30.59, N = 319000.2419014.2719039.7019070.571. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Matrix 3D Mathacbd4K8K12K16K20KSE +/- 5.61, N = 317150.1317161.9317168.2817176.651. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Memory Copyingdbac7K14K21K28K35KSE +/- 50.08, N = 331095.3531364.5431375.3231565.711. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Shuffleacdb20K40K60K80K100KSE +/- 192.26, N = 384138.4584482.6084525.3184762.101. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Mixed Schedulercdba30K60K90K120K150KSE +/- 60.64, N = 3119458.91119549.12119811.36122963.081. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Socket Activitydabc9K18K27K36K45KSE +/- 40.26, N = 340689.5040702.3340726.6640788.381. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Exponential Mathacbd90K180K270K360K450KSE +/- 3969.34, N = 6383630.44389486.05398930.74404064.531. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Jpeg Compressioncabd20K40K60K80K100KSE +/- 336.69, N = 388010.3988326.0489241.1889337.301. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Logarithmic Mathbacd150K300K450K600K750KSE +/- 1549.57, N = 3715277.29716302.05716894.75718105.011. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Wide Vector Mathcabd1.5M3M4.5M6M7.5MSE +/- 1026.05, N = 36921682.496924089.966924707.066926027.091. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Context Switchingcadb14M28M42M56M70MSE +/- 279870.92, N = 363768508.7563915053.0364355743.8664954321.281. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Fractal Generatorcbda150300450600750SE +/- 2.15, N = 3684.29688.12691.63693.401. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Radix String Sortacdb30060090012001500SE +/- 0.60, N = 31564.701567.301567.321568.141. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Fused Multiply-Addadcb30M60M90M120M150MSE +/- 40538.03, N = 3138497783.11138573633.55138579068.09138796151.411. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Trigonometric Mathcdba50K100K150K200K250KSE +/- 407.29, N = 3242366.63242558.25243089.84244291.111. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Bitonic Integer Sortacdb2004006008001000SE +/- 1.18, N = 31044.401045.531045.961046.971. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Vector Floating Pointcabd80K160K240K320K400KSE +/- 955.04, N = 3378253.20379135.34379291.15379655.691. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Bessel Math Operationsdcba13K26K39K52K65KSE +/- 3.51, N = 360304.1360345.1060356.6260411.471. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Integer Bit Operationscbda5M10M15M20M25MSE +/- 79034.91, N = 322766908.8722934130.2223049501.3223056228.011. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Glibc C String Functionsabdc30M60M90M120M150M107612437.81116765511.69121109562.70121505178.261. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Glibc Qsort Data Sortingacdb60012001800240030002548.192554.432568.332568.761. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: System V Message Passingcabd10M20M30M40M50M46473032.4247541326.1247921020.6847987577.931. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: POSIX Regular Expressionsbcda140K280K420K560K700K658699.92660034.85660725.51661780.501. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

OpenBenchmarking.orgBogo Ops/s, More Is BetterStress-NG 0.18.09Test: Hyperbolic Trigonometric Mathbacd130K260K390K520K650K593034.23593312.68593368.41593440.181. (CXX) g++ options: -lm -laio -lapparmor -latomic -lcrypt -ldl -ljpeg -lEGL -lGLESv2 -lmpfr -lgmp -lsctp -lz -lrt -lpthread -lc -std=gnu99 -O2 -fipa-pta -fivopts -fmodulo-sched

NCNN

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: mobilenetbdca369121512.2611.7211.7111.66MIN: 11.83 / MAX: 38.58MIN: 11.52 / MAX: 12.06MIN: 11.51 / MAX: 11.88MIN: 11.45 / MAX: 12.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU-v2-v2 - Model: mobilenet-v2dcab1.2962.5923.8885.1846.485.765.765.755.72MIN: 5.65 / MAX: 7.3MIN: 5.66 / MAX: 5.97MIN: 5.65 / MAX: 6.15MIN: 5.61 / MAX: 6.141. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU-v3-v3 - Model: mobilenet-v3badc2468107.056.276.246.23MIN: 6.19 / MAX: 157.63MIN: 6.19 / MAX: 6.64MIN: 6.16 / MAX: 6.65MIN: 6.15 / MAX: 6.611. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: shufflenet-v2dabc2468107.186.516.426.41MIN: 6.33 / MAX: 199.41MIN: 6.43 / MAX: 8.49MIN: 6.37 / MAX: 6.67MIN: 6.34 / MAX: 6.71. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: mnasnetdbac1.27352.5473.82055.0946.36755.665.635.565.55MIN: 5.57 / MAX: 5.92MIN: 5.56 / MAX: 5.81MIN: 5.45 / MAX: 5.69MIN: 5.46 / MAX: 7.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: efficientnet-b0dbac36912158.978.828.788.68MIN: 8.79 / MAX: 9.27MIN: 8.63 / MAX: 15.62MIN: 8.63 / MAX: 9.09MIN: 8.54 / MAX: 8.971. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: blazefaceabdc0.82351.6472.47053.2944.11753.663.653.613.59MIN: 3.58 / MAX: 3.74MIN: 3.55 / MAX: 3.8MIN: 3.54 / MAX: 4.58MIN: 3.52 / MAX: 3.721. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: googlenetdabc4812162014.3412.7111.4911.22MIN: 11.33 / MAX: 392.85MIN: 10.95 / MAX: 204.69MIN: 11.27 / MAX: 11.81MIN: 10.84 / MAX: 13.821. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: vgg16dcba91827364537.1529.8528.3625.30MIN: 19 / MAX: 553.55MIN: 18.57 / MAX: 491.56MIN: 18.62 / MAX: 395.65MIN: 18.81 / MAX: 398.661. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: resnet18bdca369121510.429.018.086.78MIN: 6.5 / MAX: 500.3MIN: 6.6 / MAX: 197.68MIN: 6.59 / MAX: 143.39MIN: 6.57 / MAX: 7.451. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: alexnetdcab0.83251.6652.49753.334.16253.703.693.653.63MIN: 3.6 / MAX: 3.96MIN: 3.57 / MAX: 5.69MIN: 3.56 / MAX: 4.02MIN: 3.56 / MAX: 3.961. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: resnet50badc4812162014.4613.5912.5312.43MIN: 12.6 / MAX: 236.39MIN: 12.47 / MAX: 203.53MIN: 12.27 / MAX: 14.64MIN: 12.07 / MAX: 13.041. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3bdca369121512.2611.7211.7111.66MIN: 11.83 / MAX: 38.58MIN: 11.52 / MAX: 12.06MIN: 11.51 / MAX: 11.88MIN: 11.45 / MAX: 12.131. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: yolov4-tinybdac4812162016.1115.9915.5715.51MIN: 15.6 / MAX: 79.48MIN: 15.01 / MAX: 205MIN: 15.34 / MAX: 17.56MIN: 15.32 / MAX: 20.251. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: squeezenet_ssdbcad369121513.3113.2013.1413.10MIN: 13.17 / MAX: 15.89MIN: 12.76 / MAX: 15.13MIN: 12.98 / MAX: 13.61MIN: 12.73 / MAX: 22.511. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: regnety_400macdb71421283530.9330.5030.1730.11MIN: 30.33 / MAX: 129.22MIN: 30.05 / MAX: 66.6MIN: 29.93 / MAX: 32.92MIN: 29.92 / MAX: 32.781. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: vision_transformercbad81624324035.0731.1528.8327.60MIN: 27.34 / MAX: 470.93MIN: 27.65 / MAX: 419.66MIN: 27.44 / MAX: 145.29MIN: 27.29 / MAX: 30.051. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

OpenBenchmarking.orgms, Fewer Is BetterNCNN 20241226Target: CPU - Model: FastestDetbadc2468108.378.358.068.02MIN: 8.21 / MAX: 10.94MIN: 8.22 / MAX: 9.19MIN: 7.94 / MAX: 8.64MIN: 7.85 / MAX: 8.911. (CXX) g++ options: -O3 -rdynamic -lgomp -lpthread

Llama.cpp

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128bacd102030405045.5845.7245.8145.851. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512adcb306090120150109.12109.20113.24113.291. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024adbc306090120150105.26106.51112.48112.481. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048bdac306090120150111.22111.29111.43113.341. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128abcd112233445547.4347.6047.6147.751. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512dacb306090120150107.16111.83112.67115.391. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024bcad20406080100107.87109.42110.17111.101. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048cbda306090120150109.76110.41111.80112.551. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128bacd2040608010093.0993.2393.5094.081. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512cadb80160240320400364.03371.10373.62373.681. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024bdca80160240320400363.38366.93370.94373.191. (CXX) g++ options: -O3

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4397Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048abcd80160240320400351.86358.35358.79363.161. (CXX) g++ options: -O3

82 Results Shown

Stress-NG:
  Hash
  MMAP
  NUMA
  Pipe
  Poll
  Zlib
  Futex
  MEMFD
  Mutex
  Atomic
  Crypto
  Malloc
  Cloning
  Forking
  Pthread
  AVL Tree
  IO_uring
  SENDFILE
  CPU Cache
  CPU Stress
  Power Math
  Semaphores
  Matrix Math
  Vector Math
  AVX-512 VNNI
  Integer Math
  Function Call
  x86_64 RdRand
  Floating Point
  Matrix 3D Math
  Memory Copying
  Vector Shuffle
  Mixed Scheduler
  Socket Activity
  Exponential Math
  Jpeg Compression
  Logarithmic Math
  Wide Vector Math
  Context Switching
  Fractal Generator
  Radix String Sort
  Fused Multiply-Add
  Trigonometric Math
  Bitonic Integer Sort
  Vector Floating Point
  Bessel Math Operations
  Integer Bit Operations
  Glibc C String Functions
  Glibc Qsort Data Sorting
  System V Message Passing
  POSIX Regular Expressions
  Hyperbolic Trigonometric Math
NCNN:
  CPU - mobilenet
  CPU-v2-v2 - mobilenet-v2
  CPU-v3-v3 - mobilenet-v3
  CPU - shufflenet-v2
  CPU - mnasnet
  CPU - efficientnet-b0
  CPU - blazeface
  CPU - googlenet
  CPU - vgg16
  CPU - resnet18
  CPU - alexnet
  CPU - resnet50
  CPUv2-yolov3v2-yolov3 - mobilenetv2-yolov3
  CPU - yolov4-tiny
  CPU - squeezenet_ssd
  CPU - regnety_400m
  CPU - vision_transformer
  CPU - FastestDet
Llama.cpp:
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024
  CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024
  CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024
  CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048