System76 Thelio Astra Benchmarks With Ampere Altra

Benchmarks for a future article.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2410215-NE-THELIOAST43
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts

Limit displaying results to tests within:

Timed Code Compilation 3 Tests
C/C++ Compiler Tests 4 Tests
CPU Massive 6 Tests
Creator Workloads 3 Tests
HPC - High Performance Computing 11 Tests
Machine Learning 7 Tests
Molecular Dynamics 2 Tests
MPI Benchmarks 3 Tests
Multi-Core 10 Tests
OpenMPI Tests 3 Tests
Programmer / Developer System Benchmarks 4 Tests
Python Tests 5 Tests
Scientific Computing 3 Tests
Server 2 Tests
Server CPU Tests 5 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per RAM Channel Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
System76 Thelio Astra Altra M128-30
October 18
  12 Hours, 38 Minutes
System76 Thelio Major TR 7980X
October 19
  7 Hours, 11 Minutes
Invert Hiding All Results Option
  9 Hours, 55 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


System76 Thelio Astra Benchmarks With Ampere AltraProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerDisplay DriverOpenGLCompilerFile-SystemScreen ResolutionSystem76 Thelio Astra Altra M128-30System76 Thelio Major TR 7980XARMv8 Neoverse-N1 @ 3.00GHz (128 Cores)System76 Thelio Astra (3.02 BIOS)Ampere Computing LLC Altra PCI Root Complex A8 x 32GB DDR4-3200MT/s Micron 18ASF4G72PDZ-3G2F11024GB KINGSTON SKC3000S1024GNVIDIA RTX A400/PCIe 4GBNVIDIA Device 2291DELL P2415Q2 x Intel X550 + Intel I210Ubuntu 24.046.8.0-47-generic-64k (aarch64)GNOME Shell 46.0X Server 1.21.1.11NVIDIA 550.107.024.6.0GCC 13.2.0ext43840x2160AMD Ryzen Threadripper 7980X 64-Cores (64 Cores / 128 Threads)System76 Thelio Major (FA Z5 BIOS)AMD Device 14a44 x 32GB DDR5-4800MT/s Micron MTC20F1045S1RC48BA21000GB CT1000T700SSD5AMD Radeon RX 6700 XT 12GBAMD Device 14ccAquantia AQC113C NBase-T/IEEE + Realtek RTL8125 2.5GbE + Intel Wi-Fi 6E6.8.0-47-generic (x86_64)X Server + Wayland4.6 Mesa 24.0.9-0ubuntu0.2 (LLVM 17.0.6 DRM 3.57)1920x1200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- System76 Thelio Astra Altra M128-30: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-dIwDw0/gcc-13-13.2.0/debian/tmp-nvptx/usr --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-target-system-zlib=auto --without-cuda-driver -v - System76 Thelio Major TR 7980X: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-uJ7kn6/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- System76 Thelio Astra Altra M128-30: Scaling Governor: cppc_cpufreq schedutil (Boost: Disabled)- System76 Thelio Major TR 7980X: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105OpenCL Details- System76 Thelio Astra Altra M128-30: GPU Compute Cores: 768Python Details- Python 3.12.3Security Details- System76 Thelio Astra Altra M128-30: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of __user pointer sanitization + spectre_v2: Mitigation of CSV2 BHB + srbds: Not affected + tsx_async_abort: Not affected - System76 Thelio Major TR 7980X: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

System76 Thelio Astra Altra M128-30 vs. System76 Thelio Major TR 7980X ComparisonPhoronix Test SuiteBaseline+353.6%+353.6%+707.2%+707.2%+1060.8%+1060.8%+1414.4%+1414.4%892.5%783.9%673.7%660.9%390.3%333.2%324.5%324%259.8%225.2%206.5%202.2%187.4%181.2%178.6%172.2%168.9%161.9%154.9%138.2%126%118.7%111.2%110.7%107.1%101.1%100.1%1414.5%1414.1%1003.2%96.7%94.4%88.2%85.1%84%83.3%66.8%64.1%51%50.8%44%22.2%13.4%11.8%5.5%3.8%R.N.N.I - CPUC.B.S.A - CPUD.B.s - CPUR.N.N.T - CPUWPA PSKHMAC-SHA512Object DetectionR.R.W.Rggml-base.en - 2.S.o.t.UD.B.s - CPUP.P.B.T.TTime To CompilePabellon Barcelona - CPU-OnlyUpdate RandFishy Cat - CPU-OnlyR.R.W.RCoreUpdate Randggml-small.en - 2.S.o.t.UTime To CompileImage ProcessingBarbershop - CPU-OnlyClassroom - CPU-OnlyUniform PlasmaUnix Makefilesmobilenet-v1-1.0102.6%ggml-medium.en - 2.S.o.t.UIP Shapes 3D - CPUIP Shapes 1D - CPUMD5BMW27 - CPU-OnlyP.ACPU - 256 - ResNet-50inception-v387%Mobilenet Quant86.6%NinjaS.F.P.RCPU - 512 - ResNet-50FP16MobileNetV281.8%NASNet Mobile81.5%QS8MobileNetV275%FP16MobileNetV3Large73.2%FP16MobileNetV3Small72.8%FP16MobileNetV169%squeezenetv1.167.1%DNN - D.N.NMPI CPU - water_GMX50_baremobilenetV362.2%DeepLab V361.5%FP32MobileNetV3Small58.4%FP32MobileNetV252.1%bcryptBlowfishMobileNetV2_22447.9%nasnet46.7%FP32MobileNetV3Large46.2%P.P.B.T.TSqueezeNet39.7%SqueezeNetV1.035.8%4K - 1635.3%5K - 1635.3%Small32.5%1080p - 1630.9%104 104 104 - 6029.5%resnet-v2-5028.4%CoreMark Size 666 - I.P.SVideoStitching13.2%Q.C.S.M.v12.1%Read While WritingRand Read10.6%Mobilenet Float10.4%FP32MobileNetV19%Read While Writing6.9%I.R.V5.8%Inception V4Rand Read4.3%Features 2DoneDNNoneDNNoneDNNoneDNNJohn The RipperJohn The RipperOpenCVRocksDBWhisper.cpponeDNNsrsRAN ProjectTimed Node.js CompilationBlenderRocksDBBlenderSpeedbOpenCVSpeedbWhisper.cppTimed Godot Game Engine CompilationOpenCVBlenderBlenderWarpXTimed LLVM CompilationMobile Neural NetworkNumpy BenchmarkWhisper.cpponeDNNoneDNNJohn The RipperBlenderWarpXPyTorchMobile Neural NetworkLiteRTTimed LLVM CompilationACES DGEMMPyTorchXNNPACKLiteRTXNNPACKXNNPACKXNNPACKXNNPACKMobile Neural NetworkOpenCVGROMACSMobile Neural NetworkLiteRTXNNPACKXNNPACKJohn The RipperJohn The RipperMobile Neural NetworkMobile Neural NetworkXNNPACKsrsRAN ProjectLiteRTMobile Neural NetworkC-RayC-RayminiFEC-RayHigh Performance Conjugate GradientMobile Neural NetworkCoremarkOpenCVOpenCVLiteRTRocksDBRocksDBLiteRTXNNPACKSpeedbLiteRTLiteRTSpeedbOpenCVSystem76 Thelio Astra Altra M128-30System76 Thelio Major TR 7980X

System76 Thelio Astra Benchmarks With Ampere Altramt-dgemm: Sustained Floating-Point Rateblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyblender: Barbershop - CPU-Onlyc-ray: 1080p - 16c-ray: 4K - 16c-ray: 5K - 16coremark: CoreMark Size 666 - Iterations Per Secondgromacs: MPI CPU - water_GMX50_barehpcg: 104 104 104 - 60john-the-ripper: MD5john-the-ripper: Blowfishjohn-the-ripper: HMAC-SHA512john-the-ripper: bcryptjohn-the-ripper: WPA PSKlitert: Mobilenet Floatlitert: Mobilenet Quantlitert: NASNet Mobilelitert: SqueezeNetlitert: Inception ResNet V2litert: Inception V4litert: Quantized COCO SSD MobileNet v1litert: DeepLab V3minife: Smallmnn: nasnetmnn: mobilenetV3mnn: squeezenetv1.1mnn: resnet-v2-50mnn: SqueezeNetV1.0mnn: MobileNetV2_224mnn: mobilenet-v1-1.0mnn: inception-v3numpy: onednn: Convolution Batch Shapes Auto - CPUonednn: Deconvolution Batch shapes_1d - CPUonednn: Deconvolution Batch shapes_3d - CPUonednn: IP Shapes 1D - CPUonednn: IP Shapes 3D - CPUonednn: Recurrent Neural Network Training - CPUonednn: Recurrent Neural Network Inference - CPUopencv: DNN - Deep Neural Networkopencv: Features 2Dopencv: Object Detectionopencv: Coreopencv: Image Processingopencv: Stitchingopencv: Videopytorch: CPU - 256 - ResNet-50pytorch: CPU - 512 - ResNet-50rocksdb: Rand Readrocksdb: Read While Writingrocksdb: Read Rand Write Randrocksdb: Update Randspeedb: Rand Readspeedb: Read While Writingspeedb: Read Rand Write Randspeedb: Update Randsrsran: PUSCH Processor Benchmark, Throughput Totalsrsran: PDSCH Processor Benchmark, Throughput Totalbuild-godot: Time To Compilebuild-llvm: Ninjabuild-llvm: Unix Makefilesbuild-nodejs: Time To Compilewarpx: Plasma Accelerationwarpx: Uniform Plasmawhisper-cpp: ggml-base.en - 2016 State of the Unionwhisper-cpp: ggml-small.en - 2016 State of the Unionwhisper-cpp: ggml-medium.en - 2016 State of the Unionxnnpack: FP32MobileNetV1xnnpack: FP32MobileNetV2xnnpack: FP32MobileNetV3Largexnnpack: FP32MobileNetV3Smallxnnpack: FP16MobileNetV1xnnpack: FP16MobileNetV2xnnpack: FP16MobileNetV3Largexnnpack: FP16MobileNetV3Smallxnnpack: QS8MobileNetV2System76 Thelio Astra Altra M128-30System76 Thelio Major TR 7980X1875.13607735.8270.5365.08140.21357.056.90226.42746.9752793203.0670524.57421.41871219667100972688793331009401100611927.051368.6525569.72363.3029027.727845.62964.533372.0824201.410.0391.5762.35414.3104.3942.2421.94219.369366.854.9378925.32257.900928.638655.108254148.633215.5260292893331010361284932103712478491463024.2324.524741568951016008212921782173524639004651345722111602271746631504.813707.1229.783257.869415.578511.05147.6534204938.51536585405.39651564.899791056.782401943261041082705122120933304246023113450.89923418.2133.4023.3648.78163.299.03735.76863.5673413412.6278877.50416.5367134550001523112984113331524695396112127.822554.4546404.83300.4030710.626395.93323.555447.1218264.114.7272.5573.93418.3715.9693.3153.93436.227737.750.5586727.787231.021130.5705620.337279545.232323.99636150860432380147781930642806151289745.6144.954287735881136099954782376112514448922021258646731584424574314612.519740.796.471139.333200.646169.09524.5140256018.28281276112.68755221.59869528.11506211839696007428620633805572242524044OpenBenchmarking.org

ACES DGEMM

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-307001400210028003500SE +/- 3.64, N = 4SE +/- 4.30, N = 33450.901875.14-mavx21. (CC) gcc options: -ffast-math -O3 -fopenmp -lopenblas

Blender

Blender is an open-source 3D creation software project. This test is of Blender's Cycles benchmark with various sample files. GPU computing is supported. This system/blender test profile makes use of the system-supplied Blender. Use pts/blender if wishing to stick to a fixed version of Blender. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0.2Blend File: BMW27 - Compute: CPU-OnlySystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30816243240SE +/- 0.09, N = 3SE +/- 0.15, N = 318.2135.82

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0.2Blend File: Classroom - Compute: CPU-OnlySystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301632486480SE +/- 0.13, N = 3SE +/- 0.16, N = 333.4070.53

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0.2Blend File: Fishy Cat - Compute: CPU-OnlySystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301530456075SE +/- 0.11, N = 3SE +/- 0.27, N = 323.3665.08

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0.2Blend File: Pabellon Barcelona - Compute: CPU-OnlySystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30306090120150SE +/- 0.05, N = 3SE +/- 0.36, N = 348.78140.21

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0.2Blend File: Barbershop - Compute: CPU-OnlySystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3080160240320400SE +/- 0.33, N = 3SE +/- 0.30, N = 3163.29357.05

C-Ray

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 2.0Resolution: 1080p - Rays Per Pixel: 16System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-303691215SE +/- 0.016, N = 5SE +/- 0.001, N = 69.0376.9021. (CC) gcc options: -lpthread -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 2.0Resolution: 4K - Rays Per Pixel: 16System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30816243240SE +/- 0.10, N = 3SE +/- 0.02, N = 335.7726.431. (CC) gcc options: -lpthread -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 2.0Resolution: 5K - Rays Per Pixel: 16System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301428425670SE +/- 0.11, N = 3SE +/- 0.02, N = 363.5746.981. (CC) gcc options: -lpthread -lm

Coremark

This is a test of EEMBC CoreMark processor benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgIterations/Sec, More Is BetterCoremark 1.0CoreMark Size 666 - Iterations Per SecondSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30700K1400K2100K2800K3500KSE +/- 23890.91, N = 3SE +/- 1584.02, N = 33413412.632793203.071. (CC) gcc options: -O2 -lrt" -lrt

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3060120180240300Min: 28.94 / Avg: 265.43 / Max: 361.54Min: 23.78 / Avg: 138.85 / Max: 252.32

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3020406080100Min: 34 / Avg: 58.32 / Max: 92.5Min: 43 / Avg: 61.05 / Max: 77

Drive Temperature (nvme0n1) Monitor

OpenBenchmarking.orgCelsiusDrive Temperature (nvme0n1) MonitorPhoronix Test Suite System MonitoringSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30918273645Min: 36.85 / Avg: 41.47 / Max: 45.85Min: 24.85 / Avg: 27.9 / Max: 39.85

GROMACS

The GROMACS (GROningen MAchine for Chemical Simulations) molecular dynamics package testing with the water_GMX50 data. This test profile allows selecting between CPU and GPU-based GROMACS builds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACS 2024Implementation: MPI CPU - Input: water_GMX50_bareSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30246810SE +/- 0.017, N = 3SE +/- 0.013, N = 37.5044.5741. (CXX) g++ options: -O3 -lm

High Performance Conjugate Gradient

HPCG is the High Performance Conjugate Gradient and is a new scientific benchmark from Sandia National Lans focused for super-computer testing with modern real-world workloads compared to HPCC. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgGFLOP/s, More Is BetterHigh Performance Conjugate Gradient 3.1X Y Z: 104 104 104 - RT: 60System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30510152025SE +/- 0.02, N = 3SE +/- 0.00, N = 316.5421.421. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi

John The Ripper

This is a benchmark of John The Ripper, which is a password cracker. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: MD5System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-303M6M9M12M15MSE +/- 13316.66, N = 3SE +/- 5174.72, N = 3134550001219667-m641. (CC) gcc options: -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: BlowfishSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3030K60K90K120K150KSE +/- 202.63, N = 3SE +/- 126.74, N = 3152311100972-m641. (CC) gcc options: -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: HMAC-SHA512System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3060M120M180M240M300MSE +/- 860641.69, N = 3SE +/- 457404.76, N = 329841133368879333-m641. (CC) gcc options: -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: bcryptSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3030K60K90K120K150KSE +/- 186.01, N = 3SE +/- 259.62, N = 3152469100940-m641. (CC) gcc options: -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt

OpenBenchmarking.orgReal C/S, More Is BetterJohn The Ripper 2023.03.14Test: WPA PSKSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30120K240K360K480K600KSE +/- 1530.79, N = 3SE +/- 612.62, N = 3539611110061-m641. (CC) gcc options: -lssl -lcrypto -fopenmp -lm -lrt -lz -ldl -lcrypt

LiteRT

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Mobilenet FloatSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-305001000150020002500SE +/- 13.97, N = 3SE +/- 12.15, N = 32127.821927.05

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Mobilenet QuantSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-305001000150020002500SE +/- 36.53, N = 3SE +/- 9.82, N = 32554.451368.65

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: NASNet MobileSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3010K20K30K40K50KSE +/- 225.85, N = 3SE +/- 247.26, N = 346404.825569.7

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: SqueezeNetSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-307001400210028003500SE +/- 24.05, N = 3SE +/- 5.44, N = 33300.402363.30

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Inception ResNet V2System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-307K14K21K28K35KSE +/- 80.99, N = 3SE +/- 184.20, N = 330710.629027.7

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Inception V4System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-306K12K18K24K30KSE +/- 117.38, N = 3SE +/- 149.53, N = 326395.927845.6

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Quantized COCO SSD MobileNet v1System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-307001400210028003500SE +/- 24.92, N = 3SE +/- 17.01, N = 33323.552964.53

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: DeepLab V3System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3012002400360048006000SE +/- 29.16, N = 3SE +/- 20.38, N = 35447.123372.08

miniFE

MiniFE Finite Element is an application for unstructured implicit finite element codes. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgCG Mflops, More Is BetterminiFE 2.2Problem Size: SmallSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-305K10K15K20K25KSE +/- 22.76, N = 3SE +/- 20.09, N = 418264.124201.41. (CXX) g++ options: -O3 -fopenmp -lmpi_cxx -lmpi

Mobile Neural Network

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: nasnetSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3048121620SE +/- 0.16, N = 3SE +/- 0.02, N = 314.7310.04MIN: 14.05 / MAX: 19.07MIN: 9.76 / MAX: 11.231. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: mobilenetV3System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-300.57531.15061.72592.30122.8765SE +/- 0.012, N = 3SE +/- 0.032, N = 32.5571.576MIN: 2.39 / MAX: 3.37MIN: 1.38 / MAX: 2.661. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: squeezenetv1.1System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-300.88521.77042.65563.54084.426SE +/- 0.039, N = 3SE +/- 0.008, N = 33.9342.354MIN: 3.74 / MAX: 4.71MIN: 2.18 / MAX: 5.041. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: resnet-v2-50System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30510152025SE +/- 0.00, N = 3SE +/- 0.35, N = 318.3714.31MIN: 18.04 / MAX: 28.7MIN: 13.48 / MAX: 17.961. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: SqueezeNetV1.0System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301.3432.6864.0295.3726.715SE +/- 0.065, N = 3SE +/- 0.030, N = 35.9694.394MIN: 5.66 / MAX: 10.42MIN: 4.2 / MAX: 6.391. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: MobileNetV2_224System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-300.74591.49182.23772.98363.7295SE +/- 0.006, N = 3SE +/- 0.014, N = 33.3152.242MIN: 3.2 / MAX: 4.75MIN: 2.13 / MAX: 3.861. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: mobilenet-v1-1.0System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-300.88521.77042.65563.54084.426SE +/- 0.021, N = 3SE +/- 0.005, N = 33.9341.942MIN: 3.82 / MAX: 4.53MIN: 1.79 / MAX: 3.631. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

OpenBenchmarking.orgms, Fewer Is BetterMobile Neural Network 2.9.b11b7037dModel: inception-v3System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30816243240SE +/- 0.01, N = 3SE +/- 0.03, N = 336.2319.37MIN: 35.98 / MAX: 47.78MIN: 18.94 / MAX: 21.811. (CXX) g++ options: -std=c++11 -O3 -fvisibility=hidden -fomit-frame-pointer -fstrict-aliasing -ffunction-sections -fdata-sections -ffast-math -fno-rtti -fno-exceptions -pthread -ldl

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30160320480640800SE +/- 2.48, N = 3SE +/- 1.54, N = 3737.75366.85

oneDNN

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Convolution Batch Shapes Auto - Engine: CPUSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301.1112.2223.3334.4445.555SE +/- 0.001464, N = 7SE +/- 0.034692, N = 120.5586724.937890-mcpu=generic -lpthread - MIN: 4.071. (CXX) g++ options: -O3 -march=native -fopenmp -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Deconvolution Batch shapes_1d - Engine: CPUSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30612182430SE +/- 0.02546, N = 3SE +/- 0.23064, N = 77.7872325.32250-msse4.1 -fcf-protection=full - MIN: 4.91-mcpu=generic -lpthread - MIN: 19.771. (CXX) g++ options: -O3 -march=native -fopenmp -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Deconvolution Batch shapes_3d - Engine: CPUSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30246810SE +/- 0.00060, N = 9SE +/- 0.29556, N = 151.021137.90092-mcpu=generic -lpthread - MIN: 2.991. (CXX) g++ options: -O3 -march=native -fopenmp -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: IP Shapes 1D - Engine: CPUSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30246810SE +/- 0.002121, N = 4SE +/- 0.078824, N = 150.5705628.638650-mcpu=generic -lpthread - MIN: 3.441. (CXX) g++ options: -O3 -march=native -fopenmp -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: IP Shapes 3D - Engine: CPUSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301.14942.29883.44824.59765.747SE +/- 0.001823, N = 5SE +/- 0.125327, N = 150.3372795.108250-mcpu=generic -lpthread - MIN: 1.971. (CXX) g++ options: -O3 -march=native -fopenmp -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Recurrent Neural Network Training - Engine: CPUSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-309001800270036004500SE +/- 0.54, N = 3SE +/- 13.08, N = 3545.234148.63-mcpu=generic -lpthread - MIN: 3579.881. (CXX) g++ options: -O3 -march=native -fopenmp -fPIC -pie -ldl

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Recurrent Neural Network Inference - Engine: CPUSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-307001400210028003500SE +/- 0.63, N = 3SE +/- 30.66, N = 3324.003215.52-mcpu=generic -lpthread - MIN: 2717.061. (CXX) g++ options: -O3 -march=native -fopenmp -fPIC -pie -ldl

OpenCV

This is a benchmark of the OpenCV (Computer Vision) library's built-in performance tests. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenCV 4.7Test: DNN - Deep Neural NetworkSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3013K26K39K52K65KSE +/- 1239.45, N = 15SE +/- 717.84, N = 43615060292-msse -msse2 -msse31. (CXX) g++ options: -fsigned-char -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -fvisibility=hidden -O3 -ldl -lm -lpthread -lrt

OpenBenchmarking.orgms, Fewer Is BetterOpenCV 4.7Test: Features 2DSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3020K40K60K80K100KSE +/- 3626.20, N = 15SE +/- 2087.36, N = 128604389333-msse -msse2 -msse31. (CXX) g++ options: -fsigned-char -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -fvisibility=hidden -O3 -ldl -lm -lpthread -lrt

OpenBenchmarking.orgms, Fewer Is BetterOpenCV 4.7Test: Object DetectionSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3020K40K60K80K100KSE +/- 434.10, N = 15SE +/- 793.40, N = 923801101036-msse -msse2 -msse31. (CXX) g++ options: -fsigned-char -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -fvisibility=hidden -O3 -ldl -lm -lpthread -lrt

OpenBenchmarking.orgms, Fewer Is BetterOpenCV 4.7Test: CoreSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3030K60K90K120K150KSE +/- 436.47, N = 3SE +/- 482.28, N = 347781128493-msse -msse2 -msse31. (CXX) g++ options: -fsigned-char -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -fvisibility=hidden -O3 -ldl -lm -lpthread -lrt

OpenBenchmarking.orgms, Fewer Is BetterOpenCV 4.7Test: Image ProcessingSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3050K100K150K200K250KSE +/- 1000.50, N = 3SE +/- 1895.00, N = 1293064210371-msse -msse2 -msse31. (CXX) g++ options: -fsigned-char -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -fvisibility=hidden -O3 -ldl -lm -lpthread -lrt

OpenBenchmarking.orgms, Fewer Is BetterOpenCV 4.7Test: StitchingSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3060K120K180K240K300KSE +/- 2278.09, N = 3SE +/- 1011.33, N = 3280615247849-msse -msse2 -msse31. (CXX) g++ options: -fsigned-char -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -fvisibility=hidden -O3 -ldl -lm -lpthread -lrt

OpenBenchmarking.orgms, Fewer Is BetterOpenCV 4.7Test: VideoSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-303K6K9K12K15KSE +/- 121.71, N = 4SE +/- 169.59, N = 41289714630-msse -msse2 -msse31. (CXX) g++ options: -fsigned-char -pthread -fomit-frame-pointer -ffunction-sections -fdata-sections -fvisibility=hidden -O3 -ldl -lm -lpthread -lrt

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 256 - Model: ResNet-50System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301020304050SE +/- 0.15, N = 3SE +/- 0.34, N = 345.6124.23MIN: 42.27 / MAX: 46.41MIN: 11.28 / MAX: 26.16

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.2.1Device: CPU - Batch Size: 512 - Model: ResNet-50System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301020304050SE +/- 0.29, N = 3SE +/- 0.33, N = 344.9524.52MIN: 41.24 / MAX: 46.05MIN: 12.59 / MAX: 26.37

RocksDB

This is a benchmark of Meta/Facebook's RocksDB as an embeddable persistent key-value store for fast storage based on Google's LevelDB. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Random ReadSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30100M200M300M400M500MSE +/- 1100751.77, N = 3SE +/- 6329660.21, N = 34287735884741568951. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read While WritingSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-302M4M6M8M10MSE +/- 163321.59, N = 3SE +/- 84686.88, N = 311360999101600821. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Read Random Write RandomSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301.2M2.4M3.6M4.8M6MSE +/- 40762.83, N = 3SE +/- 9460.89, N = 3547823712921781. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

OpenBenchmarking.orgOp/s, More Is BetterRocksDB 9.0Test: Update RandomSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30130K260K390K520K650KSE +/- 681.42, N = 3SE +/- 1778.60, N = 36112512173521. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

Speedb

Speedb is a next-generation key value storage engine that is RocksDB compatible and aiming for stability, efficiency, and performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Random ReadSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30100M200M300M400M500MSE +/- 678570.59, N = 3SE +/- 4679221.79, N = 154448922024639004651. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read While WritingSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-303M6M9M12M15MSE +/- 230932.35, N = 15SE +/- 753903.88, N = 1512586467134572211. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Read Random Write RandomSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30700K1400K2100K2800K3500KSE +/- 6116.46, N = 3SE +/- 7547.70, N = 3315844211602271. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

OpenBenchmarking.orgOp/s, More Is BetterSpeedb 2.7Test: Update RandomSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30100K200K300K400K500KSE +/- 1072.72, N = 3SE +/- 1456.90, N = 34574311746631. (CXX) g++ options: -O3 -march=native -pthread -fno-builtin-memcmp -fno-rtti

srsRAN Project

srsRAN Project is a complete ORAN-native 5G RAN solution created by Software Radio Systems (SRS). The srsRAN Project radio suite was formerly known as srsLTE and can be used for building your own software-defined radio (SDR) 4G/5G mobile network. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PUSCH Processor Benchmark, Throughput TotalSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3010002000300040005000SE +/- 0.32, N = 3SE +/- 3.59, N = 34612.51504.8-march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq - MIN: 3132.3 / MAX: 4613.1MIN: 885.6 / MAX: 15121. (CXX) g++ options: -O3 -fno-trapping-math -fno-math-errno -ldl

OpenBenchmarking.orgMbps, More Is BettersrsRAN Project 23.10.1-20240325Test: PDSCH Processor Benchmark, Throughput TotalSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-304K8K12K16K20KSE +/- 57.06, N = 3SE +/- 72.39, N = 319740.713707.1-march=native -mavx2 -mavx -msse4.1 -mfma -mavx512f -mavx512cd -mavx512bw -mavx512dq1. (CXX) g++ options: -O3 -fno-trapping-math -fno-math-errno -ldl

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3050100150200250SE +/- 0.32, N = 3SE +/- 0.85, N = 396.47229.78

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3060120180240300SE +/- 0.20, N = 3SE +/- 0.98, N = 3139.33257.87

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: Unix MakefilesSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3090180270360450SE +/- 0.41, N = 3SE +/- 0.62, N = 3200.65415.58

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 21.7.2Time To CompileSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30110220330440550SE +/- 0.18, N = 3SE +/- 1.15, N = 3169.10511.05

WarpX

OpenBenchmarking.orgSeconds, Fewer Is BetterWarpX 24.10Input: Plasma AccelerationSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-301122334455SE +/- 0.04, N = 3SE +/- 0.09, N = 324.5147.651. (CXX) g++ options: -O3

OpenBenchmarking.orgSeconds, Fewer Is BetterWarpX 24.10Input: Uniform PlasmaSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30918273645SE +/- 0.11, N = 3SE +/- 0.31, N = 318.2838.521. (CXX) g++ options: -O3

Whisper.cpp

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-base.en - Input: 2016 State of the UnionSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3090180270360450SE +/- 0.11, N = 3SE +/- 1.58, N = 3112.69405.40-msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni-mcpu=native1. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-small.en - Input: 2016 State of the UnionSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30120240360480600SE +/- 0.09, N = 3SE +/- 23.23, N = 9221.60564.90-msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni-mcpu=native1. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-medium.en - Input: 2016 State of the UnionSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-302004006008001000SE +/- 1.16, N = 3SE +/- 42.64, N = 9528.121056.78-msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni-mcpu=native1. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

XNNPACK

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV1System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-305001000150020002500SE +/- 10.26, N = 3SE +/- 18.36, N = 3211819431. (CXX) g++ options: -O3 -lrt -lm

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV2System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-309001800270036004500SE +/- 20.17, N = 3SE +/- 26.06, N = 3396926101. (CXX) g++ options: -O3 -lrt -lm

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV3LargeSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3013002600390052006500SE +/- 21.73, N = 3SE +/- 73.96, N = 3600741081. (CXX) g++ options: -O3 -lrt -lm

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV3SmallSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-309001800270036004500SE +/- 4.67, N = 3SE +/- 12.91, N = 3428627051. (CXX) g++ options: -O3 -lrt -lm

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV1System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-30400800120016002000SE +/- 9.49, N = 3SE +/- 23.78, N = 3206312211. (CXX) g++ options: -O3 -lrt -lm

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV2System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-308001600240032004000SE +/- 10.73, N = 3SE +/- 28.10, N = 3380520931. (CXX) g++ options: -O3 -lrt -lm

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV3LargeSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-3012002400360048006000SE +/- 7.55, N = 3SE +/- 55.56, N = 3572233041. (CXX) g++ options: -O3 -lrt -lm

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV3SmallSystem76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-309001800270036004500SE +/- 5.70, N = 3SE +/- 73.70, N = 3425224601. (CXX) g++ options: -O3 -lrt -lm

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: QS8MobileNetV2System76 Thelio Major TR 7980XSystem76 Thelio Astra Altra M128-309001800270036004500SE +/- 39.34, N = 3SE +/- 61.16, N = 3404423111. (CXX) g++ options: -O3 -lrt -lm

82 Results Shown

ACES DGEMM
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Pabellon Barcelona - CPU-Only
  Barbershop - CPU-Only
C-Ray:
  1080p - 16
  4K - 16
  5K - 16
Coremark
CPU Power Consumption Monitor:
  Phoronix Test Suite System Monitoring:
    Watts
    Celsius
    Celsius
GROMACS
High Performance Conjugate Gradient
John The Ripper:
  MD5
  Blowfish
  HMAC-SHA512
  bcrypt
  WPA PSK
LiteRT:
  Mobilenet Float
  Mobilenet Quant
  NASNet Mobile
  SqueezeNet
  Inception ResNet V2
  Inception V4
  Quantized COCO SSD MobileNet v1
  DeepLab V3
miniFE
Mobile Neural Network:
  nasnet
  mobilenetV3
  squeezenetv1.1
  resnet-v2-50
  SqueezeNetV1.0
  MobileNetV2_224
  mobilenet-v1-1.0
  inception-v3
Numpy Benchmark
oneDNN:
  Convolution Batch Shapes Auto - CPU
  Deconvolution Batch shapes_1d - CPU
  Deconvolution Batch shapes_3d - CPU
  IP Shapes 1D - CPU
  IP Shapes 3D - CPU
  Recurrent Neural Network Training - CPU
  Recurrent Neural Network Inference - CPU
OpenCV:
  DNN - Deep Neural Network
  Features 2D
  Object Detection
  Core
  Image Processing
  Stitching
  Video
PyTorch:
  CPU - 256 - ResNet-50
  CPU - 512 - ResNet-50
RocksDB:
  Rand Read
  Read While Writing
  Read Rand Write Rand
  Update Rand
Speedb:
  Rand Read
  Read While Writing
  Read Rand Write Rand
  Update Rand
srsRAN Project:
  PUSCH Processor Benchmark, Throughput Total
  PDSCH Processor Benchmark, Throughput Total
Timed Godot Game Engine Compilation
Timed LLVM Compilation:
  Ninja
  Unix Makefiles
Timed Node.js Compilation
WarpX:
  Plasma Acceleration
  Uniform Plasma
Whisper.cpp:
  ggml-base.en - 2016 State of the Union
  ggml-small.en - 2016 State of the Union
  ggml-medium.en - 2016 State of the Union
XNNPACK:
  FP32MobileNetV1
  FP32MobileNetV2
  FP32MobileNetV3Large
  FP32MobileNetV3Small
  FP16MobileNetV1
  FP16MobileNetV2
  FP16MobileNetV3Large
  FP16MobileNetV3Small
  QS8MobileNetV2