TR Comparison

AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS) and AMD Radeon RX 5700 8GB on Pop 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2401140-NE-2401134NE94
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

BLAS (Basic Linear Algebra Sub-Routine) Tests 2 Tests
C++ Boost Tests 3 Tests
Timed Code Compilation 7 Tests
C/C++ Compiler Tests 4 Tests
CPU Massive 9 Tests
Creator Workloads 8 Tests
Game Development 2 Tests
HPC - High Performance Computing 10 Tests
Machine Learning 8 Tests
Multi-Core 15 Tests
NVIDIA GPU Compute 4 Tests
Intel oneAPI 3 Tests
OpenMPI Tests 2 Tests
Programmer / Developer System Benchmarks 7 Tests
Python Tests 10 Tests
Renderers 4 Tests
Server CPU Tests 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
TR 7980X DIY Build
January 12
  9 Hours, 33 Minutes
TR 3990X System76 Thelio
January 13
  15 Hours, 51 Minutes
Invert Hiding All Results Option
  12 Hours, 42 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


TR ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionTR 7980X DIY BuildTR 3990X System76 ThelioAMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads)ASUS Pro WS TRX50-SAGE WIFI (0607 BIOS)AMD Device 14a44 x 32 GB DRAM-4800MT/s F5-6400R3239G32GQ1000GB Western Digital WDS100T1X0E-00AFY0NAVI31 20GB (2025/1249MHz)Realtek ALC1220DELL U2723QEAquantia Device 04c0 + Intel Device 125b + MEDIATEK Device 0616Pop 22.046.6.6-76060606-generic (x86_64)GNOME Shell 42.5X Server 1.21.1.44.6 Mesa 23.3.2-1pop0~1704238321~22.04~36f1d0e (LLVM 15.0.7 DRM 3.54)1.3.267GCC 11.4.0ext43840x2160AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads)Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS)AMD Starship/Matisse4 x 32 GB DRAM-3000MT/s CMK64GX4M2D3000C16Samsung SSD 970 EVO Plus 500GBAMD Radeon RX 5700 8GB (1750/875MHz)AMD Navi 10 HDMI AudioDELL P2415QIntel I211 + Intel Wi-Fi 6 AX200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- TR 7980X DIY Build: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105- TR 3990X System76 Thelio: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x830107aPython Details- Python 3.10.12Security Details- TR 7980X DIY Build: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - TR 3990X System76 Thelio: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

TR 7980X DIY Build vs. TR 3990X System76 Thelio ComparisonPhoronix Test SuiteBaseline+192.5%+192.5%+385%+385%+577.5%+577.5%81.4%80.2%75.1%72.1%62.3%61.9%60.7%59.1%27.1%11.5%10.9%4.9%CPU - 256 - ResNet-50769.8%CPU - 16 - ResNet-50503.1%Eigen467%BLAS411%W.P.D.F.I - CPU344.3%F.D.F.I - CPU337%F.D.F.I - CPU335%W.P.D.F.I - CPU334.7%C.S.9.P.Y.P - A.M.S279%N.T.C.B.b.u.S.S.I - A.M.S261.2%R.5.S.I - A.M.S259.5%M.T.E.T.D.F - CPU258%M.T.E.T.D.F - CPU257.8%V.D.F.I - CPU243.5%V.D.F.I - CPU239.8%H.E.R.F.I - CPU233%H.E.R.F.I - CPU232.8%gravity_spheres_volume/dim_512/scivis/real_time232%gravity_spheres_volume/dim_512/ao/real_time222.6%B.L.N.Q.A.S.I - A.M.S214.6%F.D.R.F.I - CPU208.4%CPU - 1 - Efficientnet_v2_l196.5%CPU - 1 - ResNet-50195.3%CPU - 64 - ResNet-50193.5%R.S.A.F.I - CPU192.6%R.S.A.F.I - CPU192%A.G.R.R.0.F.I - CPU185%P.D.F - CPU184.5%P.D.F - CPU182.4%CPU - 64 - ResNet-152181%CPU - 64 - Efficientnet_v2_l179%P.V.B.D.F - CPU178.7%P.V.B.D.F - CPU175.6%CPU - 1 - ResNet-152168.3%A.G.R.R.0.F.I - CPU164.2%Compression Rating154.8%Pathtracer ISPC - Asian Dragon151.4%C.D.Y.C - A.M.S151.1%C.D.Y.C.S.I - A.M.S148.5%R.5.B - A.M.S147.2%C.C.R.5.I - A.M.S146.5%gravity_spheres_volume/dim_512/pathtracer/real_time138%N.D.C.o.b.u.o.I - A.M.S131.4%llama-2-13b.Q4_0.gguf130.1%Chrysler Neon 1M129.8%N.T.C.B.b.u.c - A.M.S126.9%B.L.N.Q.A - A.M.S122.4%d.M.M.S - Execution Time120.7%N.T.C.D.m - A.M.S120.6%llama-2-7b.Q4_0.gguf119.9%llama-2-70b-chat.Q5_0.gguf109.7%Preset 8 - Bosphorus 4K107.7%C.P.D.T106.4%d.S.M.S - Execution Time101.1%Preset 4 - Bosphorus 4K97.8%Pathtracer ISPC - Crown95.1%92.4%Barbershop - CPU-Only85.2%N.T.C.D.m - A.M.SCPU81.2%B.L.N.Q.A - A.M.SI.a.F.S.I.D.C77.7%d.M.M.S - Mesh Time76.6%R.O.R.S.I76%N.T.C.B.b.u.c - A.M.SClassroom - CPU-Only75.1%N.D.C.o.b.u.o.I - A.M.SPabellon Barcelona - CPU-Only67%Ninja66.9%Time To Compile66%BMW27 - CPU-Only64.8%Time To Compile64.5%Time To Compile63.1%C.C.R.5.I - A.M.SR.5.B - A.M.SC.D.Y.C.S.I - A.M.SF.D.R.F.I - CPU59.6%C.D.Y.C - A.M.Sparticle_volume/pathtracer/real_time58.4%Fishy Cat - CPU-Only57.8%Time To Compile57.5%particle_volume/scivis/real_time56%Preset 13 - Bosphorus 4K55.5%CPU - Supercar55.4%allmodconfig54.9%Multi-Threaded54.1%particle_volume/ao/real_time53.8%CPU - Bedroom53.3%defconfig53.1%CPU - 1 - ResNet-5052.4%Preset 12 - Bosphorus 4K52.1%B.S.o.W45.7%d.S.M.S - Mesh Time45.1%D.R45%Bumper Beam37.8%ggml-medium.en - 2.S.o.t.U36%ggml-small.en - 2.S.o.t.U30.1%ggml-base.en - 2.S.o.t.U29.2%B.L.N.Q.A.S.I - A.M.SR.5.S.I - A.M.SN.T.C.B.b.u.S.S.I - A.M.SC.S.9.P.Y.P - A.M.STensorFlowTensorFlowLeelaChessZeroLeelaChessZeroOpenVINOOpenVINOOpenVINOOpenVINONeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOSPRayOSPRayNeural Magic DeepSparseOpenVINOPyTorchPyTorchPyTorchOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOPyTorchPyTorchOpenVINOOpenVINOPyTorchOpenVINO7-Zip CompressionEmbreeNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseOSPRayNeural Magic DeepSparseLlama.cppOpenRadiossNeural Magic DeepSparseNeural Magic DeepSparseOpenFOAMNeural Magic DeepSparseLlama.cppLlama.cppSVT-AV1OpenRadiossOpenFOAMSVT-AV1EmbreeNumpy BenchmarkBlenderNeural Magic DeepSparseChaos Group V-RAYNeural Magic DeepSparseOpenRadiossOpenFOAMOpenRadiossNeural Magic DeepSparseBlenderNeural Magic DeepSparseBlenderTimed LLVM CompilationTimed FFmpeg CompilationBlenderTimed Godot Game Engine CompilationTimed Node.js CompilationNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseOpenVINONeural Magic DeepSparseOSPRayBlenderTimed Gem5 CompilationOSPRaySVT-AV1IndigoBenchTimed Linux Kernel CompilationQuantLibOSPRayIndigoBenchTimed Linux Kernel CompilationTensorFlowSVT-AV1OpenRadiossOpenFOAM7-Zip CompressionOpenRadiossWhisper.cppWhisper.cppWhisper.cppNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseTR 7980X DIY BuildTR 3990X System76 Thelio

TR Comparisonopenvino: Face Detection FP16-INT8 - CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUtensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 256 - ResNet-50pytorch: CPU - 1 - ResNet-50pytorch: CPU - 1 - ResNet-152pytorch: CPU - 1 - Efficientnet_v2_lpytorch: CPU - 64 - ResNet-50pytorch: CPU - 64 - ResNet-152pytorch: CPU - 64 - Efficientnet_v2_lwhisper-cpp: ggml-base.en - 2016 State of the Unionwhisper-cpp: ggml-small.en - 2016 State of the Unionwhisper-cpp: ggml-medium.en - 2016 State of the Unionllama-cpp: llama-2-7b.Q4_0.ggufllama-cpp: llama-2-13b.Q4_0.ggufllama-cpp: llama-2-70b-chat.Q5_0.gguflczero: BLASlczero: Eigendeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamnumpy: build-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-godot: Time To Compilebuild-ffmpeg: Time To Compilebuild-llvm: Ninjabuild-nodejs: Time To Compilebuild-gem5: Time To Compileblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyblender: Barbershop - CPU-Onlyospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownv-ray: CPUindigobench: CPU - Supercarindigobench: CPU - Bedroomcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: Cell Phone Drop Testopenradioss: Bumper Beamopenradioss: INIVOL and Fluid Structure Interaction Drop Containeropenradioss: Chrysler Neon 1Mquantlib: Multi-Threadedsvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio78.74405.37112465.330.40220.46145.957702.028.094727.166.674215.157.48429.1174.4213253.184.601711.0437.311601.3819.927.6259.41105.8559.7922.0812.8748.3919.058.23191.99942445.32330925.9806530.7818.433.04557533905.41368.8140190.480141.9629280.000128.542822.2065359.8588130.586961.2123133.539459.876122.2004359.858341.9230190.6468280.027428.54022372.16823.351827.6721288.5758405.484919.7033753.6823.413216.69079.84411.671122.225113.780178.79418.4747.1523.8057.94166.8823.425722.644626.506222.527522.5832239.319103.913893.45938857434.44615.70444334952923119.55385636.85956104.60125617.2658105.4253.1823.4175.61115.12292.06245683.2194.101198.74090.4509.24618.021763.3842563.231.1477.50412.091771.6035.941391.0922.911529.1920.85119.93266.394296.887.34514.20124.25548.4058.285.009.8512.1720.258.234.3416.496.782.95247.99593579.206721259.4050014.008.011.45109941003.658631.8335345.441392.5781454.444870.365538.8841816.6532207.7083153.6873214.5970148.803838.2162832.615643.9894722.5058453.263870.54962645.310212.050549.8527641.7697515.529761.9787391.7135.857335.736131.35719.377204.001185.538281.53830.4382.5437.5696.76309.067.261016.8203011.137714.649214.4799151.05041.333147.90194887122.16210.24217397036498128.37055974.108433184.712011362.3583153.6293.6148.31104.16204.54671.04159470.1124.791130.63143.5454.675OpenBenchmarking.org

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.45, N = 3SE +/- 0.07, N = 378.7418.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio1530456075Min: 78.14 / Avg: 78.74 / Max: 79.61Min: 17.92 / Avg: 18.02 / Max: 18.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio400800120016002000SE +/- 2.22, N = 3SE +/- 6.80, N = 3405.371763.38MIN: 344.27 / MAX: 423.97MIN: 1658.83 / MAX: 1802.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500Min: 400.99 / Avg: 405.37 / Max: 408.25Min: 1750.34 / Avg: 1763.38 / Max: 1773.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20K40K60K80K100KSE +/- 340.10, N = 3SE +/- 40.80, N = 3112465.3342563.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20K40K60K80K100KMin: 111826.41 / Avg: 112465.33 / Max: 112986.9Min: 42508.48 / Avg: 42563.23 / Max: 426431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio0.25650.5130.76951.0261.2825SE +/- 0.00, N = 3SE +/- 0.00, N = 30.401.14MIN: 0.18 / MAX: 27.23MIN: 0.58 / MAX: 11.741. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio246810Min: 0.39 / Avg: 0.4 / Max: 0.4Min: 1.14 / Avg: 1.14 / Max: 1.141. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 5.43, N = 15SE +/- 0.30, N = 3220.4677.501. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 206.83 / Avg: 220.46 / Max: 279.15Min: 76.9 / Avg: 77.5 / Max: 77.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio90180270360450SE +/- 3.04, N = 15SE +/- 1.75, N = 3145.95412.09MIN: 40.15 / MAX: 306.09MIN: 190.32 / MAX: 502.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio70140210280350Min: 114.46 / Avg: 145.95 / Max: 154.41Min: 410.31 / Avg: 412.09 / Max: 415.591. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio17003400510068008500SE +/- 11.71, N = 3SE +/- 2.55, N = 37702.021771.601. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio13002600390052006500Min: 7680.06 / Avg: 7702.02 / Max: 7720.04Min: 1768.51 / Avg: 1771.6 / Max: 1776.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio816243240SE +/- 0.02, N = 3SE +/- 0.05, N = 38.0935.94MIN: 3.7 / MAX: 19.86MIN: 18.09 / MAX: 65.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 8.06 / Avg: 8.09 / Max: 8.11Min: 35.84 / Avg: 35.94 / Max: 361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio10002000300040005000SE +/- 5.51, N = 3SE +/- 4.83, N = 34727.161391.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio8001600240032004000Min: 4720.67 / Avg: 4727.16 / Max: 4738.12Min: 1384.3 / Avg: 1391.09 / Max: 1400.431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.01, N = 3SE +/- 0.08, N = 36.6722.91MIN: 3.42 / MAX: 32MIN: 12.08 / MAX: 49.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 6.65 / Avg: 6.67 / Max: 6.68Min: 22.76 / Avg: 22.91 / Max: 23.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio9001800270036004500SE +/- 6.56, N = 3SE +/- 6.05, N = 34215.151529.191. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio7001400210028003500Min: 4202.88 / Avg: 4215.15 / Max: 4225.3Min: 1522.87 / Avg: 1529.19 / Max: 1541.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.01, N = 3SE +/- 0.08, N = 37.4820.85MIN: 4.13 / MAX: 17.57MIN: 11.83 / MAX: 44.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 7.46 / Avg: 7.48 / Max: 7.51Min: 20.69 / Avg: 20.85 / Max: 20.941. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio90180270360450SE +/- 0.87, N = 3SE +/- 0.81, N = 3429.11119.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio80160240320400Min: 428.13 / Avg: 429.11 / Max: 430.85Min: 118.63 / Avg: 119.93 / Max: 121.421. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300SE +/- 0.15, N = 3SE +/- 1.80, N = 374.42266.39MIN: 39.51 / MAX: 109.01MIN: 120.23 / MAX: 356.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250Min: 74.13 / Avg: 74.42 / Max: 74.58Min: 263.12 / Avg: 266.39 / Max: 269.321. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio3K6K9K12K15KSE +/- 23.14, N = 3SE +/- 10.47, N = 313253.184296.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio2K4K6K8K10KMin: 13224.41 / Avg: 13253.18 / Max: 13298.97Min: 4278.82 / Avg: 4296.88 / Max: 4315.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio246810SE +/- 0.01, N = 3SE +/- 0.02, N = 34.607.34MIN: 2.13 / MAX: 19.82MIN: 4.14 / MAX: 22.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio3691215Min: 4.58 / Avg: 4.6 / Max: 4.61Min: 7.3 / Avg: 7.34 / Max: 7.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio400800120016002000SE +/- 4.52, N = 3SE +/- 1.95, N = 31711.04514.201. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500Min: 1705.87 / Avg: 1711.04 / Max: 1720.06Min: 512.11 / Avg: 514.2 / Max: 518.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.10, N = 3SE +/- 0.47, N = 337.31124.25MIN: 21.65 / MAX: 56.7MIN: 71.1 / MAX: 148.341. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 37.11 / Avg: 37.31 / Max: 37.42Min: 123.31 / Avg: 124.25 / Max: 124.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500SE +/- 1.27, N = 3SE +/- 4.39, N = 151601.38548.401. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500Min: 1599.28 / Avg: 1601.38 / Max: 1603.66Min: 520.82 / Avg: 548.4 / Max: 576.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio1326395265SE +/- 0.02, N = 3SE +/- 0.46, N = 1519.9258.28MIN: 12.32 / MAX: 32.17MIN: 26.07 / MAX: 102.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio1224364860Min: 19.89 / Avg: 19.92 / Max: 19.95Min: 55.37 / Avg: 58.28 / Max: 61.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio246810SE +/- 0.02, N = 3SE +/- 0.01, N = 37.625.00
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio3691215Min: 7.59 / Avg: 7.62 / Max: 7.65Min: 4.98 / Avg: 5 / Max: 5.01

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1326395265SE +/- 0.19, N = 3SE +/- 0.06, N = 359.419.85
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1224364860Min: 59.05 / Avg: 59.41 / Max: 59.71Min: 9.76 / Avg: 9.85 / Max: 9.97

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 1.06, N = 3SE +/- 0.00, N = 3105.8512.17
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 104.38 / Avg: 105.85 / Max: 107.92Min: 12.16 / Avg: 12.17 / Max: 12.17

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Currently this test profile is catered to CPU-based testing. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1326395265SE +/- 0.17, N = 3SE +/- 0.15, N = 359.7920.25MIN: 54.43 / MAX: 61.61MIN: 18.92 / MAX: 21.46
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1224364860Min: 59.48 / Avg: 59.79 / Max: 60.06Min: 19.95 / Avg: 20.25 / Max: 20.46

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152TR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.12, N = 3SE +/- 0.09, N = 322.088.23MIN: 21.34 / MAX: 22.48MIN: 7.92 / MAX: 8.51
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152TR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 21.86 / Avg: 22.08 / Max: 22.25Min: 8.06 / Avg: 8.23 / Max: 8.37

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lTR 7980X DIY BuildTR 3990X System76 Thelio3691215SE +/- 0.04, N = 3SE +/- 0.02, N = 312.874.34MIN: 12.56 / MAX: 13.11MIN: 4.07 / MAX: 4.54
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lTR 7980X DIY BuildTR 3990X System76 Thelio48121620Min: 12.8 / Avg: 12.87 / Max: 12.93Min: 4.32 / Avg: 4.34 / Max: 4.38

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1122334455SE +/- 0.35, N = 3SE +/- 0.20, N = 348.3916.49MIN: 44.46 / MAX: 50.22MIN: 15.1 / MAX: 17.33
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1020304050Min: 47.87 / Avg: 48.39 / Max: 49.05Min: 16.27 / Avg: 16.49 / Max: 16.89

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152TR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.15, N = 3SE +/- 0.09, N = 319.056.78MIN: 18.34 / MAX: 19.48MIN: 6.01 / MAX: 7.11
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152TR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 18.79 / Avg: 19.05 / Max: 19.32Min: 6.64 / Avg: 6.78 / Max: 6.94

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 7980X DIY BuildTR 3990X System76 Thelio246810SE +/- 0.02, N = 3SE +/- 0.03, N = 38.232.95MIN: 6.24 / MAX: 8.41MIN: 2.79 / MAX: 3.12
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 7980X DIY BuildTR 3990X System76 Thelio3691215Min: 8.18 / Avg: 8.23 / Max: 8.26Min: 2.9 / Avg: 2.95 / Max: 3.01

Whisper.cpp

Whisper.cpp is a port of OpenAI's Whisper model in C/C++. Whisper.cpp is developed by Georgi Gerganov for transcribing WAV audio files to text / speech recognition. Whisper.cpp supports ARM NEON, x86 AVX, and other advanced CPU features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-base.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 4.70, N = 12SE +/- 0.87, N = 3192.00248.001. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-base.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 165.04 / Avg: 192 / Max: 218.19Min: 246.26 / Avg: 248 / Max: 248.941. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-small.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio130260390520650SE +/- 15.22, N = 9SE +/- 6.62, N = 9445.32579.211. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-small.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio100200300400500Min: 364.49 / Avg: 445.32 / Max: 482.62Min: 552.59 / Avg: 579.21 / Max: 617.151. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-medium.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500SE +/- 4.81, N = 3SE +/- 11.88, N = 7925.981259.411. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-medium.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000Min: 917.12 / Avg: 925.98 / Max: 933.66Min: 1210.21 / Avg: 1259.41 / Max: 1289.891. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

Llama.cpp

Llama.cpp is a port of Facebook's LLaMA model in C/C++ developed by Georgi Gerganov. Llama.cpp allows the inference of LLaMA and other supported models in C/C++. For CPU inference Llama.cpp supports AVX2/AVX-512, ARM NEON, and other modern ISAs along with features like OpenBLAS usage. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio714212835SE +/- 0.02, N = 3SE +/- 0.00, N = 330.7814.001. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio714212835Min: 30.75 / Avg: 30.78 / Max: 30.8Min: 14 / Avg: 14 / Max: 14.011. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.05, N = 3SE +/- 0.00, N = 318.438.011. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 18.33 / Avg: 18.43 / Max: 18.5Min: 8.01 / Avg: 8.01 / Max: 8.021. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio0.6841.3682.0522.7363.42SE +/- 0.03, N = 12SE +/- 0.00, N = 33.041.451. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio246810Min: 2.94 / Avg: 3.04 / Max: 3.3Min: 1.45 / Avg: 1.45 / Max: 1.451. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASTR 7980X DIY BuildTR 3990X System76 Thelio120240360480600SE +/- 2.19, N = 3SE +/- 0.88, N = 35571091. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASTR 7980X DIY BuildTR 3990X System76 Thelio100200300400500Min: 554 / Avg: 556.67 / Max: 561Min: 108 / Avg: 109.33 / Max: 1111. (CXX) g++ options: -flto -pthread

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenTR 7980X DIY BuildTR 3990X System76 Thelio120240360480600SE +/- 5.78, N = 3SE +/- 0.33, N = 3533941. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenTR 7980X DIY BuildTR 3990X System76 Thelio90180270360450Min: 522 / Avg: 533.33 / Max: 541Min: 94 / Avg: 94.33 / Max: 951. (CXX) g++ options: -flto -pthread

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000SE +/- 1.13, N = 3SE +/- 2.12, N = 3905.411003.66
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000Min: 903.19 / Avg: 905.41 / Max: 906.82Min: 1000.13 / Avg: 1003.66 / Max: 1007.47

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio714212835SE +/- 0.0108, N = 3SE +/- 0.0689, N = 38.814031.8335
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio714212835Min: 8.8 / Avg: 8.81 / Max: 8.84Min: 31.71 / Avg: 31.83 / Max: 31.94

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio80160240320400SE +/- 0.04, N = 3SE +/- 0.16, N = 3190.48345.44
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300Min: 190.4 / Avg: 190.48 / Max: 190.54Min: 345.24 / Avg: 345.44 / Max: 345.76

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.01, N = 3SE +/- 0.04, N = 341.9692.58
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 41.94 / Avg: 41.96 / Max: 41.99Min: 92.49 / Avg: 92.58 / Max: 92.63

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio100200300400500SE +/- 0.18, N = 3SE +/- 0.42, N = 3280.00454.44
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio80160240320400Min: 279.67 / Avg: 280 / Max: 280.28Min: 453.84 / Avg: 454.44 / Max: 455.26

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1632486480SE +/- 0.02, N = 3SE +/- 0.07, N = 328.5470.37
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1428425670Min: 28.52 / Avg: 28.54 / Max: 28.58Min: 70.24 / Avg: 70.37 / Max: 70.46

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio918273645SE +/- 0.03, N = 3SE +/- 0.26, N = 322.2138.88
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 22.17 / Avg: 22.21 / Max: 22.26Min: 38.36 / Avg: 38.88 / Max: 39.23

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000SE +/- 0.44, N = 3SE +/- 4.97, N = 3359.86816.65
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio140280420560700Min: 359.31 / Avg: 359.86 / Max: 360.72Min: 807.78 / Avg: 816.65 / Max: 824.96

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 0.20, N = 3SE +/- 0.61, N = 3130.59207.71
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 130.33 / Avg: 130.59 / Max: 130.99Min: 206.64 / Avg: 207.71 / Max: 208.77

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.10, N = 3SE +/- 0.45, N = 361.21153.69
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio306090120150Min: 61.02 / Avg: 61.21 / Max: 61.34Min: 152.9 / Avg: 153.69 / Max: 154.46

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 0.12, N = 3SE +/- 1.30, N = 3133.54214.60
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 133.3 / Avg: 133.54 / Max: 133.67Min: 212.05 / Avg: 214.6 / Max: 216.27

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.05, N = 3SE +/- 0.87, N = 359.88148.80
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio306090120150Min: 59.82 / Avg: 59.88 / Max: 59.98Min: 147.7 / Avg: 148.8 / Max: 150.53

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio918273645SE +/- 0.03, N = 3SE +/- 0.45, N = 322.2038.22
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 22.15 / Avg: 22.2 / Max: 22.24Min: 37.32 / Avg: 38.22 / Max: 38.71

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000SE +/- 0.17, N = 3SE +/- 9.47, N = 3359.86832.62
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio150300450600750Min: 359.65 / Avg: 359.86 / Max: 360.19Min: 822.97 / Avg: 832.62 / Max: 851.54

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1020304050SE +/- 0.02, N = 3SE +/- 0.09, N = 341.9243.99
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio918273645Min: 41.89 / Avg: 41.92 / Max: 41.95Min: 43.81 / Avg: 43.99 / Max: 44.1

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio160320480640800SE +/- 0.02, N = 3SE +/- 1.54, N = 3190.65722.51
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio130260390520650Min: 190.62 / Avg: 190.65 / Max: 190.68Min: 720.76 / Avg: 722.51 / Max: 725.57

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio100200300400500SE +/- 0.06, N = 3SE +/- 0.51, N = 3280.03453.26
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio80160240320400Min: 279.91 / Avg: 280.03 / Max: 280.09Min: 452.59 / Avg: 453.26 / Max: 454.27

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1632486480SE +/- 0.01, N = 3SE +/- 0.08, N = 328.5470.55
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1428425670Min: 28.53 / Avg: 28.54 / Max: 28.55Min: 70.39 / Avg: 70.55 / Max: 70.65

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio6001200180024003000SE +/- 9.01, N = 3SE +/- 11.68, N = 32372.172645.31
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio5001000150020002500Min: 2354.45 / Avg: 2372.17 / Max: 2383.83Min: 2622.97 / Avg: 2645.31 / Max: 2662.36

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio3691215SE +/- 0.0127, N = 3SE +/- 0.0526, N = 33.351812.0505
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio48121620Min: 3.34 / Avg: 3.35 / Max: 3.38Min: 11.97 / Avg: 12.05 / Max: 12.15

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1122334455SE +/- 0.04, N = 3SE +/- 0.00, N = 327.6749.85
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1020304050Min: 27.6 / Avg: 27.67 / Max: 27.74Min: 49.84 / Avg: 49.85 / Max: 49.86

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio140280420560700SE +/- 0.18, N = 3SE +/- 0.05, N = 3288.58641.77
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio110220330440550Min: 288.29 / Avg: 288.58 / Max: 288.9Min: 641.7 / Avg: 641.77 / Max: 641.87

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio110220330440550SE +/- 0.14, N = 3SE +/- 0.24, N = 3405.48515.53
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio90180270360450Min: 405.27 / Avg: 405.48 / Max: 405.73Min: 515.28 / Avg: 515.53 / Max: 516

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1428425670SE +/- 0.01, N = 3SE +/- 0.03, N = 319.7061.98
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1224364860Min: 19.69 / Avg: 19.7 / Max: 19.71Min: 61.92 / Avg: 61.98 / Max: 62.01

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkTR 7980X DIY BuildTR 3990X System76 Thelio160320480640800SE +/- 1.70, N = 3SE +/- 0.25, N = 3753.68391.71
OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkTR 7980X DIY BuildTR 3990X System76 Thelio130260390520650Min: 750.28 / Avg: 753.68 / Max: 755.44Min: 391.43 / Avg: 391.71 / Max: 392.21

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigTR 7980X DIY BuildTR 3990X System76 Thelio816243240SE +/- 0.23, N = 6SE +/- 0.29, N = 923.4135.86
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 22.83 / Avg: 23.41 / Max: 24.5Min: 35.46 / Avg: 35.86 / Max: 38.15

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigTR 7980X DIY BuildTR 3990X System76 Thelio70140210280350SE +/- 0.36, N = 3SE +/- 0.52, N = 3216.69335.74
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300Min: 216.12 / Avg: 216.69 / Max: 217.36Min: 335.1 / Avg: 335.74 / Max: 336.77

Timed Mesa Compilation

This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.

Time To Compile

TR 7980X DIY Build: The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

TR 3990X System76 Thelio: The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.14, N = 3SE +/- 0.30, N = 379.84131.36
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 79.56 / Avg: 79.84 / Max: 80Min: 130.86 / Avg: 131.36 / Max: 131.9

Timed FFmpeg Compilation

This test times how long it takes to build the FFmpeg multimedia library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.03, N = 4SE +/- 0.05, N = 311.6719.38
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 11.62 / Avg: 11.67 / Max: 11.74Min: 19.27 / Avg: 19.38 / Max: 19.44

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 0.22, N = 3SE +/- 0.18, N = 3122.23204.00
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 121.79 / Avg: 122.23 / Max: 122.46Min: 203.67 / Avg: 204 / Max: 204.27

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 0.78, N = 3SE +/- 1.78, N = 3113.78185.54
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio306090120150Min: 112.89 / Avg: 113.78 / Max: 115.34Min: 183.34 / Avg: 185.54 / Max: 189.07

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300SE +/- 2.15, N = 3SE +/- 1.78, N = 3178.79281.54
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250Min: 176.35 / Avg: 178.79 / Max: 183.09Min: 279.64 / Avg: 281.54 / Max: 285.09

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio714212835SE +/- 0.03, N = 3SE +/- 0.09, N = 318.4730.43
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio714212835Min: 18.42 / Avg: 18.47 / Max: 18.52Min: 30.27 / Avg: 30.43 / Max: 30.59

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.15, N = 3SE +/- 0.56, N = 347.1582.54
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio1632486480Min: 46.93 / Avg: 47.15 / Max: 47.44Min: 81.42 / Avg: 82.54 / Max: 83.14

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio918273645SE +/- 0.09, N = 3SE +/- 0.10, N = 323.8037.56
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 23.63 / Avg: 23.8 / Max: 23.91Min: 37.36 / Avg: 37.56 / Max: 37.69

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.15, N = 3SE +/- 0.24, N = 357.9496.76
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 57.64 / Avg: 57.94 / Max: 58.14Min: 96.28 / Avg: 96.76 / Max: 97.02

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio70140210280350SE +/- 0.09, N = 3SE +/- 1.16, N = 3166.88309.06
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300Min: 166.74 / Avg: 166.88 / Max: 167.05Min: 307.31 / Avg: 309.06 / Max: 311.25

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio612182430SE +/- 0.00283, N = 3SE +/- 0.00671, N = 323.425707.26101
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 23.42 / Avg: 23.43 / Max: 23.43Min: 7.25 / Avg: 7.26 / Max: 7.27

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.03326, N = 3SE +/- 0.00213, N = 322.644606.82030
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 22.58 / Avg: 22.64 / Max: 22.68Min: 6.82 / Avg: 6.82 / Max: 6.82

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio612182430SE +/- 0.03, N = 3SE +/- 0.01, N = 326.5111.14
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio612182430Min: 26.47 / Avg: 26.51 / Max: 26.57Min: 11.12 / Avg: 11.14 / Max: 11.15

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.03, N = 3SE +/- 0.00, N = 322.5314.65
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 22.49 / Avg: 22.53 / Max: 22.58Min: 14.65 / Avg: 14.65 / Max: 14.65

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 322.5814.48
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 22.57 / Avg: 22.58 / Max: 22.59Min: 14.46 / Avg: 14.48 / Max: 14.49

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 0.48, N = 3SE +/- 0.24, N = 3239.32151.05
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 238.44 / Avg: 239.32 / Max: 240.09Min: 150.58 / Avg: 151.05 / Max: 151.4

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.08, N = 6SE +/- 0.04, N = 3103.9141.33MIN: 102.79 / MAX: 105.67MIN: 40.86 / MAX: 42.73
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 103.59 / Avg: 103.91 / Max: 104.19Min: 41.25 / Avg: 41.33 / Max: 41.39

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.17, N = 6SE +/- 0.10, N = 493.4647.90MIN: 91.73 / MAX: 95.85MIN: 47.07 / MAX: 49.79
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 93.03 / Avg: 93.46 / Max: 94.11Min: 47.75 / Avg: 47.9 / Max: 48.19

Chaos Group V-RAY

This is a test of Chaos Group's V-RAY benchmark. V-RAY is a commercial renderer that can integrate with various creator software products like SketchUp and 3ds Max. The V-RAY benchmark is standalone and supports CPU and NVIDIA CUDA/RTX based rendering. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20K40K60K80K100KSE +/- 667.39, N = 3SE +/- 331.05, N = 158857448871
OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 7980X DIY BuildTR 3990X System76 Thelio15K30K45K60K75KMin: 87251 / Avg: 88574.33 / Max: 89387Min: 46833 / Avg: 48871.13 / Max: 51318

IndigoBench

This is a test of Indigo Renderer's IndigoBench benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarTR 7980X DIY BuildTR 3990X System76 Thelio816243240SE +/- 0.02, N = 3SE +/- 0.07, N = 334.4522.16
OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarTR 7980X DIY BuildTR 3990X System76 Thelio714212835Min: 34.4 / Avg: 34.45 / Max: 34.48Min: 22.03 / Avg: 22.16 / Max: 22.23

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomTR 7980X DIY BuildTR 3990X System76 Thelio48121620SE +/- 0.03, N = 3SE +/- 0.00, N = 315.7010.24
OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomTR 7980X DIY BuildTR 3990X System76 Thelio48121620Min: 15.64 / Avg: 15.7 / Max: 15.74Min: 10.24 / Avg: 10.24 / Max: 10.25

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingTR 7980X DIY BuildTR 3990X System76 Thelio90K180K270K360K450KSE +/- 469.56, N = 3SE +/- 158.08, N = 34433491739701. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingTR 7980X DIY BuildTR 3990X System76 Thelio80K160K240K320K400KMin: 442506 / Avg: 443348.67 / Max: 444129Min: 173655 / Avg: 173970 / Max: 1741511. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingTR 7980X DIY BuildTR 3990X System76 Thelio110K220K330K440K550KSE +/- 1196.73, N = 3SE +/- 687.51, N = 35292313649811. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingTR 7980X DIY BuildTR 3990X System76 Thelio90K180K270K360K450KMin: 526857 / Avg: 529231.33 / Max: 530680Min: 363701 / Avg: 364981 / Max: 3660561. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeTR 7980X DIY BuildTR 3990X System76 Thelio71421283519.5528.371. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeTR 7980X DIY BuildTR 3990X System76 Thelio163248648036.8674.111. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200104.60184.711. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500617.271362.361. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on WindshieldTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.68, N = 3SE +/- 0.67, N = 3105.42153.62
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on WindshieldTR 7980X DIY BuildTR 3990X System76 Thelio306090120150Min: 104.18 / Avg: 105.42 / Max: 106.51Min: 152.29 / Avg: 153.62 / Max: 154.37

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal InstallationTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.34, N = 3SE +/- 0.07, N = 353.1893.61
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal InstallationTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 52.53 / Avg: 53.18 / Max: 53.7Min: 93.48 / Avg: 93.61 / Max: 93.72

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestTR 7980X DIY BuildTR 3990X System76 Thelio1122334455SE +/- 0.10, N = 3SE +/- 0.36, N = 323.4148.31
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestTR 7980X DIY BuildTR 3990X System76 Thelio1020304050Min: 23.23 / Avg: 23.41 / Max: 23.58Min: 47.68 / Avg: 48.31 / Max: 48.92

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper BeamTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.65, N = 3SE +/- 0.27, N = 375.61104.16
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper BeamTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 74.9 / Avg: 75.61 / Max: 76.9Min: 103.64 / Avg: 104.16 / Max: 104.53

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 0.12, N = 3SE +/- 0.44, N = 3115.12204.54
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 114.89 / Avg: 115.12 / Max: 115.28Min: 203.67 / Avg: 204.54 / Max: 205.06

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MTR 7980X DIY BuildTR 3990X System76 Thelio140280420560700SE +/- 3.99, N = 3SE +/- 0.33, N = 3292.06671.04
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MTR 7980X DIY BuildTR 3990X System76 Thelio120240360480600Min: 284.8 / Avg: 292.06 / Max: 298.57Min: 670.6 / Avg: 671.04 / Max: 671.68

QuantLib

QuantLib is an open-source library/framework around quantitative finance for modeling, trading and risk management scenarios. QuantLib is written in C++ with Boost and its built-in benchmark used reports the QuantLib Benchmark Index benchmark score. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedTR 7980X DIY BuildTR 3990X System76 Thelio50K100K150K200K250KSE +/- 97.04, N = 3SE +/- 434.08, N = 3245683.2159470.11. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedTR 7980X DIY BuildTR 3990X System76 Thelio40K80K120K160K200KMin: 245538 / Avg: 245683.17 / Max: 245867.3Min: 158772.3 / Avg: 159470.1 / Max: 160266.31. (CXX) g++ options: -O3 -march=native -fPIE -pie

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 1.79, N = 15SE +/- 6.37, N = 13194.10124.791. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 186.73 / Avg: 194.1 / Max: 212.55Min: 48.48 / Avg: 124.79 / Max: 133.71. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 1.52, N = 15SE +/- 0.33, N = 5198.74130.631. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 189.35 / Avg: 198.74 / Max: 207.28Min: 129.84 / Avg: 130.63 / Max: 131.641. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.28, N = 5SE +/- 0.07, N = 390.4543.551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 89.38 / Avg: 90.45 / Max: 91.04Min: 43.46 / Avg: 43.55 / Max: 43.681. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio3691215SE +/- 0.001, N = 3SE +/- 0.020, N = 39.2464.6751. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio3691215Min: 9.24 / Avg: 9.25 / Max: 9.25Min: 4.64 / Avg: 4.68 / Max: 4.711. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

Meta Performance Per Watts

OpenBenchmarking.orgPerformance Per Watts, More Is BetterMeta Performance Per WattsPerformance Per WattsTR 7980X DIY BuildTR 3990X System76 Thelio2040608010099.2941.70

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringTR 7980X DIY BuildTR 3990X System76 Thelio10002000300040005000Min: 545 / Avg: 4217.07 / Max: 5617Min: 2196 / Avg: 3527.76 / Max: 4330

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringTR 7980X DIY BuildTR 3990X System76 Thelio70140210280350Min: 39.88 / Avg: 305.94 / Max: 372.82Min: 27.29 / Avg: 256.14 / Max: 305.51

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 36.88 / Avg: 64.84 / Max: 94.75Min: 42.25 / Avg: 65.24 / Max: 89

106 Results Shown

OpenVINO:
  Face Detection FP16-INT8 - CPU:
    FPS
    ms
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU:
    FPS
    ms
  Person Detection FP16 - CPU:
    FPS
    ms
  Weld Porosity Detection FP16-INT8 - CPU:
    FPS
    ms
  Vehicle Detection FP16-INT8 - CPU:
    FPS
    ms
  Person Vehicle Bike Detection FP16 - CPU:
    FPS
    ms
  Machine Translation EN To DE FP16 - CPU:
    FPS
    ms
  Face Detection Retail FP16-INT8 - CPU:
    FPS
    ms
  Handwritten English Recognition FP16-INT8 - CPU:
    FPS
    ms
  Road Segmentation ADAS FP16-INT8 - CPU:
    FPS
    ms
TensorFlow:
  CPU - 1 - ResNet-50
  CPU - 16 - ResNet-50
  CPU - 256 - ResNet-50
PyTorch:
  CPU - 1 - ResNet-50
  CPU - 1 - ResNet-152
  CPU - 1 - Efficientnet_v2_l
  CPU - 64 - ResNet-50
  CPU - 64 - ResNet-152
  CPU - 64 - Efficientnet_v2_l
Whisper.cpp:
  ggml-base.en - 2016 State of the Union
  ggml-small.en - 2016 State of the Union
  ggml-medium.en - 2016 State of the Union
Llama.cpp:
  llama-2-7b.Q4_0.gguf
  llama-2-13b.Q4_0.gguf
  llama-2-70b-chat.Q5_0.gguf
LeelaChessZero:
  BLAS
  Eigen
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  ResNet-50, Baseline - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream:
    items/sec
    ms/batch
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream:
    items/sec
    ms/batch
Numpy Benchmark
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed Godot Game Engine Compilation
Timed FFmpeg Compilation
Timed LLVM Compilation
Timed Node.js Compilation
Timed Gem5 Compilation
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Pabellon Barcelona - CPU-Only
  Barbershop - CPU-Only
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/ao/real_time
  particle_volume/scivis/real_time
  particle_volume/pathtracer/real_time
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Crown
Chaos Group V-RAY
IndigoBench:
  CPU - Supercar
  CPU - Bedroom
7-Zip Compression:
  Compression Rating
  Decompression Rating
OpenFOAM:
  drivaerFastback, Small Mesh Size - Mesh Time
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
  drivaerFastback, Medium Mesh Size - Execution Time
OpenRadioss:
  Bird Strike on Windshield
  Rubber O-Ring Seal Installation
  Cell Phone Drop Test
  Bumper Beam
  INIVOL and Fluid Structure Interaction Drop Container
  Chrysler Neon 1M
QuantLib
SVT-AV1:
  Preset 13 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 4 - Bosphorus 4K
Meta Performance Per Watts:
  Performance Per Watts
  Phoronix Test Suite System Monitoring
  Phoronix Test Suite System Monitoring
  Phoronix Test Suite System Monitoring