TR Comparison

AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS) and AMD Radeon RX 5700 8GB on Pop 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2401140-NE-2401134NE94
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

BLAS (Basic Linear Algebra Sub-Routine) Tests 2 Tests
C++ Boost Tests 3 Tests
Timed Code Compilation 7 Tests
C/C++ Compiler Tests 4 Tests
CPU Massive 9 Tests
Creator Workloads 8 Tests
Game Development 2 Tests
HPC - High Performance Computing 10 Tests
Machine Learning 8 Tests
Multi-Core 15 Tests
NVIDIA GPU Compute 4 Tests
Intel oneAPI 3 Tests
OpenMPI Tests 2 Tests
Programmer / Developer System Benchmarks 7 Tests
Python Tests 10 Tests
Renderers 4 Tests
Server CPU Tests 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
TR 7980X DIY Build
January 12
  9 Hours, 33 Minutes
TR 3990X System76 Thelio
January 13
  15 Hours, 51 Minutes
Invert Hiding All Results Option
  12 Hours, 42 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


TR ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionTR 7980X DIY BuildTR 3990X System76 ThelioAMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads)ASUS Pro WS TRX50-SAGE WIFI (0607 BIOS)AMD Device 14a44 x 32 GB DRAM-4800MT/s F5-6400R3239G32GQ1000GB Western Digital WDS100T1X0E-00AFY0NAVI31 20GB (2025/1249MHz)Realtek ALC1220DELL U2723QEAquantia Device 04c0 + Intel Device 125b + MEDIATEK Device 0616Pop 22.046.6.6-76060606-generic (x86_64)GNOME Shell 42.5X Server 1.21.1.44.6 Mesa 23.3.2-1pop0~1704238321~22.04~36f1d0e (LLVM 15.0.7 DRM 3.54)1.3.267GCC 11.4.0ext43840x2160AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads)Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS)AMD Starship/Matisse4 x 32 GB DRAM-3000MT/s CMK64GX4M2D3000C16Samsung SSD 970 EVO Plus 500GBAMD Radeon RX 5700 8GB (1750/875MHz)AMD Navi 10 HDMI AudioDELL P2415QIntel I211 + Intel Wi-Fi 6 AX200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- TR 7980X DIY Build: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105- TR 3990X System76 Thelio: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x830107aPython Details- Python 3.10.12Security Details- TR 7980X DIY Build: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - TR 3990X System76 Thelio: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

TR 7980X DIY Build vs. TR 3990X System76 Thelio ComparisonPhoronix Test SuiteBaseline+192.5%+192.5%+385%+385%+577.5%+577.5%81.4%80.2%75.1%72.1%62.3%61.9%60.7%59.1%27.1%11.5%10.9%4.9%CPU - 256 - ResNet-50769.8%CPU - 16 - ResNet-50503.1%Eigen467%BLAS411%W.P.D.F.I - CPU344.3%F.D.F.I - CPU337%F.D.F.I - CPU335%W.P.D.F.I - CPU334.7%C.S.9.P.Y.P - A.M.S279%N.T.C.B.b.u.S.S.I - A.M.S261.2%R.5.S.I - A.M.S259.5%M.T.E.T.D.F - CPU258%M.T.E.T.D.F - CPU257.8%V.D.F.I - CPU243.5%V.D.F.I - CPU239.8%H.E.R.F.I - CPU233%H.E.R.F.I - CPU232.8%gravity_spheres_volume/dim_512/scivis/real_time232%gravity_spheres_volume/dim_512/ao/real_time222.6%B.L.N.Q.A.S.I - A.M.S214.6%F.D.R.F.I - CPU208.4%CPU - 1 - Efficientnet_v2_l196.5%CPU - 1 - ResNet-50195.3%CPU - 64 - ResNet-50193.5%R.S.A.F.I - CPU192.6%R.S.A.F.I - CPU192%A.G.R.R.0.F.I - CPU185%P.D.F - CPU184.5%P.D.F - CPU182.4%CPU - 64 - ResNet-152181%CPU - 64 - Efficientnet_v2_l179%P.V.B.D.F - CPU178.7%P.V.B.D.F - CPU175.6%CPU - 1 - ResNet-152168.3%A.G.R.R.0.F.I - CPU164.2%Compression Rating154.8%Pathtracer ISPC - Asian Dragon151.4%C.D.Y.C - A.M.S151.1%C.D.Y.C.S.I - A.M.S148.5%R.5.B - A.M.S147.2%C.C.R.5.I - A.M.S146.5%gravity_spheres_volume/dim_512/pathtracer/real_time138%N.D.C.o.b.u.o.I - A.M.S131.4%llama-2-13b.Q4_0.gguf130.1%Chrysler Neon 1M129.8%N.T.C.B.b.u.c - A.M.S126.9%B.L.N.Q.A - A.M.S122.4%d.M.M.S - Execution Time120.7%N.T.C.D.m - A.M.S120.6%llama-2-7b.Q4_0.gguf119.9%llama-2-70b-chat.Q5_0.gguf109.7%Preset 8 - Bosphorus 4K107.7%C.P.D.T106.4%d.S.M.S - Execution Time101.1%Preset 4 - Bosphorus 4K97.8%Pathtracer ISPC - Crown95.1%92.4%Barbershop - CPU-Only85.2%N.T.C.D.m - A.M.SCPU81.2%B.L.N.Q.A - A.M.SI.a.F.S.I.D.C77.7%d.M.M.S - Mesh Time76.6%R.O.R.S.I76%N.T.C.B.b.u.c - A.M.SClassroom - CPU-Only75.1%N.D.C.o.b.u.o.I - A.M.SPabellon Barcelona - CPU-Only67%Ninja66.9%Time To Compile66%BMW27 - CPU-Only64.8%Time To Compile64.5%Time To Compile63.1%C.C.R.5.I - A.M.SR.5.B - A.M.SC.D.Y.C.S.I - A.M.SF.D.R.F.I - CPU59.6%C.D.Y.C - A.M.Sparticle_volume/pathtracer/real_time58.4%Fishy Cat - CPU-Only57.8%Time To Compile57.5%particle_volume/scivis/real_time56%Preset 13 - Bosphorus 4K55.5%CPU - Supercar55.4%allmodconfig54.9%Multi-Threaded54.1%particle_volume/ao/real_time53.8%CPU - Bedroom53.3%defconfig53.1%CPU - 1 - ResNet-5052.4%Preset 12 - Bosphorus 4K52.1%B.S.o.W45.7%d.S.M.S - Mesh Time45.1%D.R45%Bumper Beam37.8%ggml-medium.en - 2.S.o.t.U36%ggml-small.en - 2.S.o.t.U30.1%ggml-base.en - 2.S.o.t.U29.2%B.L.N.Q.A.S.I - A.M.SR.5.S.I - A.M.SN.T.C.B.b.u.S.S.I - A.M.SC.S.9.P.Y.P - A.M.STensorFlowTensorFlowLeelaChessZeroLeelaChessZeroOpenVINOOpenVINOOpenVINOOpenVINONeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOSPRayOSPRayNeural Magic DeepSparseOpenVINOPyTorchPyTorchPyTorchOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOPyTorchPyTorchOpenVINOOpenVINOPyTorchOpenVINO7-Zip CompressionEmbreeNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseOSPRayNeural Magic DeepSparseLlama.cppOpenRadiossNeural Magic DeepSparseNeural Magic DeepSparseOpenFOAMNeural Magic DeepSparseLlama.cppLlama.cppSVT-AV1OpenRadiossOpenFOAMSVT-AV1EmbreeNumpy BenchmarkBlenderNeural Magic DeepSparseChaos Group V-RAYNeural Magic DeepSparseOpenRadiossOpenFOAMOpenRadiossNeural Magic DeepSparseBlenderNeural Magic DeepSparseBlenderTimed LLVM CompilationTimed FFmpeg CompilationBlenderTimed Godot Game Engine CompilationTimed Node.js CompilationNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseOpenVINONeural Magic DeepSparseOSPRayBlenderTimed Gem5 CompilationOSPRaySVT-AV1IndigoBenchTimed Linux Kernel CompilationQuantLibOSPRayIndigoBenchTimed Linux Kernel CompilationTensorFlowSVT-AV1OpenRadiossOpenFOAM7-Zip CompressionOpenRadiossWhisper.cppWhisper.cppWhisper.cppNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseTR 7980X DIY BuildTR 3990X System76 Thelio

TR Comparisonpytorch: CPU - 1 - ResNet-152pytorch: CPU - 1 - Efficientnet_v2_lpytorch: CPU - 64 - ResNet-50pytorch: CPU - 64 - ResNet-152pytorch: CPU - 1 - ResNet-50pytorch: CPU - 64 - Efficientnet_v2_lopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownsvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ktensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 256 - ResNet-50ospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: particle_volume/ao/real_timedeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamindigobench: CPU - Supercarindigobench: CPU - Bedroomquantlib: Multi-Threadedcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratinglczero: BLASlczero: Eigennumpy: llama-cpp: llama-2-7b.Q4_0.ggufllama-cpp: llama-2-13b.Q4_0.ggufllama-cpp: llama-2-70b-chat.Q5_0.ggufv-ray: CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamwhisper-cpp: ggml-base.en - 2016 State of the Unionwhisper-cpp: ggml-small.en - 2016 State of the Unionwhisper-cpp: ggml-medium.en - 2016 State of the Unionbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-godot: Time To Compilebuild-ffmpeg: Time To Compilebuild-llvm: Ninjabuild-nodejs: Time To Compilebuild-gem5: Time To Compileblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyblender: Barbershop - CPU-Onlyopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: Cell Phone Drop Testopenradioss: Bumper Beamopenradioss: INIVOL and Fluid Structure Interaction Drop Containeropenradioss: Chrysler Neon 1MTR 7980X DIY BuildTR 3990X System76 Thelio22.0812.8748.3919.0559.798.2378.74112465.33220.467702.024727.164215.15429.1113253.181711.041601.38103.913893.4593194.101198.74090.4509.2467.6259.41105.8523.425726.506222.5832239.31922.644622.5275905.4136190.4801280.000122.2065130.5869133.539422.200441.9230280.02742372.168227.6721405.484934.44615.704245683.2443349529231557533753.6830.7818.433.0488574405.370.40145.958.096.677.4874.424.6037.3119.928.814041.962928.5428359.858861.212359.8761359.8583190.646828.54023.3518288.575819.7033191.99942445.32330925.9806523.413216.69079.84411.671122.225113.780178.79418.4747.1523.8057.94166.8819.55385636.85956104.60125617.2658105.4253.1823.4175.61115.12292.068.234.3416.496.7820.252.9518.0242563.2377.501771.601391.091529.19119.934296.88514.20548.4041.333147.9019124.791130.63143.5454.6755.009.8512.177.2610111.137714.4799151.0506.8203014.64921003.6586345.4413454.444838.8841207.7083214.597038.216243.9894453.26382645.310249.8527515.529722.16210.242159470.117397036498110994391.7114.008.011.45488711763.381.14412.0935.9422.9120.85266.397.34124.2558.2831.833592.578170.3655816.6532153.6873148.8038832.6156722.505870.549612.0505641.769761.9787247.99593579.206721259.4050035.857335.736131.35719.377204.001185.538281.53830.4382.5437.5696.76309.0628.37055974.108433184.712011362.3583153.6293.6148.31104.16204.54671.04OpenBenchmarking.org

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 42.25 / Avg: 65.24 / Max: 89Min: 36.88 / Avg: 64.84 / Max: 94.75

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringTR 3990X System76 ThelioTR 7980X DIY Build10002000300040005000Min: 2196 / Avg: 3527.76 / Max: 4330Min: 545 / Avg: 4217.07 / Max: 5617

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringTR 3990X System76 ThelioTR 7980X DIY Build70140210280350Min: 27.29 / Avg: 256.14 / Max: 305.51Min: 39.88 / Avg: 305.94 / Max: 372.82

PyTorch

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build0.05220.10440.15660.20880.2610.0800.232

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152TR 3990X System76 ThelioTR 7980X DIY Build510152025SE +/- 0.09, N = 3SE +/- 0.12, N = 38.2322.08MIN: 7.92 / MAX: 8.51MIN: 21.34 / MAX: 22.48
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152TR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 8.06 / Avg: 8.23 / Max: 8.37Min: 21.86 / Avg: 22.08 / Max: 22.25

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lTR 3990X System76 ThelioTR 7980X DIY Build3691215SE +/- 0.02, N = 3SE +/- 0.04, N = 34.3412.87MIN: 4.07 / MAX: 4.54MIN: 12.56 / MAX: 13.11
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lTR 3990X System76 ThelioTR 7980X DIY Build48121620Min: 4.32 / Avg: 4.34 / Max: 4.38Min: 12.8 / Avg: 12.87 / Max: 12.93

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build1122334455SE +/- 0.20, N = 3SE +/- 0.35, N = 316.4948.39MIN: 15.1 / MAX: 17.33MIN: 44.46 / MAX: 50.22
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build1020304050Min: 16.27 / Avg: 16.49 / Max: 16.89Min: 47.87 / Avg: 48.39 / Max: 49.05

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152TR 3990X System76 ThelioTR 7980X DIY Build510152025SE +/- 0.09, N = 3SE +/- 0.15, N = 36.7819.05MIN: 6.01 / MAX: 7.11MIN: 18.34 / MAX: 19.48
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152TR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 6.64 / Avg: 6.78 / Max: 6.94Min: 18.79 / Avg: 19.05 / Max: 19.32

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 3990X System76 ThelioTR 7980X DIY Build0.00590.01180.01770.02360.02950.0110.026

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build1326395265SE +/- 0.15, N = 3SE +/- 0.17, N = 320.2559.79MIN: 18.92 / MAX: 21.46MIN: 54.43 / MAX: 61.61
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build1224364860Min: 19.95 / Avg: 20.25 / Max: 20.46Min: 59.48 / Avg: 59.79 / Max: 60.06

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 3990X System76 ThelioTR 7980X DIY Build246810SE +/- 0.03, N = 3SE +/- 0.02, N = 32.958.23MIN: 2.79 / MAX: 3.12MIN: 6.24 / MAX: 8.41
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 3990X System76 ThelioTR 7980X DIY Build3691215Min: 2.9 / Avg: 2.95 / Max: 3.01Min: 8.18 / Avg: 8.23 / Max: 8.26

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.07, N = 3SE +/- 0.45, N = 318.0278.741. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build1530456075Min: 17.92 / Avg: 18.02 / Max: 18.15Min: 78.14 / Avg: 78.74 / Max: 79.611. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build20K40K60K80K100KSE +/- 40.80, N = 3SE +/- 340.10, N = 342563.23112465.331. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build20K40K60K80K100KMin: 42508.48 / Avg: 42563.23 / Max: 42643Min: 111826.41 / Avg: 112465.33 / Max: 112986.91. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build50100150200250SE +/- 0.30, N = 3SE +/- 5.43, N = 1577.50220.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build4080120160200Min: 76.9 / Avg: 77.5 / Max: 77.82Min: 206.83 / Avg: 220.46 / Max: 279.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build17003400510068008500SE +/- 2.55, N = 3SE +/- 11.71, N = 31771.607702.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build13002600390052006500Min: 1768.51 / Avg: 1771.6 / Max: 1776.66Min: 7680.06 / Avg: 7702.02 / Max: 7720.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build10002000300040005000SE +/- 4.83, N = 3SE +/- 5.51, N = 31391.094727.161. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build8001600240032004000Min: 1384.3 / Avg: 1391.09 / Max: 1400.43Min: 4720.67 / Avg: 4727.16 / Max: 4738.121. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build9001800270036004500SE +/- 6.05, N = 3SE +/- 6.56, N = 31529.194215.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build7001400210028003500Min: 1522.87 / Avg: 1529.19 / Max: 1541.29Min: 4202.88 / Avg: 4215.15 / Max: 4225.31. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build90180270360450SE +/- 0.81, N = 3SE +/- 0.87, N = 3119.93429.111. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build80160240320400Min: 118.63 / Avg: 119.93 / Max: 121.42Min: 428.13 / Avg: 429.11 / Max: 430.851. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build3K6K9K12K15KSE +/- 10.47, N = 3SE +/- 23.14, N = 34296.8813253.181. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build2K4K6K8K10KMin: 4278.82 / Avg: 4296.88 / Max: 4315.09Min: 13224.41 / Avg: 13253.18 / Max: 13298.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build400800120016002000SE +/- 1.95, N = 3SE +/- 4.52, N = 3514.201711.041. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build30060090012001500Min: 512.11 / Avg: 514.2 / Max: 518.1Min: 1705.87 / Avg: 1711.04 / Max: 1720.061. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build30060090012001500SE +/- 4.39, N = 15SE +/- 1.27, N = 3548.401601.381. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build30060090012001500Min: 520.82 / Avg: 548.4 / Max: 576.68Min: 1599.28 / Avg: 1601.38 / Max: 1603.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Embree

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 3990X System76 ThelioTR 7980X DIY Build0.08150.1630.24450.3260.40750.2000.362

SVT-AV1

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build0.10170.20340.30510.40680.50850.2300.452

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build0.00970.01940.02910.03880.04850.0230.043

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonTR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.04, N = 3SE +/- 0.08, N = 641.33103.91MIN: 40.86 / MAX: 42.73MIN: 102.79 / MAX: 105.67
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 41.25 / Avg: 41.33 / Max: 41.39Min: 103.59 / Avg: 103.91 / Max: 104.19

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.10, N = 4SE +/- 0.17, N = 647.9093.46MIN: 47.07 / MAX: 49.79MIN: 91.73 / MAX: 95.85
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 47.75 / Avg: 47.9 / Max: 48.19Min: 93.03 / Avg: 93.46 / Max: 94.11

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build4080120160200SE +/- 6.37, N = 13SE +/- 1.79, N = 15124.79194.101. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build4080120160200Min: 48.48 / Avg: 124.79 / Max: 133.7Min: 186.73 / Avg: 194.1 / Max: 212.551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build4080120160200SE +/- 0.33, N = 5SE +/- 1.52, N = 15130.63198.741. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build4080120160200Min: 129.84 / Avg: 130.63 / Max: 131.64Min: 189.35 / Avg: 198.74 / Max: 207.281. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.07, N = 3SE +/- 0.28, N = 543.5590.451. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 43.46 / Avg: 43.55 / Max: 43.68Min: 89.38 / Avg: 90.45 / Max: 91.041. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build3691215SE +/- 0.020, N = 3SE +/- 0.001, N = 34.6759.2461. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 3990X System76 ThelioTR 7980X DIY Build3691215Min: 4.64 / Avg: 4.68 / Max: 4.71Min: 9.24 / Avg: 9.25 / Max: 9.251. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 1 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build246810SE +/- 0.01, N = 3SE +/- 0.02, N = 35.007.62
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 1 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build3691215Min: 4.98 / Avg: 5 / Max: 5.01Min: 7.59 / Avg: 7.62 / Max: 7.65

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build1326395265SE +/- 0.06, N = 3SE +/- 0.19, N = 39.8559.41
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build1224364860Min: 9.76 / Avg: 9.85 / Max: 9.97Min: 59.05 / Avg: 59.41 / Max: 59.71

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.00, N = 3SE +/- 1.06, N = 312.17105.85
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50TR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 12.16 / Avg: 12.17 / Max: 12.17Min: 104.38 / Avg: 105.85 / Max: 107.92

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeTR 3990X System76 ThelioTR 7980X DIY Build612182430SE +/- 0.00671, N = 3SE +/- 0.00283, N = 37.2610123.42570
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeTR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 7.25 / Avg: 7.26 / Max: 7.27Min: 23.42 / Avg: 23.43 / Max: 23.43

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeTR 3990X System76 ThelioTR 7980X DIY Build612182430SE +/- 0.01, N = 3SE +/- 0.03, N = 311.1426.51
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeTR 3990X System76 ThelioTR 7980X DIY Build612182430Min: 11.12 / Avg: 11.14 / Max: 11.15Min: 26.47 / Avg: 26.51 / Max: 26.57

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeTR 3990X System76 ThelioTR 7980X DIY Build510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 314.4822.58
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeTR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 14.46 / Avg: 14.48 / Max: 14.49Min: 22.57 / Avg: 22.58 / Max: 22.59

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeTR 3990X System76 ThelioTR 7980X DIY Build50100150200250SE +/- 0.24, N = 3SE +/- 0.48, N = 3151.05239.32
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeTR 3990X System76 ThelioTR 7980X DIY Build4080120160200Min: 150.58 / Avg: 151.05 / Max: 151.4Min: 238.44 / Avg: 239.32 / Max: 240.09

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeTR 3990X System76 ThelioTR 7980X DIY Build510152025SE +/- 0.00213, N = 3SE +/- 0.03326, N = 36.8203022.64460
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeTR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 6.82 / Avg: 6.82 / Max: 6.82Min: 22.58 / Avg: 22.64 / Max: 22.68

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 3990X System76 ThelioTR 7980X DIY Build0.01510.03020.04530.06040.07550.0530.067

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 3990X System76 ThelioTR 7980X DIY Build510152025SE +/- 0.00, N = 3SE +/- 0.03, N = 314.6522.53
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 14.65 / Avg: 14.65 / Max: 14.65Min: 22.49 / Avg: 22.53 / Max: 22.58

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build2004006008001000SE +/- 2.12, N = 3SE +/- 1.13, N = 31003.66905.41
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build2004006008001000Min: 1000.13 / Avg: 1003.66 / Max: 1007.47Min: 903.19 / Avg: 905.41 / Max: 906.82

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build80160240320400SE +/- 0.16, N = 3SE +/- 0.04, N = 3345.44190.48
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build60120180240300Min: 345.24 / Avg: 345.44 / Max: 345.76Min: 190.4 / Avg: 190.48 / Max: 190.54

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build100200300400500SE +/- 0.42, N = 3SE +/- 0.18, N = 3454.44280.00
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build80160240320400Min: 453.84 / Avg: 454.44 / Max: 455.26Min: 279.67 / Avg: 280 / Max: 280.28

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build918273645SE +/- 0.26, N = 3SE +/- 0.03, N = 338.8822.21
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build816243240Min: 38.36 / Avg: 38.88 / Max: 39.23Min: 22.17 / Avg: 22.21 / Max: 22.26

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build50100150200250SE +/- 0.61, N = 3SE +/- 0.20, N = 3207.71130.59
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build4080120160200Min: 206.64 / Avg: 207.71 / Max: 208.77Min: 130.33 / Avg: 130.59 / Max: 130.99

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build50100150200250SE +/- 1.30, N = 3SE +/- 0.12, N = 3214.60133.54
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build4080120160200Min: 212.05 / Avg: 214.6 / Max: 216.27Min: 133.3 / Avg: 133.54 / Max: 133.67

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build918273645SE +/- 0.45, N = 3SE +/- 0.03, N = 338.2222.20
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build816243240Min: 37.32 / Avg: 38.22 / Max: 38.71Min: 22.15 / Avg: 22.2 / Max: 22.24

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build1020304050SE +/- 0.09, N = 3SE +/- 0.02, N = 343.9941.92
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build918273645Min: 43.81 / Avg: 43.99 / Max: 44.1Min: 41.89 / Avg: 41.92 / Max: 41.95

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build100200300400500SE +/- 0.51, N = 3SE +/- 0.06, N = 3453.26280.03
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build80160240320400Min: 452.59 / Avg: 453.26 / Max: 454.27Min: 279.91 / Avg: 280.03 / Max: 280.09

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build6001200180024003000SE +/- 11.68, N = 3SE +/- 9.01, N = 32645.312372.17
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build5001000150020002500Min: 2622.97 / Avg: 2645.31 / Max: 2662.36Min: 2354.45 / Avg: 2372.17 / Max: 2383.83

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build1122334455SE +/- 0.00, N = 3SE +/- 0.04, N = 349.8527.67
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build1020304050Min: 49.84 / Avg: 49.85 / Max: 49.86Min: 27.6 / Avg: 27.67 / Max: 27.74

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build110220330440550SE +/- 0.24, N = 3SE +/- 0.14, N = 3515.53405.48
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build90180270360450Min: 515.28 / Avg: 515.53 / Max: 516Min: 405.27 / Avg: 405.48 / Max: 405.73

IndigoBench

This is a test of Indigo Renderer's IndigoBench benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarTR 3990X System76 ThelioTR 7980X DIY Build816243240SE +/- 0.07, N = 3SE +/- 0.02, N = 322.1634.45
OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarTR 3990X System76 ThelioTR 7980X DIY Build714212835Min: 22.03 / Avg: 22.16 / Max: 22.23Min: 34.4 / Avg: 34.45 / Max: 34.48

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomTR 3990X System76 ThelioTR 7980X DIY Build48121620SE +/- 0.00, N = 3SE +/- 0.03, N = 310.2415.70
OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomTR 3990X System76 ThelioTR 7980X DIY Build48121620Min: 10.24 / Avg: 10.24 / Max: 10.25Min: 15.64 / Avg: 15.7 / Max: 15.74

OpenVINO

MinAvgMaxTR 3990X System76 Thelio290032394266TR 7980X DIY Build54536295194OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio290032043595TR 7980X DIY Build54538275018OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio239628404156TR 7980X DIY Build54541185219OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio290031824167TR 7980X DIY Build54535914456OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 3990X System76 Thelio289930324143TR 7980X DIY Build54535375065OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio222123764150TR 7980X DIY Build143236104876OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 3990X System76 Thelio223824404167TR 7980X DIY Build54536374645OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 3990X System76 Thelio290030224080TR 7980X DIY Build54535545044OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio259526894091TR 7980X DIY Build54535104194OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

MinAvgMaxTR 3990X System76 Thelio280831324186TR 7980X DIY Build146736514945OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Whisper.cpp

MinAvgMaxTR 3990X System76 Thelio290037334217TR 7980X DIY Build54545494992OpenBenchmarking.orgMegahertz, More Is BetterWhisper.cpp 1.4CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenBenchmarking.orgMegahertz, More Is BetterWhisper.cpp 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 3990X System76 ThelioTR 7980X DIY Build9001800270036004500Min: 2900 / Avg: 3682.86 / Max: 4236Min: 545 / Avg: 4516.14 / Max: 5155

OpenBenchmarking.orgMegahertz, More Is BetterWhisper.cpp 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 3990X System76 ThelioTR 7980X DIY Build9001800270036004500Min: 2900 / Avg: 3560.02 / Max: 4242Min: 545 / Avg: 4441.33 / Max: 5192

Llama.cpp

MinAvgMaxTR 3990X System76 Thelio290037554197TR 7980X DIY Build54540144903OpenBenchmarking.orgMegahertz, More Is BetterLlama.cpp b1808CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio290037394180TR 7980X DIY Build54542995277OpenBenchmarking.orgMegahertz, More Is BetterLlama.cpp b1808CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio290037724189TR 7980X DIY Build54545265304OpenBenchmarking.orgMegahertz, More Is BetterLlama.cpp b1808CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

LeelaChessZero

MinAvgMaxTR 3990X System76 Thelio290036294155TR 7980X DIY Build54543395391OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.30CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 3990X System76 Thelio290035144203TR 7980X DIY Build54543455371OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.30CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Neural Magic DeepSparse

MinAvgMaxTR 3990X System76 Thelio278331634212TR 7980X DIY Build54545235508OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 3990X System76 Thelio251929244192TR 7980X DIY Build54544645502OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 3990X System76 Thelio266929594220TR 7980X DIY Build54544345076OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio241230344222TR 7980X DIY Build54544425297OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio233129624264TR 7980X DIY Build54543665169OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio266929484208TR 7980X DIY Build54544174861OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 3990X System76 Thelio241130644167TR 7980X DIY Build54544895591OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 3990X System76 Thelio287531804167TR 7980X DIY Build54544905296OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio280030674199TR 7980X DIY Build54543674822OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 3990X System76 Thelio245234754242TR 7980X DIY Build54547335608OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 3990X System76 Thelio281831444237TR 7980X DIY Build54545375585OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Numpy Benchmark

MinAvgMaxTR 3990X System76 Thelio220041734261TR 7980X DIY Build54550315416OpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Timed Linux Kernel Compilation

MinAvgMaxTR 3990X System76 Thelio287035304269TR 7980X DIY Build54542825617OpenBenchmarking.orgMegahertz, More Is BetterTimed Linux Kernel Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 3990X System76 Thelio220031704244TR 7980X DIY Build149140945317OpenBenchmarking.orgMegahertz, More Is BetterTimed Linux Kernel Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Timed Godot Game Engine Compilation

MinAvgMaxTR 3990X System76 Thelio286835634235TR 7980X DIY Build54543575292OpenBenchmarking.orgMegahertz, More Is BetterTimed Godot Game Engine Compilation 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Timed FFmpeg Compilation

MinAvgMaxTR 3990X System76 Thelio220034314274TR 7980X DIY Build54539445336OpenBenchmarking.orgMegahertz, More Is BetterTimed FFmpeg Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Timed LLVM Compilation

MinAvgMaxTR 3990X System76 Thelio280033604217TR 7980X DIY Build54541875412OpenBenchmarking.orgMegahertz, More Is BetterTimed LLVM Compilation 16.0CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Timed Node.js Compilation

MinAvgMaxTR 3990X System76 Thelio282034794268TR 7980X DIY Build54542945442OpenBenchmarking.orgMegahertz, More Is BetterTimed Node.js Compilation 19.8.1CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Timed Gem5 Compilation

MinAvgMaxTR 3990X System76 Thelio220037634267TR 7980X DIY Build54547445577OpenBenchmarking.orgMegahertz, More Is BetterTimed Gem5 Compilation 23.0.1CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Blender

MinAvgMaxTR 3990X System76 Thelio220027654257TR 7980X DIY Build54533264194OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

MinAvgMaxTR 3990X System76 Thelio266827314142TR 7980X DIY Build54535375167OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio268227994193TR 7980X DIY Build54532875137OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio220027134092TR 7980X DIY Build54534954924OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio220027844217TR 7980X DIY Build54536675267OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Chaos Group V-RAY

OpenBenchmarking.orgMegahertz, More Is BetterChaos Group V-RAY 5.02CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 3990X System76 ThelioTR 7980X DIY Build9001800270036004500Min: 2657 / Avg: 3047.34 / Max: 4266Min: 545 / Avg: 3819.48 / Max: 5301

7-Zip Compression

MinAvgMaxTR 3990X System76 Thelio279535004242TR 7980X DIY Build54538105277OpenBenchmarking.orgMegahertz, More Is Better7-Zip Compression 22.01CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenFOAM

MinAvgMaxTR 3990X System76 Thelio290034094206TR 7980X DIY Build54539115461OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 3990X System76 ThelioTR 7980X DIY Build9001800270036004500Min: 2900 / Avg: 3756.27 / Max: 4193Min: 1470 / Avg: 4491.84 / Max: 5340

OpenRadioss

MinAvgMaxTR 3990X System76 Thelio290033894163TR 7980X DIY Build54540035238OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio290034644286TR 7980X DIY Build54540115192OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio290033574231TR 7980X DIY Build54537775269OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio290032704177TR 7980X DIY Build54538205053OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 3990X System76 Thelio290034074192TR 7980X DIY Build54539445125OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 3990X System76 ThelioTR 7980X DIY Build10002000300040005000Min: 2900 / Avg: 3790.09 / Max: 4231Min: 545 / Avg: 4557.74 / Max: 5559

QuantLib

MinAvgMaxTR 3990X System76 Thelio273228674142TR 7980X DIY Build54535214982OpenBenchmarking.orgMegahertz, More Is BetterQuantLib 1.32CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedTR 3990X System76 ThelioTR 7980X DIY Build50K100K150K200K250KSE +/- 434.08, N = 3SE +/- 97.04, N = 3159470.1245683.21. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedTR 3990X System76 ThelioTR 7980X DIY Build40K80K120K160K200KMin: 158772.3 / Avg: 159470.1 / Max: 160266.3Min: 245538 / Avg: 245683.17 / Max: 245867.31. (CXX) g++ options: -O3 -march=native -fPIE -pie

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingTR 3990X System76 ThelioTR 7980X DIY Build90K180K270K360K450KSE +/- 158.08, N = 3SE +/- 469.56, N = 31739704433491. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingTR 3990X System76 ThelioTR 7980X DIY Build80K160K240K320K400KMin: 173655 / Avg: 173970 / Max: 174151Min: 442506 / Avg: 443348.67 / Max: 4441291. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingTR 3990X System76 ThelioTR 7980X DIY Build110K220K330K440K550KSE +/- 687.51, N = 3SE +/- 1196.73, N = 33649815292311. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingTR 3990X System76 ThelioTR 7980X DIY Build90K180K270K360K450KMin: 363701 / Avg: 364981 / Max: 366056Min: 526857 / Avg: 529231.33 / Max: 5306801. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

LeelaChessZero

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.30Backend: EigenTR 3990X System76 ThelioTR 7980X DIY Build0.39380.78761.18141.57521.9690.3841.750

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASTR 3990X System76 ThelioTR 7980X DIY Build120240360480600SE +/- 0.88, N = 3SE +/- 2.19, N = 31095571. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASTR 3990X System76 ThelioTR 7980X DIY Build100200300400500Min: 108 / Avg: 109.33 / Max: 111Min: 554 / Avg: 556.67 / Max: 5611. (CXX) g++ options: -flto -pthread

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenTR 3990X System76 ThelioTR 7980X DIY Build120240360480600SE +/- 0.33, N = 3SE +/- 5.78, N = 3945331. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenTR 3990X System76 ThelioTR 7980X DIY Build90180270360450Min: 94 / Avg: 94.33 / Max: 95Min: 522 / Avg: 533.33 / Max: 5411. (CXX) g++ options: -flto -pthread

Meta Performance Per Watts

OpenBenchmarking.orgPerformance Per Watts, More Is BetterMeta Performance Per WattsPerformance Per WattsTR 3990X System76 ThelioTR 7980X DIY Build2040608010041.7099.29

Numpy Benchmark

OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkTR 3990X System76 ThelioTR 7980X DIY Build1.18462.36923.55384.73845.9233.4595.265

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkTR 3990X System76 ThelioTR 7980X DIY Build160320480640800SE +/- 0.25, N = 3SE +/- 1.70, N = 3391.71753.68
OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkTR 3990X System76 ThelioTR 7980X DIY Build130260390520650Min: 391.43 / Avg: 391.71 / Max: 392.21Min: 750.28 / Avg: 753.68 / Max: 755.44

Llama.cpp

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 3990X System76 ThelioTR 7980X DIY Build0.02390.04780.07170.09560.11950.0540.106

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 3990X System76 ThelioTR 7980X DIY Build0.01370.02740.04110.05480.06850.0300.061

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 3990X System76 ThelioTR 7980X DIY Build0.0020.0040.0060.0080.010.0050.009

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 3990X System76 ThelioTR 7980X DIY Build714212835SE +/- 0.00, N = 3SE +/- 0.02, N = 314.0030.781. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 3990X System76 ThelioTR 7980X DIY Build714212835Min: 14 / Avg: 14 / Max: 14.01Min: 30.75 / Avg: 30.78 / Max: 30.81. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 3990X System76 ThelioTR 7980X DIY Build510152025SE +/- 0.00, N = 3SE +/- 0.05, N = 38.0118.431. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 8.01 / Avg: 8.01 / Max: 8.02Min: 18.33 / Avg: 18.43 / Max: 18.51. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 3990X System76 ThelioTR 7980X DIY Build0.6841.3682.0522.7363.42SE +/- 0.00, N = 3SE +/- 0.03, N = 121.453.041. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 3990X System76 ThelioTR 7980X DIY Build246810Min: 1.45 / Avg: 1.45 / Max: 1.45Min: 2.94 / Avg: 3.04 / Max: 3.31. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

Chaos Group V-RAY

OpenBenchmarking.orgvsamples Per Watt, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 3990X System76 ThelioTR 7980X DIY Build60120180240300200.02289.23

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 3990X System76 ThelioTR 7980X DIY Build20K40K60K80K100KSE +/- 331.05, N = 15SE +/- 667.39, N = 34887188574
OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 3990X System76 ThelioTR 7980X DIY Build15K30K45K60K75KMin: 46833 / Avg: 48871.13 / Max: 51318Min: 87251 / Avg: 88574.33 / Max: 89387

OpenVINO

MinAvgMaxTR 3990X System76 Thelio42.366.272.3TR 7980X DIY Build37.363.476.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio47.067.371.0TR 7980X DIY Build47.466.870.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio48.362.369.8TR 7980X DIY Build48.366.081.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.869.171.8TR 7980X DIY Build48.367.371.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio48.568.972.0TR 7980X DIY Build49.166.769.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.064.169.0TR 7980X DIY Build48.667.071.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio50.063.767.5TR 7980X DIY Build49.165.569.6OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio50.069.772.8TR 7980X DIY Build49.167.171.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.868.071.3TR 7980X DIY Build48.368.171.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.868.676.8TR 7980X DIY Build49.167.573.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

Whisper.cpp

MinAvgMaxTR 3990X System76 Thelio48.866.670.5TR 7980X DIY Build49.169.376.0OpenBenchmarking.orgCelsius, Fewer Is BetterWhisper.cpp 1.4CPU Temperature Monitor20406080100

OpenBenchmarking.orgCelsius, Fewer Is BetterWhisper.cpp 1.4CPU Temperature MonitorTR 3990X System76 ThelioTR 7980X DIY Build1428425670Min: 48.75 / Avg: 67.13 / Max: 71.75Min: 48.25 / Avg: 68.54 / Max: 75.13

OpenBenchmarking.orgCelsius, Fewer Is BetterWhisper.cpp 1.4CPU Temperature MonitorTR 3990X System76 ThelioTR 7980X DIY Build1530456075Min: 48.75 / Avg: 67.38 / Max: 71Min: 49.13 / Avg: 69.3 / Max: 75.5

Neural Magic DeepSparse

MinAvgMaxTR 3990X System76 Thelio46.360.667.0TR 7980X DIY Build46.050.552.4OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio48.361.866.3TR 7980X DIY Build42.849.051.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.363.968.0TR 7980X DIY Build41.949.051.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio48.561.968.3TR 7980X DIY Build43.649.051.4OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.064.269.5TR 7980X DIY Build41.948.550.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.864.368.8TR 7980X DIY Build41.448.250.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.562.369.5TR 7980X DIY Build41.948.451.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio48.863.172.5TR 7980X DIY Build41.548.750.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.063.567.8TR 7980X DIY Build42.349.451.9OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.057.967.5TR 7980X DIY Build42.847.249.6OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio48.561.867.8TR 7980X DIY Build41.447.950.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

Timed Linux Kernel Compilation

MinAvgMaxTR 3990X System76 Thelio46.058.776.5TR 7980X DIY Build38.355.084.6OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Linux Kernel Compilation 6.1CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio47.366.874.0TR 7980X DIY Build43.667.383.8OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Linux Kernel Compilation 6.1CPU Temperature Monitor20406080100

Timed Godot Game Engine Compilation

MinAvgMaxTR 3990X System76 Thelio47.563.279.3TR 7980X DIY Build43.360.385.1OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Godot Game Engine Compilation 4.0CPU Temperature Monitor20406080100

Timed FFmpeg Compilation

MinAvgMaxTR 3990X System76 Thelio47.857.873.8TR 7980X DIY Build43.655.679.6OpenBenchmarking.orgCelsius, Fewer Is BetterTimed FFmpeg Compilation 6.1CPU Temperature Monitor20406080100

Timed LLVM Compilation

MinAvgMaxTR 3990X System76 Thelio47.865.176.0TR 7980X DIY Build43.667.189.3OpenBenchmarking.orgCelsius, Fewer Is BetterTimed LLVM Compilation 16.0CPU Temperature Monitor20406080100

Timed Node.js Compilation

MinAvgMaxTR 3990X System76 Thelio48.864.177.5TR 7980X DIY Build46.964.988.3OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Node.js Compilation 19.8.1CPU Temperature Monitor20406080100

Timed Gem5 Compilation

MinAvgMaxTR 3990X System76 Thelio47.357.874.3TR 7980X DIY Build41.954.682.9OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Gem5 Compilation 23.0.1CPU Temperature Monitor20406080100

Blender

MinAvgMaxTR 3990X System76 Thelio47.362.566.8TR 7980X DIY Build40.059.567.4OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio48.866.268.5TR 7980X DIY Build47.467.372.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.065.369.0TR 7980X DIY Build48.364.482.9OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio48.866.779.3TR 7980X DIY Build48.668.071.5OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.067.972.8TR 7980X DIY Build49.669.187.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

OpenFOAM

MinAvgMaxTR 3990X System76 Thelio48.566.570.5TR 7980X DIY Build49.166.571.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature MonitorTR 3990X System76 ThelioTR 7980X DIY Build1530456075Min: 49.25 / Avg: 71.04 / Max: 77.5Min: 49.63 / Avg: 68.73 / Max: 81

OpenRadioss

MinAvgMaxTR 3990X System76 Thelio49.869.073.0TR 7980X DIY Build48.370.382.9OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.866.872.0TR 7980X DIY Build48.666.972.4OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.566.073.8TR 7980X DIY Build49.164.186.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio48.868.371.8TR 7980X DIY Build47.869.874.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 3990X System76 Thelio49.868.572.0TR 7980X DIY Build50.069.488.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature MonitorTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 50.5 / Avg: 68.63 / Max: 75Min: 49.13 / Avg: 67.05 / Max: 92.38

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build400800120016002000SE +/- 6.80, N = 3SE +/- 2.22, N = 31763.38405.37MIN: 1658.83 / MAX: 1802.81MIN: 344.27 / MAX: 423.971. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build30060090012001500Min: 1750.34 / Avg: 1763.38 / Max: 1773.22Min: 400.99 / Avg: 405.37 / Max: 408.251. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build0.25650.5130.76951.0261.2825SE +/- 0.00, N = 3SE +/- 0.00, N = 31.140.40MIN: 0.58 / MAX: 11.74MIN: 0.18 / MAX: 27.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build246810Min: 1.14 / Avg: 1.14 / Max: 1.14Min: 0.39 / Avg: 0.4 / Max: 0.41. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build90180270360450SE +/- 1.75, N = 3SE +/- 3.04, N = 15412.09145.95MIN: 190.32 / MAX: 502.01MIN: 40.15 / MAX: 306.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build70140210280350Min: 410.31 / Avg: 412.09 / Max: 415.59Min: 114.46 / Avg: 145.95 / Max: 154.411. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build816243240SE +/- 0.05, N = 3SE +/- 0.02, N = 335.948.09MIN: 18.09 / MAX: 65.01MIN: 3.7 / MAX: 19.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build816243240Min: 35.84 / Avg: 35.94 / Max: 36Min: 8.06 / Avg: 8.09 / Max: 8.111. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build510152025SE +/- 0.08, N = 3SE +/- 0.01, N = 322.916.67MIN: 12.08 / MAX: 49.52MIN: 3.42 / MAX: 321. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 22.76 / Avg: 22.91 / Max: 23.02Min: 6.65 / Avg: 6.67 / Max: 6.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build510152025SE +/- 0.08, N = 3SE +/- 0.01, N = 320.857.48MIN: 11.83 / MAX: 44.86MIN: 4.13 / MAX: 17.571. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 20.69 / Avg: 20.85 / Max: 20.94Min: 7.46 / Avg: 7.48 / Max: 7.511. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build60120180240300SE +/- 1.80, N = 3SE +/- 0.15, N = 3266.3974.42MIN: 120.23 / MAX: 356.46MIN: 39.51 / MAX: 109.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build50100150200250Min: 263.12 / Avg: 266.39 / Max: 269.32Min: 74.13 / Avg: 74.42 / Max: 74.581. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build246810SE +/- 0.02, N = 3SE +/- 0.01, N = 37.344.60MIN: 4.14 / MAX: 22.27MIN: 2.13 / MAX: 19.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build3691215Min: 7.3 / Avg: 7.34 / Max: 7.37Min: 4.58 / Avg: 4.6 / Max: 4.611. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build306090120150SE +/- 0.47, N = 3SE +/- 0.10, N = 3124.2537.31MIN: 71.1 / MAX: 148.34MIN: 21.65 / MAX: 56.71. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 123.31 / Avg: 124.25 / Max: 124.77Min: 37.11 / Avg: 37.31 / Max: 37.421. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build1326395265SE +/- 0.46, N = 15SE +/- 0.02, N = 358.2819.92MIN: 26.07 / MAX: 102.47MIN: 12.32 / MAX: 32.171. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 3990X System76 ThelioTR 7980X DIY Build1224364860Min: 55.37 / Avg: 58.28 / Max: 61.31Min: 19.89 / Avg: 19.92 / Max: 19.951. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build714212835SE +/- 0.0689, N = 3SE +/- 0.0108, N = 331.83358.8140
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build714212835Min: 31.71 / Avg: 31.83 / Max: 31.94Min: 8.8 / Avg: 8.81 / Max: 8.84

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.04, N = 3SE +/- 0.01, N = 392.5841.96
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 92.49 / Avg: 92.58 / Max: 92.63Min: 41.94 / Avg: 41.96 / Max: 41.99

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build1632486480SE +/- 0.07, N = 3SE +/- 0.02, N = 370.3728.54
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build1428425670Min: 70.24 / Avg: 70.37 / Max: 70.46Min: 28.52 / Avg: 28.54 / Max: 28.58

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build2004006008001000SE +/- 4.97, N = 3SE +/- 0.44, N = 3816.65359.86
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build140280420560700Min: 807.78 / Avg: 816.65 / Max: 824.96Min: 359.31 / Avg: 359.86 / Max: 360.72

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build306090120150SE +/- 0.45, N = 3SE +/- 0.10, N = 3153.6961.21
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build306090120150Min: 152.9 / Avg: 153.69 / Max: 154.46Min: 61.02 / Avg: 61.21 / Max: 61.34

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build306090120150SE +/- 0.87, N = 3SE +/- 0.05, N = 3148.8059.88
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build306090120150Min: 147.7 / Avg: 148.8 / Max: 150.53Min: 59.82 / Avg: 59.88 / Max: 59.98

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build2004006008001000SE +/- 9.47, N = 3SE +/- 0.17, N = 3832.62359.86
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build150300450600750Min: 822.97 / Avg: 832.62 / Max: 851.54Min: 359.65 / Avg: 359.86 / Max: 360.19

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build160320480640800SE +/- 1.54, N = 3SE +/- 0.02, N = 3722.51190.65
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build130260390520650Min: 720.76 / Avg: 722.51 / Max: 725.57Min: 190.62 / Avg: 190.65 / Max: 190.68

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build1632486480SE +/- 0.08, N = 3SE +/- 0.01, N = 370.5528.54
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build1428425670Min: 70.39 / Avg: 70.55 / Max: 70.65Min: 28.53 / Avg: 28.54 / Max: 28.55

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build3691215SE +/- 0.0526, N = 3SE +/- 0.0127, N = 312.05053.3518
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build48121620Min: 11.97 / Avg: 12.05 / Max: 12.15Min: 3.34 / Avg: 3.35 / Max: 3.38

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build140280420560700SE +/- 0.05, N = 3SE +/- 0.18, N = 3641.77288.58
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build110220330440550Min: 641.7 / Avg: 641.77 / Max: 641.87Min: 288.29 / Avg: 288.58 / Max: 288.9

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build1428425670SE +/- 0.03, N = 3SE +/- 0.01, N = 361.9819.70
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 3990X System76 ThelioTR 7980X DIY Build1224364860Min: 61.92 / Avg: 61.98 / Max: 62.01Min: 19.69 / Avg: 19.7 / Max: 19.71

Whisper.cpp

Whisper.cpp is a port of OpenAI's Whisper model in C/C++. Whisper.cpp is developed by Georgi Gerganov for transcribing WAV audio files to text / speech recognition. Whisper.cpp supports ARM NEON, x86 AVX, and other advanced CPU features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-base.en - Input: 2016 State of the UnionTR 3990X System76 ThelioTR 7980X DIY Build50100150200250SE +/- 0.87, N = 3SE +/- 4.70, N = 12248.00192.001. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-base.en - Input: 2016 State of the UnionTR 3990X System76 ThelioTR 7980X DIY Build4080120160200Min: 246.26 / Avg: 248 / Max: 248.94Min: 165.04 / Avg: 192 / Max: 218.191. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-small.en - Input: 2016 State of the UnionTR 3990X System76 ThelioTR 7980X DIY Build130260390520650SE +/- 6.62, N = 9SE +/- 15.22, N = 9579.21445.321. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-small.en - Input: 2016 State of the UnionTR 3990X System76 ThelioTR 7980X DIY Build100200300400500Min: 552.59 / Avg: 579.21 / Max: 617.15Min: 364.49 / Avg: 445.32 / Max: 482.621. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-medium.en - Input: 2016 State of the UnionTR 3990X System76 ThelioTR 7980X DIY Build30060090012001500SE +/- 11.88, N = 7SE +/- 4.81, N = 31259.41925.981. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-medium.en - Input: 2016 State of the UnionTR 3990X System76 ThelioTR 7980X DIY Build2004006008001000Min: 1210.21 / Avg: 1259.41 / Max: 1289.89Min: 917.12 / Avg: 925.98 / Max: 933.661. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigTR 3990X System76 ThelioTR 7980X DIY Build816243240SE +/- 0.29, N = 9SE +/- 0.23, N = 635.8623.41
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigTR 3990X System76 ThelioTR 7980X DIY Build816243240Min: 35.46 / Avg: 35.86 / Max: 38.15Min: 22.83 / Avg: 23.41 / Max: 24.5

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigTR 3990X System76 ThelioTR 7980X DIY Build70140210280350SE +/- 0.52, N = 3SE +/- 0.36, N = 3335.74216.69
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigTR 3990X System76 ThelioTR 7980X DIY Build60120180240300Min: 335.1 / Avg: 335.74 / Max: 336.77Min: 216.12 / Avg: 216.69 / Max: 217.36

Timed Mesa Compilation

This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.

Time To Compile

TR 7980X DIY Build: The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

TR 3990X System76 Thelio: The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileTR 3990X System76 ThelioTR 7980X DIY Build306090120150SE +/- 0.30, N = 3SE +/- 0.14, N = 3131.3679.84
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 130.86 / Avg: 131.36 / Max: 131.9Min: 79.56 / Avg: 79.84 / Max: 80

Timed FFmpeg Compilation

This test times how long it takes to build the FFmpeg multimedia library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileTR 3990X System76 ThelioTR 7980X DIY Build510152025SE +/- 0.05, N = 3SE +/- 0.03, N = 419.3811.67
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileTR 3990X System76 ThelioTR 7980X DIY Build510152025Min: 19.27 / Avg: 19.38 / Max: 19.44Min: 11.62 / Avg: 11.67 / Max: 11.74

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaTR 3990X System76 ThelioTR 7980X DIY Build4080120160200SE +/- 0.18, N = 3SE +/- 0.22, N = 3204.00122.23
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaTR 3990X System76 ThelioTR 7980X DIY Build4080120160200Min: 203.67 / Avg: 204 / Max: 204.27Min: 121.79 / Avg: 122.23 / Max: 122.46

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileTR 3990X System76 ThelioTR 7980X DIY Build4080120160200SE +/- 1.78, N = 3SE +/- 0.78, N = 3185.54113.78
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileTR 3990X System76 ThelioTR 7980X DIY Build306090120150Min: 183.34 / Avg: 185.54 / Max: 189.07Min: 112.89 / Avg: 113.78 / Max: 115.34

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileTR 3990X System76 ThelioTR 7980X DIY Build60120180240300SE +/- 1.78, N = 3SE +/- 2.15, N = 3281.54178.79
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileTR 3990X System76 ThelioTR 7980X DIY Build50100150200250Min: 279.64 / Avg: 281.54 / Max: 285.09Min: 176.35 / Avg: 178.79 / Max: 183.09

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build714212835SE +/- 0.09, N = 3SE +/- 0.03, N = 330.4318.47
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build714212835Min: 30.27 / Avg: 30.43 / Max: 30.59Min: 18.42 / Avg: 18.47 / Max: 18.52

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.56, N = 3SE +/- 0.15, N = 382.5447.15
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build1632486480Min: 81.42 / Avg: 82.54 / Max: 83.14Min: 46.93 / Avg: 47.15 / Max: 47.44

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build918273645SE +/- 0.10, N = 3SE +/- 0.09, N = 337.5623.80
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build816243240Min: 37.36 / Avg: 37.56 / Max: 37.69Min: 23.63 / Avg: 23.8 / Max: 23.91

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.24, N = 3SE +/- 0.15, N = 396.7657.94
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 96.28 / Avg: 96.76 / Max: 97.02Min: 57.64 / Avg: 57.94 / Max: 58.14

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build70140210280350SE +/- 1.16, N = 3SE +/- 0.09, N = 3309.06166.88
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyTR 3990X System76 ThelioTR 7980X DIY Build60120180240300Min: 307.31 / Avg: 309.06 / Max: 311.25Min: 166.74 / Avg: 166.88 / Max: 167.05

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeTR 3990X System76 ThelioTR 7980X DIY Build71421283528.3719.551. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeTR 3990X System76 ThelioTR 7980X DIY Build163248648074.1136.861. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeTR 3990X System76 ThelioTR 7980X DIY Build4080120160200184.71104.601. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeTR 3990X System76 ThelioTR 7980X DIY Build300600900120015001362.36617.271. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on WindshieldTR 3990X System76 ThelioTR 7980X DIY Build306090120150SE +/- 0.67, N = 3SE +/- 0.68, N = 3153.62105.42
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on WindshieldTR 3990X System76 ThelioTR 7980X DIY Build306090120150Min: 152.29 / Avg: 153.62 / Max: 154.37Min: 104.18 / Avg: 105.42 / Max: 106.51

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal InstallationTR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.07, N = 3SE +/- 0.34, N = 393.6153.18
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal InstallationTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 93.48 / Avg: 93.61 / Max: 93.72Min: 52.53 / Avg: 53.18 / Max: 53.7

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestTR 3990X System76 ThelioTR 7980X DIY Build1122334455SE +/- 0.36, N = 3SE +/- 0.10, N = 348.3123.41
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestTR 3990X System76 ThelioTR 7980X DIY Build1020304050Min: 47.68 / Avg: 48.31 / Max: 48.92Min: 23.23 / Avg: 23.41 / Max: 23.58

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper BeamTR 3990X System76 ThelioTR 7980X DIY Build20406080100SE +/- 0.27, N = 3SE +/- 0.65, N = 3104.1675.61
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper BeamTR 3990X System76 ThelioTR 7980X DIY Build20406080100Min: 103.64 / Avg: 104.16 / Max: 104.53Min: 74.9 / Avg: 75.61 / Max: 76.9

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerTR 3990X System76 ThelioTR 7980X DIY Build4080120160200SE +/- 0.44, N = 3SE +/- 0.12, N = 3204.54115.12
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerTR 3990X System76 ThelioTR 7980X DIY Build4080120160200Min: 203.67 / Avg: 204.54 / Max: 205.06Min: 114.89 / Avg: 115.12 / Max: 115.28

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MTR 3990X System76 ThelioTR 7980X DIY Build140280420560700SE +/- 0.33, N = 3SE +/- 3.99, N = 3671.04292.06
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MTR 3990X System76 ThelioTR 7980X DIY Build120240360480600Min: 670.6 / Avg: 671.04 / Max: 671.68Min: 284.8 / Avg: 292.06 / Max: 298.57

215 Results Shown

CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Megahertz
    Watts
  CPU - 1 - ResNet-50:
    batches/sec Per Watt
PyTorch:
  CPU - 1 - ResNet-152
  CPU - 1 - Efficientnet_v2_l
  CPU - 64 - ResNet-50
  CPU - 64 - ResNet-152
PyTorch
PyTorch:
  CPU - 1 - ResNet-50
  CPU - 64 - Efficientnet_v2_l
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
Embree:
  Pathtracer ISPC - Crown
  Preset 8 - Bosphorus 4K
  Preset 4 - Bosphorus 4K
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Crown
SVT-AV1:
  Preset 13 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 4 - Bosphorus 4K
TensorFlow:
  CPU - 1 - ResNet-50
  CPU - 16 - ResNet-50
  CPU - 256 - ResNet-50
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/scivis/real_time
  particle_volume/pathtracer/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
OSPRay
OSPRay
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  ResNet-50, Baseline - Asynchronous Multi-Stream
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream
IndigoBench:
  CPU - Supercar
  CPU - Bedroom
OpenVINO:
  CPU Peak Freq (Highest CPU Core Frequency) Monitor:
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
QuantLib
7-Zip Compression:
  Compression Rating
  Decompression Rating
LeelaChessZero
LeelaChessZero:
  BLAS
  Eigen
Meta Performance Per Watts:
  Performance Per Watts
 
Numpy Benchmark
Llama.cpp:
  llama-2-7b.Q4_0.gguf
  llama-2-13b.Q4_0.gguf
  llama-2-70b-chat.Q5_0.gguf
Llama.cpp:
  llama-2-7b.Q4_0.gguf
  llama-2-13b.Q4_0.gguf
  llama-2-70b-chat.Q5_0.gguf
Chaos Group V-RAY
Chaos Group V-RAY
OpenVINO:
  CPU Temp Monitor:
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  ResNet-50, Baseline - Asynchronous Multi-Stream
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream
Whisper.cpp:
  ggml-base.en - 2016 State of the Union
  ggml-small.en - 2016 State of the Union
  ggml-medium.en - 2016 State of the Union
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed Godot Game Engine Compilation
Timed FFmpeg Compilation
Timed LLVM Compilation
Timed Node.js Compilation
Timed Gem5 Compilation
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Pabellon Barcelona - CPU-Only
  Barbershop - CPU-Only
OpenFOAM:
  drivaerFastback, Small Mesh Size - Mesh Time
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
  drivaerFastback, Medium Mesh Size - Execution Time
OpenRadioss:
  Bird Strike on Windshield
  Rubber O-Ring Seal Installation
  Cell Phone Drop Test
  Bumper Beam
  INIVOL and Fluid Structure Interaction Drop Container
  Chrysler Neon 1M