TR Comparison

AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS) and AMD Radeon RX 5700 8GB on Pop 22.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2401140-NE-2401134NE94
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

BLAS (Basic Linear Algebra Sub-Routine) Tests 2 Tests
C++ Boost Tests 3 Tests
Timed Code Compilation 7 Tests
C/C++ Compiler Tests 4 Tests
CPU Massive 9 Tests
Creator Workloads 8 Tests
Game Development 2 Tests
HPC - High Performance Computing 10 Tests
Machine Learning 8 Tests
Multi-Core 15 Tests
NVIDIA GPU Compute 4 Tests
Intel oneAPI 3 Tests
OpenMPI Tests 2 Tests
Programmer / Developer System Benchmarks 7 Tests
Python Tests 10 Tests
Renderers 4 Tests
Server CPU Tests 6 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs
No Box Plots
On Line Graphs With Missing Data, Connect The Line Gaps

Additional Graphs

Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs
Condense Test Profiles With Multiple Version Results Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
TR 7980X DIY Build
January 12
  9 Hours, 33 Minutes
TR 3990X System76 Thelio
January 13
  15 Hours, 51 Minutes
Invert Hiding All Results Option
  12 Hours, 42 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


TR ComparisonProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen ResolutionTR 7980X DIY BuildTR 3990X System76 ThelioAMD Ryzen Threadripper 7980X 64-Cores @ 8.21GHz (64 Cores / 128 Threads)ASUS Pro WS TRX50-SAGE WIFI (0607 BIOS)AMD Device 14a44 x 32 GB DRAM-4800MT/s F5-6400R3239G32GQ1000GB Western Digital WDS100T1X0E-00AFY0NAVI31 20GB (2025/1249MHz)Realtek ALC1220DELL U2723QEAquantia Device 04c0 + Intel Device 125b + MEDIATEK Device 0616Pop 22.046.6.6-76060606-generic (x86_64)GNOME Shell 42.5X Server 1.21.1.44.6 Mesa 23.3.2-1pop0~1704238321~22.04~36f1d0e (LLVM 15.0.7 DRM 3.54)1.3.267GCC 11.4.0ext43840x2160AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads)Gigabyte TRX40 AORUS PRO WIFI (F6 BIOS)AMD Starship/Matisse4 x 32 GB DRAM-3000MT/s CMK64GX4M2D3000C16Samsung SSD 970 EVO Plus 500GBAMD Radeon RX 5700 8GB (1750/875MHz)AMD Navi 10 HDMI AudioDELL P2415QIntel I211 + Intel Wi-Fi 6 AX200OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-11-XeT9lY/gcc-11-11.4.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- TR 7980X DIY Build: Scaling Governor: amd-pstate-epp powersave (EPP: balance_performance) - CPU Microcode: 0xa108105- TR 3990X System76 Thelio: Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x830107aPython Details- Python 3.10.12Security Details- TR 7980X DIY Build: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - TR 3990X System76 Thelio: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected

TR 7980X DIY Build vs. TR 3990X System76 Thelio ComparisonPhoronix Test SuiteBaseline+192.5%+192.5%+385%+385%+577.5%+577.5%81.4%80.2%75.1%72.1%62.3%61.9%60.7%59.1%27.1%11.5%10.9%4.9%CPU - 256 - ResNet-50769.8%CPU - 16 - ResNet-50503.1%Eigen467%BLAS411%W.P.D.F.I - CPU344.3%F.D.F.I - CPU337%F.D.F.I - CPU335%W.P.D.F.I - CPU334.7%C.S.9.P.Y.P - A.M.S279%N.T.C.B.b.u.S.S.I - A.M.S261.2%R.5.S.I - A.M.S259.5%M.T.E.T.D.F - CPU258%M.T.E.T.D.F - CPU257.8%V.D.F.I - CPU243.5%V.D.F.I - CPU239.8%H.E.R.F.I - CPU233%H.E.R.F.I - CPU232.8%gravity_spheres_volume/dim_512/scivis/real_time232%gravity_spheres_volume/dim_512/ao/real_time222.6%B.L.N.Q.A.S.I - A.M.S214.6%F.D.R.F.I - CPU208.4%CPU - 1 - Efficientnet_v2_l196.5%CPU - 1 - ResNet-50195.3%CPU - 64 - ResNet-50193.5%R.S.A.F.I - CPU192.6%R.S.A.F.I - CPU192%A.G.R.R.0.F.I - CPU185%P.D.F - CPU184.5%P.D.F - CPU182.4%CPU - 64 - ResNet-152181%CPU - 64 - Efficientnet_v2_l179%P.V.B.D.F - CPU178.7%P.V.B.D.F - CPU175.6%CPU - 1 - ResNet-152168.3%A.G.R.R.0.F.I - CPU164.2%Compression Rating154.8%Pathtracer ISPC - Asian Dragon151.4%C.D.Y.C - A.M.S151.1%C.D.Y.C.S.I - A.M.S148.5%R.5.B - A.M.S147.2%C.C.R.5.I - A.M.S146.5%gravity_spheres_volume/dim_512/pathtracer/real_time138%N.D.C.o.b.u.o.I - A.M.S131.4%llama-2-13b.Q4_0.gguf130.1%Chrysler Neon 1M129.8%N.T.C.B.b.u.c - A.M.S126.9%B.L.N.Q.A - A.M.S122.4%d.M.M.S - Execution Time120.7%N.T.C.D.m - A.M.S120.6%llama-2-7b.Q4_0.gguf119.9%llama-2-70b-chat.Q5_0.gguf109.7%Preset 8 - Bosphorus 4K107.7%C.P.D.T106.4%d.S.M.S - Execution Time101.1%Preset 4 - Bosphorus 4K97.8%Pathtracer ISPC - Crown95.1%92.4%Barbershop - CPU-Only85.2%N.T.C.D.m - A.M.SCPU81.2%B.L.N.Q.A - A.M.SI.a.F.S.I.D.C77.7%d.M.M.S - Mesh Time76.6%R.O.R.S.I76%N.T.C.B.b.u.c - A.M.SClassroom - CPU-Only75.1%N.D.C.o.b.u.o.I - A.M.SPabellon Barcelona - CPU-Only67%Ninja66.9%Time To Compile66%BMW27 - CPU-Only64.8%Time To Compile64.5%Time To Compile63.1%C.C.R.5.I - A.M.SR.5.B - A.M.SC.D.Y.C.S.I - A.M.SF.D.R.F.I - CPU59.6%C.D.Y.C - A.M.Sparticle_volume/pathtracer/real_time58.4%Fishy Cat - CPU-Only57.8%Time To Compile57.5%particle_volume/scivis/real_time56%Preset 13 - Bosphorus 4K55.5%CPU - Supercar55.4%allmodconfig54.9%Multi-Threaded54.1%particle_volume/ao/real_time53.8%CPU - Bedroom53.3%defconfig53.1%CPU - 1 - ResNet-5052.4%Preset 12 - Bosphorus 4K52.1%B.S.o.W45.7%d.S.M.S - Mesh Time45.1%D.R45%Bumper Beam37.8%ggml-medium.en - 2.S.o.t.U36%ggml-small.en - 2.S.o.t.U30.1%ggml-base.en - 2.S.o.t.U29.2%B.L.N.Q.A.S.I - A.M.SR.5.S.I - A.M.SN.T.C.B.b.u.S.S.I - A.M.SC.S.9.P.Y.P - A.M.STensorFlowTensorFlowLeelaChessZeroLeelaChessZeroOpenVINOOpenVINOOpenVINOOpenVINONeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOOSPRayOSPRayNeural Magic DeepSparseOpenVINOPyTorchPyTorchPyTorchOpenVINOOpenVINOOpenVINOOpenVINOOpenVINOPyTorchPyTorchOpenVINOOpenVINOPyTorchOpenVINO7-Zip CompressionEmbreeNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseOSPRayNeural Magic DeepSparseLlama.cppOpenRadiossNeural Magic DeepSparseNeural Magic DeepSparseOpenFOAMNeural Magic DeepSparseLlama.cppLlama.cppSVT-AV1OpenRadiossOpenFOAMSVT-AV1EmbreeNumpy BenchmarkBlenderNeural Magic DeepSparseChaos Group V-RAYNeural Magic DeepSparseOpenRadiossOpenFOAMOpenRadiossNeural Magic DeepSparseBlenderNeural Magic DeepSparseBlenderTimed LLVM CompilationTimed FFmpeg CompilationBlenderTimed Godot Game Engine CompilationTimed Node.js CompilationNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseOpenVINONeural Magic DeepSparseOSPRayBlenderTimed Gem5 CompilationOSPRaySVT-AV1IndigoBenchTimed Linux Kernel CompilationQuantLibOSPRayIndigoBenchTimed Linux Kernel CompilationTensorFlowSVT-AV1OpenRadiossOpenFOAM7-Zip CompressionOpenRadiossWhisper.cppWhisper.cppWhisper.cppNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseNeural Magic DeepSparseTR 7980X DIY BuildTR 3990X System76 Thelio

TR Comparisonpytorch: CPU - 1 - ResNet-152pytorch: CPU - 1 - Efficientnet_v2_lpytorch: CPU - 64 - ResNet-50pytorch: CPU - 64 - ResNet-152pytorch: CPU - 1 - ResNet-50pytorch: CPU - 64 - Efficientnet_v2_lopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUembree: Pathtracer ISPC - Asian Dragonembree: Pathtracer ISPC - Crownsvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 12 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 4 - Bosphorus 4Ktensorflow: CPU - 1 - ResNet-50tensorflow: CPU - 16 - ResNet-50tensorflow: CPU - 256 - ResNet-50ospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: particle_volume/ao/real_timedeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamindigobench: CPU - Supercarindigobench: CPU - Bedroomquantlib: Multi-Threadedcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratinglczero: BLASlczero: Eigennumpy: llama-cpp: llama-2-7b.Q4_0.ggufllama-cpp: llama-2-13b.Q4_0.ggufllama-cpp: llama-2-70b-chat.Q5_0.ggufv-ray: CPUopenvino: Face Detection FP16-INT8 - CPUopenvino: Age Gender Recognition Retail 0013 FP16-INT8 - CPUopenvino: Person Detection FP16 - CPUopenvino: Weld Porosity Detection FP16-INT8 - CPUopenvino: Vehicle Detection FP16-INT8 - CPUopenvino: Person Vehicle Bike Detection FP16 - CPUopenvino: Machine Translation EN To DE FP16 - CPUopenvino: Face Detection Retail FP16-INT8 - CPUopenvino: Handwritten English Recognition FP16-INT8 - CPUopenvino: Road Segmentation ADAS FP16-INT8 - CPUdeepsparse: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Streamdeepsparse: CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Streamdeepsparse: NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO - Asynchronous Multi-Streamdeepsparse: CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Streamdeepsparse: CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Streamdeepsparse: ResNet-50, Baseline - Asynchronous Multi-Streamdeepsparse: ResNet-50, Sparse INT8 - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering - Asynchronous Multi-Streamdeepsparse: BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Streamwhisper-cpp: ggml-base.en - 2016 State of the Unionwhisper-cpp: ggml-small.en - 2016 State of the Unionwhisper-cpp: ggml-medium.en - 2016 State of the Unionbuild-linux-kernel: defconfigbuild-linux-kernel: allmodconfigbuild-godot: Time To Compilebuild-ffmpeg: Time To Compilebuild-llvm: Ninjabuild-nodejs: Time To Compilebuild-gem5: Time To Compileblender: BMW27 - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlyblender: Barbershop - CPU-Onlyopenfoam: drivaerFastback, Small Mesh Size - Mesh Timeopenfoam: drivaerFastback, Small Mesh Size - Execution Timeopenfoam: drivaerFastback, Medium Mesh Size - Mesh Timeopenfoam: drivaerFastback, Medium Mesh Size - Execution Timeopenradioss: Bird Strike on Windshieldopenradioss: Rubber O-Ring Seal Installationopenradioss: Cell Phone Drop Testopenradioss: Bumper Beamopenradioss: INIVOL and Fluid Structure Interaction Drop Containeropenradioss: Chrysler Neon 1MTR 7980X DIY BuildTR 3990X System76 Thelio22.0812.8748.3919.0559.798.2378.74112465.33220.467702.024727.164215.15429.1113253.181711.041601.38103.913893.4593194.101198.74090.4509.2467.6259.41105.8523.425726.506222.5832239.31922.644622.5275905.4136190.4801280.000122.2065130.5869133.539422.200441.9230280.02742372.168227.6721405.484934.44615.704245683.2443349529231557533753.6830.7818.433.0488574405.370.40145.958.096.677.4874.424.6037.3119.928.814041.962928.5428359.858861.212359.8761359.8583190.646828.54023.3518288.575819.7033191.99942445.32330925.9806523.413216.69079.84411.671122.225113.780178.79418.4747.1523.8057.94166.8819.55385636.85956104.60125617.2658105.4253.1823.4175.61115.12292.068.234.3416.496.7820.252.9518.0242563.2377.501771.601391.091529.19119.934296.88514.20548.4041.333147.9019124.791130.63143.5454.6755.009.8512.177.2610111.137714.4799151.0506.8203014.64921003.6586345.4413454.444838.8841207.7083214.597038.216243.9894453.26382645.310249.8527515.529722.16210.242159470.117397036498110994391.7114.008.011.45488711763.381.14412.0935.9422.9120.85266.397.34124.2558.2831.833592.578170.3655816.6532153.6873148.8038832.6156722.505870.549612.0505641.769761.9787247.99593579.206721259.4050035.857335.736131.35719.377204.001185.538281.53830.4382.5437.5696.76309.0628.37055974.108433184.712011362.3583153.6293.6148.31104.16204.54671.04OpenBenchmarking.org

CPU Temperature Monitor

OpenBenchmarking.orgCelsiusCPU Temperature MonitorPhoronix Test Suite System MonitoringTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 36.88 / Avg: 64.84 / Max: 94.75Min: 42.25 / Avg: 65.24 / Max: 89

CPU Peak Freq (Highest CPU Core Frequency) Monitor

OpenBenchmarking.orgMegahertzCPU Peak Freq (Highest CPU Core Frequency) MonitorPhoronix Test Suite System MonitoringTR 7980X DIY BuildTR 3990X System76 Thelio10002000300040005000Min: 545 / Avg: 4217.07 / Max: 5617Min: 2196 / Avg: 3527.76 / Max: 4330

CPU Power Consumption Monitor

OpenBenchmarking.orgWattsCPU Power Consumption MonitorPhoronix Test Suite System MonitoringTR 7980X DIY BuildTR 3990X System76 Thelio70140210280350Min: 39.88 / Avg: 305.94 / Max: 372.82Min: 27.29 / Avg: 256.14 / Max: 305.51

PyTorch

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio0.05220.10440.15660.20880.2610.2320.080

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152TR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.12, N = 3SE +/- 0.09, N = 322.088.23MIN: 21.34 / MAX: 22.48MIN: 7.92 / MAX: 8.51
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152TR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 21.86 / Avg: 22.08 / Max: 22.25Min: 8.06 / Avg: 8.23 / Max: 8.37

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lTR 7980X DIY BuildTR 3990X System76 Thelio3691215SE +/- 0.04, N = 3SE +/- 0.02, N = 312.874.34MIN: 12.56 / MAX: 13.11MIN: 4.07 / MAX: 4.54
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lTR 7980X DIY BuildTR 3990X System76 Thelio48121620Min: 12.8 / Avg: 12.87 / Max: 12.93Min: 4.32 / Avg: 4.34 / Max: 4.38

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1122334455SE +/- 0.35, N = 3SE +/- 0.20, N = 348.3916.49MIN: 44.46 / MAX: 50.22MIN: 15.1 / MAX: 17.33
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1020304050Min: 47.87 / Avg: 48.39 / Max: 49.05Min: 16.27 / Avg: 16.49 / Max: 16.89

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152TR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.15, N = 3SE +/- 0.09, N = 319.056.78MIN: 18.34 / MAX: 19.48MIN: 6.01 / MAX: 7.11
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152TR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 18.79 / Avg: 19.05 / Max: 19.32Min: 6.64 / Avg: 6.78 / Max: 6.94

OpenBenchmarking.orgbatches/sec Per Watt, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 7980X DIY BuildTR 3990X System76 Thelio0.00590.01180.01770.02360.02950.0260.011

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1326395265SE +/- 0.17, N = 3SE +/- 0.15, N = 359.7920.25MIN: 54.43 / MAX: 61.61MIN: 18.92 / MAX: 21.46
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1224364860Min: 59.48 / Avg: 59.79 / Max: 60.06Min: 19.95 / Avg: 20.25 / Max: 20.46

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 7980X DIY BuildTR 3990X System76 Thelio246810SE +/- 0.02, N = 3SE +/- 0.03, N = 38.232.95MIN: 6.24 / MAX: 8.41MIN: 2.79 / MAX: 3.12
OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lTR 7980X DIY BuildTR 3990X System76 Thelio3691215Min: 8.18 / Avg: 8.23 / Max: 8.26Min: 2.9 / Avg: 2.95 / Max: 3.01

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.45, N = 3SE +/- 0.07, N = 378.7418.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio1530456075Min: 78.14 / Avg: 78.74 / Max: 79.61Min: 17.92 / Avg: 18.02 / Max: 18.151. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20K40K60K80K100KSE +/- 340.10, N = 3SE +/- 40.80, N = 3112465.3342563.231. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20K40K60K80K100KMin: 111826.41 / Avg: 112465.33 / Max: 112986.9Min: 42508.48 / Avg: 42563.23 / Max: 426431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 5.43, N = 15SE +/- 0.30, N = 3220.4677.501. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 206.83 / Avg: 220.46 / Max: 279.15Min: 76.9 / Avg: 77.5 / Max: 77.821. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio17003400510068008500SE +/- 11.71, N = 3SE +/- 2.55, N = 37702.021771.601. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio13002600390052006500Min: 7680.06 / Avg: 7702.02 / Max: 7720.04Min: 1768.51 / Avg: 1771.6 / Max: 1776.661. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio10002000300040005000SE +/- 5.51, N = 3SE +/- 4.83, N = 34727.161391.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio8001600240032004000Min: 4720.67 / Avg: 4727.16 / Max: 4738.12Min: 1384.3 / Avg: 1391.09 / Max: 1400.431. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio9001800270036004500SE +/- 6.56, N = 3SE +/- 6.05, N = 34215.151529.191. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio7001400210028003500Min: 4202.88 / Avg: 4215.15 / Max: 4225.3Min: 1522.87 / Avg: 1529.19 / Max: 1541.291. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio90180270360450SE +/- 0.87, N = 3SE +/- 0.81, N = 3429.11119.931. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio80160240320400Min: 428.13 / Avg: 429.11 / Max: 430.85Min: 118.63 / Avg: 119.93 / Max: 121.421. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio3K6K9K12K15KSE +/- 23.14, N = 3SE +/- 10.47, N = 313253.184296.881. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio2K4K6K8K10KMin: 13224.41 / Avg: 13253.18 / Max: 13298.97Min: 4278.82 / Avg: 4296.88 / Max: 4315.091. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio400800120016002000SE +/- 4.52, N = 3SE +/- 1.95, N = 31711.04514.201. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500Min: 1705.87 / Avg: 1711.04 / Max: 1720.06Min: 512.11 / Avg: 514.2 / Max: 518.11. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500SE +/- 1.27, N = 3SE +/- 4.39, N = 151601.38548.401. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgFPS, More Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500Min: 1599.28 / Avg: 1601.38 / Max: 1603.66Min: 520.82 / Avg: 548.4 / Max: 576.681. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Embree

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 7980X DIY BuildTR 3990X System76 Thelio0.08150.1630.24450.3260.40750.3620.200

SVT-AV1

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio0.10170.20340.30510.40680.50850.4520.230

OpenBenchmarking.orgFrames Per Second Per Watt, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio0.00970.01940.02910.03880.04850.0430.023

Embree

Intel Embree is a collection of high-performance ray-tracing kernels for execution on CPUs (and GPUs via SYCL) and supporting instruction sets such as SSE, AVX, AVX2, and AVX-512. Embree also supports making use of the Intel SPMD Program Compiler (ISPC). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.08, N = 6SE +/- 0.04, N = 3103.9141.33MIN: 102.79 / MAX: 105.67MIN: 40.86 / MAX: 42.73
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: Asian DragonTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 103.59 / Avg: 103.91 / Max: 104.19Min: 41.25 / Avg: 41.33 / Max: 41.39

OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.17, N = 6SE +/- 0.10, N = 493.4647.90MIN: 91.73 / MAX: 95.85MIN: 47.07 / MAX: 49.79
OpenBenchmarking.orgFrames Per Second, More Is BetterEmbree 4.3Binary: Pathtracer ISPC - Model: CrownTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 93.03 / Avg: 93.46 / Max: 94.11Min: 47.75 / Avg: 47.9 / Max: 48.19

SVT-AV1

This is a benchmark of the SVT-AV1 open-source video encoder/decoder. SVT-AV1 was originally developed by Intel as part of their Open Visual Cloud / Scalable Video Technology (SVT). Development of SVT-AV1 has since moved to the Alliance for Open Media as part of upstream AV1 development. SVT-AV1 is a CPU-based multi-threaded video encoder for the AV1 video format with a sample YUV video file. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 1.79, N = 15SE +/- 6.37, N = 13194.10124.791. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 13 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 186.73 / Avg: 194.1 / Max: 212.55Min: 48.48 / Avg: 124.79 / Max: 133.71. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 1.52, N = 15SE +/- 0.33, N = 5198.74130.631. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 12 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 189.35 / Avg: 198.74 / Max: 207.28Min: 129.84 / Avg: 130.63 / Max: 131.641. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.28, N = 5SE +/- 0.07, N = 390.4543.551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 8 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 89.38 / Avg: 90.45 / Max: 91.04Min: 43.46 / Avg: 43.55 / Max: 43.681. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio3691215SE +/- 0.001, N = 3SE +/- 0.020, N = 39.2464.6751. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 1.8Encoder Mode: Preset 4 - Input: Bosphorus 4KTR 7980X DIY BuildTR 3990X System76 Thelio3691215Min: 9.24 / Avg: 9.25 / Max: 9.25Min: 4.64 / Avg: 4.68 / Max: 4.711. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

TensorFlow

This is a benchmark of the TensorFlow deep learning framework using the TensorFlow reference benchmarks (tensorflow/benchmarks with tf_cnn_benchmarks.py). Note with the Phoronix Test Suite there is also pts/tensorflow-lite for benchmarking the TensorFlow Lite binaries if desired for complementary metrics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio246810SE +/- 0.02, N = 3SE +/- 0.01, N = 37.625.00
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 1 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio3691215Min: 7.59 / Avg: 7.62 / Max: 7.65Min: 4.98 / Avg: 5 / Max: 5.01

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1326395265SE +/- 0.19, N = 3SE +/- 0.06, N = 359.419.85
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 16 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio1224364860Min: 59.05 / Avg: 59.41 / Max: 59.71Min: 9.76 / Avg: 9.85 / Max: 9.97

OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 1.06, N = 3SE +/- 0.00, N = 3105.8512.17
OpenBenchmarking.orgimages/sec, More Is BetterTensorFlow 2.12Device: CPU - Batch Size: 256 - Model: ResNet-50TR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 104.38 / Avg: 105.85 / Max: 107.92Min: 12.16 / Avg: 12.17 / Max: 12.17

OSPRay

Intel OSPRay is a portable ray-tracing engine for high-performance, high-fidelity scientific visualizations. OSPRay builds off Intel's Embree and Intel SPMD Program Compiler (ISPC) components as part of the oneAPI rendering toolkit. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio612182430SE +/- 0.00283, N = 3SE +/- 0.00671, N = 323.425707.26101
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/ao/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 23.42 / Avg: 23.43 / Max: 23.43Min: 7.25 / Avg: 7.26 / Max: 7.27

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio612182430SE +/- 0.03, N = 3SE +/- 0.01, N = 326.5111.14
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio612182430Min: 26.47 / Avg: 26.51 / Max: 26.57Min: 11.12 / Avg: 11.14 / Max: 11.15

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.01, N = 3SE +/- 0.01, N = 322.5814.48
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/scivis/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 22.57 / Avg: 22.58 / Max: 22.59Min: 14.46 / Avg: 14.48 / Max: 14.49

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 0.48, N = 3SE +/- 0.24, N = 3239.32151.05
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/pathtracer/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 238.44 / Avg: 239.32 / Max: 240.09Min: 150.58 / Avg: 151.05 / Max: 151.4

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.03326, N = 3SE +/- 0.00213, N = 322.644606.82030
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: gravity_spheres_volume/dim_512/scivis/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 22.58 / Avg: 22.64 / Max: 22.68Min: 6.82 / Avg: 6.82 / Max: 6.82

OpenBenchmarking.orgItems Per Second Per Watt, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio0.01510.03020.04530.06040.07550.0670.053

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.03, N = 3SE +/- 0.00, N = 322.5314.65
OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 2.12Benchmark: particle_volume/ao/real_timeTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 22.49 / Avg: 22.53 / Max: 22.58Min: 14.65 / Avg: 14.65 / Max: 14.65

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000SE +/- 1.13, N = 3SE +/- 2.12, N = 3905.411003.66
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000Min: 903.19 / Avg: 905.41 / Max: 906.82Min: 1000.13 / Avg: 1003.66 / Max: 1007.47

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio80160240320400SE +/- 0.04, N = 3SE +/- 0.16, N = 3190.48345.44
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300Min: 190.4 / Avg: 190.48 / Max: 190.54Min: 345.24 / Avg: 345.44 / Max: 345.76

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio100200300400500SE +/- 0.18, N = 3SE +/- 0.42, N = 3280.00454.44
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio80160240320400Min: 279.67 / Avg: 280 / Max: 280.28Min: 453.84 / Avg: 454.44 / Max: 455.26

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio918273645SE +/- 0.03, N = 3SE +/- 0.26, N = 322.2138.88
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 22.17 / Avg: 22.21 / Max: 22.26Min: 38.36 / Avg: 38.88 / Max: 39.23

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 0.20, N = 3SE +/- 0.61, N = 3130.59207.71
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 130.33 / Avg: 130.59 / Max: 130.99Min: 206.64 / Avg: 207.71 / Max: 208.77

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 0.12, N = 3SE +/- 1.30, N = 3133.54214.60
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 133.3 / Avg: 133.54 / Max: 133.67Min: 212.05 / Avg: 214.6 / Max: 216.27

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio918273645SE +/- 0.03, N = 3SE +/- 0.45, N = 322.2038.22
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 22.15 / Avg: 22.2 / Max: 22.24Min: 37.32 / Avg: 38.22 / Max: 38.71

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1020304050SE +/- 0.02, N = 3SE +/- 0.09, N = 341.9243.99
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio918273645Min: 41.89 / Avg: 41.92 / Max: 41.95Min: 43.81 / Avg: 43.99 / Max: 44.1

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio100200300400500SE +/- 0.06, N = 3SE +/- 0.51, N = 3280.03453.26
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio80160240320400Min: 279.91 / Avg: 280.03 / Max: 280.09Min: 452.59 / Avg: 453.26 / Max: 454.27

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio6001200180024003000SE +/- 9.01, N = 3SE +/- 11.68, N = 32372.172645.31
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio5001000150020002500Min: 2354.45 / Avg: 2372.17 / Max: 2383.83Min: 2622.97 / Avg: 2645.31 / Max: 2662.36

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1122334455SE +/- 0.04, N = 3SE +/- 0.00, N = 327.6749.85
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1020304050Min: 27.6 / Avg: 27.67 / Max: 27.74Min: 49.84 / Avg: 49.85 / Max: 49.86

OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio110220330440550SE +/- 0.14, N = 3SE +/- 0.24, N = 3405.48515.53
OpenBenchmarking.orgitems/sec, More Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio90180270360450Min: 405.27 / Avg: 405.48 / Max: 405.73Min: 515.28 / Avg: 515.53 / Max: 516

IndigoBench

This is a test of Indigo Renderer's IndigoBench benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarTR 7980X DIY BuildTR 3990X System76 Thelio816243240SE +/- 0.02, N = 3SE +/- 0.07, N = 334.4522.16
OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: SupercarTR 7980X DIY BuildTR 3990X System76 Thelio714212835Min: 34.4 / Avg: 34.45 / Max: 34.48Min: 22.03 / Avg: 22.16 / Max: 22.23

OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomTR 7980X DIY BuildTR 3990X System76 Thelio48121620SE +/- 0.03, N = 3SE +/- 0.00, N = 315.7010.24
OpenBenchmarking.orgM samples/s, More Is BetterIndigoBench 4.4Acceleration: CPU - Scene: BedroomTR 7980X DIY BuildTR 3990X System76 Thelio48121620Min: 15.64 / Avg: 15.7 / Max: 15.74Min: 10.24 / Avg: 10.24 / Max: 10.25

OpenVINO

MinAvgMaxTR 7980X DIY Build54536295194TR 3990X System76 Thelio290032394266OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54538275018TR 3990X System76 Thelio290032043595OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54541185219TR 3990X System76 Thelio239628404156OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54535914456TR 3990X System76 Thelio290031824167OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54535375065TR 3990X System76 Thelio289930324143OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build143236104876TR 3990X System76 Thelio222123764150OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54536374645TR 3990X System76 Thelio223824404167OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54535545044TR 3990X System76 Thelio290030224080OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54535104194TR 3990X System76 Thelio259526894091OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

MinAvgMaxTR 7980X DIY Build146736514945TR 3990X System76 Thelio280831324186OpenBenchmarking.orgMegahertz, More Is BetterOpenVINO 2023.2.devCPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Whisper.cpp

OpenBenchmarking.orgMegahertz, More Is BetterWhisper.cpp 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 7980X DIY BuildTR 3990X System76 Thelio9001800270036004500Min: 545 / Avg: 4549.3 / Max: 4992Min: 2900 / Avg: 3732.84 / Max: 4217

OpenBenchmarking.orgMegahertz, More Is BetterWhisper.cpp 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 7980X DIY BuildTR 3990X System76 Thelio9001800270036004500Min: 545 / Avg: 4516.14 / Max: 5155Min: 2900 / Avg: 3682.86 / Max: 4236

OpenBenchmarking.orgMegahertz, More Is BetterWhisper.cpp 1.4CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 7980X DIY BuildTR 3990X System76 Thelio9001800270036004500Min: 545 / Avg: 4441.33 / Max: 5192Min: 2900 / Avg: 3560.02 / Max: 4242

Llama.cpp

MinAvgMaxTR 7980X DIY Build54540144903TR 3990X System76 Thelio290037554197OpenBenchmarking.orgMegahertz, More Is BetterLlama.cpp b1808CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54542995277TR 3990X System76 Thelio290037394180OpenBenchmarking.orgMegahertz, More Is BetterLlama.cpp b1808CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenBenchmarking.orgMegahertz, More Is BetterLlama.cpp b1808CPU Peak Freq (Highest CPU Core Frequency) MonitorTR 7980X DIY BuildTR 3990X System76 Thelio9001800270036004500Min: 545 / Avg: 4525.77 / Max: 5304Min: 2900 / Avg: 3772.11 / Max: 4189

LeelaChessZero

MinAvgMaxTR 7980X DIY Build54543395391TR 3990X System76 Thelio290036294155OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.30CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54543455371TR 3990X System76 Thelio290035144203OpenBenchmarking.orgMegahertz, More Is BetterLeelaChessZero 0.30CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Neural Magic DeepSparse

MinAvgMaxTR 7980X DIY Build54545235508TR 3990X System76 Thelio278331634212OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54544645502TR 3990X System76 Thelio251929244192OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54544345076TR 3990X System76 Thelio266929594220OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54544425297TR 3990X System76 Thelio241230344222OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54543665169TR 3990X System76 Thelio233129624264OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54544174861TR 3990X System76 Thelio266929484208OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54544895591TR 3990X System76 Thelio241130644167OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54544905296TR 3990X System76 Thelio287531804167OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54543674822TR 3990X System76 Thelio280030674199OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor12002400360048006000

MinAvgMaxTR 7980X DIY Build54547335608TR 3990X System76 Thelio245234754242OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build54545375585TR 3990X System76 Thelio281831444237OpenBenchmarking.orgMegahertz, More Is BetterNeural Magic DeepSparse 1.6CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Numpy Benchmark

MinAvgMaxTR 7980X DIY Build54550315416TR 3990X System76 Thelio220041734261OpenBenchmarking.orgMegahertz, More Is BetterNumpy BenchmarkCPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Timed Linux Kernel Compilation

MinAvgMaxTR 7980X DIY Build54542825617TR 3990X System76 Thelio287035304269OpenBenchmarking.orgMegahertz, More Is BetterTimed Linux Kernel Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build149140945317TR 3990X System76 Thelio220031704244OpenBenchmarking.orgMegahertz, More Is BetterTimed Linux Kernel Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Timed Godot Game Engine Compilation

MinAvgMaxTR 7980X DIY Build54543575292TR 3990X System76 Thelio286835634235OpenBenchmarking.orgMegahertz, More Is BetterTimed Godot Game Engine Compilation 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Timed FFmpeg Compilation

MinAvgMaxTR 7980X DIY Build54539445336TR 3990X System76 Thelio220034314274OpenBenchmarking.orgMegahertz, More Is BetterTimed FFmpeg Compilation 6.1CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Timed LLVM Compilation

MinAvgMaxTR 7980X DIY Build54541875412TR 3990X System76 Thelio280033604217OpenBenchmarking.orgMegahertz, More Is BetterTimed LLVM Compilation 16.0CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Timed Node.js Compilation

MinAvgMaxTR 7980X DIY Build54542945442TR 3990X System76 Thelio282034794268OpenBenchmarking.orgMegahertz, More Is BetterTimed Node.js Compilation 19.8.1CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Timed Gem5 Compilation

MinAvgMaxTR 7980X DIY Build54547445577TR 3990X System76 Thelio220037634267OpenBenchmarking.orgMegahertz, More Is BetterTimed Gem5 Compilation 23.0.1CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

Blender

MinAvgMaxTR 7980X DIY Build54533264194TR 3990X System76 Thelio220027654257OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor11002200330044005500

MinAvgMaxTR 7980X DIY Build54535375167TR 3990X System76 Thelio266827314142OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54532875137TR 3990X System76 Thelio268227994193OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54534954924TR 3990X System76 Thelio220027134092OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54536675267TR 3990X System76 Thelio220027844217OpenBenchmarking.orgMegahertz, More Is BetterBlender 4.0CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

Chaos Group V-RAY

MinAvgMaxTR 7980X DIY Build54538195301TR 3990X System76 Thelio265730474266OpenBenchmarking.orgMegahertz, More Is BetterChaos Group V-RAY 5.02CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

7-Zip Compression

MinAvgMaxTR 7980X DIY Build54538105277TR 3990X System76 Thelio279535004242OpenBenchmarking.orgMegahertz, More Is Better7-Zip Compression 22.01CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenFOAM

MinAvgMaxTR 7980X DIY Build54539115461TR 3990X System76 Thelio290034094206OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

MinAvgMaxTR 7980X DIY Build147044925340TR 3990X System76 Thelio290037564193OpenBenchmarking.orgMegahertz, More Is BetterOpenFOAM 10CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenRadioss

MinAvgMaxTR 7980X DIY Build54540035238TR 3990X System76 Thelio290033894163OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54540115192TR 3990X System76 Thelio290034644286OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54537775269TR 3990X System76 Thelio290033574231OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54538205053TR 3990X System76 Thelio290032704177OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54539445125TR 3990X System76 Thelio290034074192OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

MinAvgMaxTR 7980X DIY Build54545585559TR 3990X System76 Thelio290037904231OpenBenchmarking.orgMegahertz, More Is BetterOpenRadioss 2023.09.15CPU Peak Freq (Highest CPU Core Frequency) Monitor14002800420056007000

QuantLib

MinAvgMaxTR 7980X DIY Build54535214982TR 3990X System76 Thelio273228674142OpenBenchmarking.orgMegahertz, More Is BetterQuantLib 1.32CPU Peak Freq (Highest CPU Core Frequency) Monitor13002600390052006500

OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedTR 7980X DIY BuildTR 3990X System76 Thelio50K100K150K200K250KSE +/- 97.04, N = 3SE +/- 434.08, N = 3245683.2159470.11. (CXX) g++ options: -O3 -march=native -fPIE -pie
OpenBenchmarking.orgMFLOPS, More Is BetterQuantLib 1.32Configuration: Multi-ThreadedTR 7980X DIY BuildTR 3990X System76 Thelio40K80K120K160K200KMin: 245538 / Avg: 245683.17 / Max: 245867.3Min: 158772.3 / Avg: 159470.1 / Max: 160266.31. (CXX) g++ options: -O3 -march=native -fPIE -pie

7-Zip Compression

This is a test of 7-Zip compression/decompression with its integrated benchmark feature. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingTR 7980X DIY BuildTR 3990X System76 Thelio90K180K270K360K450KSE +/- 469.56, N = 3SE +/- 158.08, N = 34433491739701. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Compression RatingTR 7980X DIY BuildTR 3990X System76 Thelio80K160K240K320K400KMin: 442506 / Avg: 443348.67 / Max: 444129Min: 173655 / Avg: 173970 / Max: 1741511. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingTR 7980X DIY BuildTR 3990X System76 Thelio110K220K330K440K550KSE +/- 1196.73, N = 3SE +/- 687.51, N = 35292313649811. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 22.01Test: Decompression RatingTR 7980X DIY BuildTR 3990X System76 Thelio90K180K270K360K450KMin: 526857 / Avg: 529231.33 / Max: 530680Min: 363701 / Avg: 364981 / Max: 3660561. (CXX) g++ options: -lpthread -ldl -O2 -fPIC

LeelaChessZero

OpenBenchmarking.orgNodes Per Second Per Watt, More Is BetterLeelaChessZero 0.30Backend: EigenTR 7980X DIY BuildTR 3990X System76 Thelio0.39380.78761.18141.57521.9691.7500.384

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASTR 7980X DIY BuildTR 3990X System76 Thelio120240360480600SE +/- 2.19, N = 3SE +/- 0.88, N = 35571091. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: BLASTR 7980X DIY BuildTR 3990X System76 Thelio100200300400500Min: 554 / Avg: 556.67 / Max: 561Min: 108 / Avg: 109.33 / Max: 1111. (CXX) g++ options: -flto -pthread

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenTR 7980X DIY BuildTR 3990X System76 Thelio120240360480600SE +/- 5.78, N = 3SE +/- 0.33, N = 3533941. (CXX) g++ options: -flto -pthread
OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.30Backend: EigenTR 7980X DIY BuildTR 3990X System76 Thelio90180270360450Min: 522 / Avg: 533.33 / Max: 541Min: 94 / Avg: 94.33 / Max: 951. (CXX) g++ options: -flto -pthread

Meta Performance Per Watts

OpenBenchmarking.orgPerformance Per Watts, More Is BetterMeta Performance Per WattsPerformance Per WattsTR 7980X DIY BuildTR 3990X System76 Thelio2040608010099.2941.70

Numpy Benchmark

OpenBenchmarking.orgScore Per Watt, More Is BetterNumpy BenchmarkTR 7980X DIY BuildTR 3990X System76 Thelio1.18462.36923.55384.73845.9235.2653.459

OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkTR 7980X DIY BuildTR 3990X System76 Thelio160320480640800SE +/- 1.70, N = 3SE +/- 0.25, N = 3753.68391.71
OpenBenchmarking.orgScore, More Is BetterNumpy BenchmarkTR 7980X DIY BuildTR 3990X System76 Thelio130260390520650Min: 750.28 / Avg: 753.68 / Max: 755.44Min: 391.43 / Avg: 391.71 / Max: 392.21

Llama.cpp

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio0.02390.04780.07170.09560.11950.1060.054

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio0.01370.02740.04110.05480.06850.0610.030

OpenBenchmarking.orgTokens Per Second Per Watt, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio0.0020.0040.0060.0080.010.0090.005

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio714212835SE +/- 0.02, N = 3SE +/- 0.00, N = 330.7814.001. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-7b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio714212835Min: 30.75 / Avg: 30.78 / Max: 30.8Min: 14 / Avg: 14 / Max: 14.011. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.05, N = 3SE +/- 0.00, N = 318.438.011. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-13b.Q4_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 18.33 / Avg: 18.43 / Max: 18.5Min: 8.01 / Avg: 8.01 / Max: 8.021. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio0.6841.3682.0522.7363.42SE +/- 0.03, N = 12SE +/- 0.00, N = 33.041.451. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas
OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b1808Model: llama-2-70b-chat.Q5_0.ggufTR 7980X DIY BuildTR 3990X System76 Thelio246810Min: 2.94 / Avg: 3.04 / Max: 3.3Min: 1.45 / Avg: 1.45 / Max: 1.451. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -march=native -mtune=native -lopenblas

Chaos Group V-RAY

OpenBenchmarking.orgvsamples Per Watt, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300289.23200.02

OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20K40K60K80K100KSE +/- 667.39, N = 3SE +/- 331.05, N = 158857448871
OpenBenchmarking.orgvsamples, More Is BetterChaos Group V-RAY 5.02Mode: CPUTR 7980X DIY BuildTR 3990X System76 Thelio15K30K45K60K75KMin: 87251 / Avg: 88574.33 / Max: 89387Min: 46833 / Avg: 48871.13 / Max: 51318

OpenVINO

MinAvgMaxTR 7980X DIY Build37.363.476.5TR 3990X System76 Thelio42.366.272.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build47.466.870.5TR 3990X System76 Thelio47.067.371.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.366.081.5TR 3990X System76 Thelio48.362.369.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.367.371.0TR 3990X System76 Thelio49.869.171.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.166.769.6TR 3990X System76 Thelio48.568.972.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.667.071.9TR 3990X System76 Thelio49.064.169.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.165.569.6TR 3990X System76 Thelio50.063.767.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.167.171.0TR 3990X System76 Thelio50.069.772.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.368.171.9TR 3990X System76 Thelio49.868.071.3OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.167.573.8TR 3990X System76 Thelio49.868.676.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenVINO 2023.2.devCPU Temperature Monitor20406080100

Whisper.cpp

OpenBenchmarking.orgCelsius, Fewer Is BetterWhisper.cpp 1.4CPU Temperature MonitorTR 7980X DIY BuildTR 3990X System76 Thelio1530456075Min: 49.13 / Avg: 69.31 / Max: 76Min: 48.75 / Avg: 66.64 / Max: 70.5

OpenBenchmarking.orgCelsius, Fewer Is BetterWhisper.cpp 1.4CPU Temperature MonitorTR 7980X DIY BuildTR 3990X System76 Thelio1428425670Min: 48.25 / Avg: 68.54 / Max: 75.13Min: 48.75 / Avg: 67.13 / Max: 71.75

OpenBenchmarking.orgCelsius, Fewer Is BetterWhisper.cpp 1.4CPU Temperature MonitorTR 7980X DIY BuildTR 3990X System76 Thelio1530456075Min: 49.13 / Avg: 69.3 / Max: 75.5Min: 48.75 / Avg: 67.38 / Max: 71

Neural Magic DeepSparse

MinAvgMaxTR 7980X DIY Build46.050.552.4TR 3990X System76 Thelio46.360.667.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build42.849.051.0TR 3990X System76 Thelio48.361.866.3OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build41.949.051.0TR 3990X System76 Thelio49.363.968.0OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build43.649.051.4TR 3990X System76 Thelio48.561.968.3OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build41.948.550.0TR 3990X System76 Thelio49.064.269.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build41.448.250.0TR 3990X System76 Thelio49.864.368.8OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build41.948.451.0TR 3990X System76 Thelio49.562.369.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build41.548.750.5TR 3990X System76 Thelio48.863.172.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build42.349.451.9TR 3990X System76 Thelio49.063.567.8OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build42.847.249.6TR 3990X System76 Thelio49.057.967.5OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build41.447.950.0TR 3990X System76 Thelio48.561.867.8OpenBenchmarking.orgCelsius, Fewer Is BetterNeural Magic DeepSparse 1.6CPU Temperature Monitor20406080100

Timed Linux Kernel Compilation

MinAvgMaxTR 7980X DIY Build38.355.084.6TR 3990X System76 Thelio46.058.776.5OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Linux Kernel Compilation 6.1CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build43.667.383.8TR 3990X System76 Thelio47.366.874.0OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Linux Kernel Compilation 6.1CPU Temperature Monitor20406080100

Timed Godot Game Engine Compilation

MinAvgMaxTR 7980X DIY Build43.360.385.1TR 3990X System76 Thelio47.563.279.3OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Godot Game Engine Compilation 4.0CPU Temperature Monitor20406080100

Timed FFmpeg Compilation

MinAvgMaxTR 7980X DIY Build43.655.679.6TR 3990X System76 Thelio47.857.873.8OpenBenchmarking.orgCelsius, Fewer Is BetterTimed FFmpeg Compilation 6.1CPU Temperature Monitor20406080100

Timed LLVM Compilation

MinAvgMaxTR 7980X DIY Build43.667.189.3TR 3990X System76 Thelio47.865.176.0OpenBenchmarking.orgCelsius, Fewer Is BetterTimed LLVM Compilation 16.0CPU Temperature Monitor20406080100

Timed Node.js Compilation

MinAvgMaxTR 7980X DIY Build46.964.988.3TR 3990X System76 Thelio48.864.177.5OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Node.js Compilation 19.8.1CPU Temperature Monitor20406080100

Timed Gem5 Compilation

MinAvgMaxTR 7980X DIY Build41.954.682.9TR 3990X System76 Thelio47.357.874.3OpenBenchmarking.orgCelsius, Fewer Is BetterTimed Gem5 Compilation 23.0.1CPU Temperature Monitor20406080100

Blender

MinAvgMaxTR 7980X DIY Build40.059.567.4TR 3990X System76 Thelio47.362.566.8OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build47.467.372.0TR 3990X System76 Thelio48.866.268.5OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.364.482.9TR 3990X System76 Thelio49.065.369.0OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.668.071.5TR 3990X System76 Thelio48.866.779.3OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.669.187.0TR 3990X System76 Thelio49.067.972.8OpenBenchmarking.orgCelsius, Fewer Is BetterBlender 4.0CPU Temperature Monitor20406080100

OpenFOAM

MinAvgMaxTR 7980X DIY Build49.166.571.0TR 3990X System76 Thelio48.566.570.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.668.781.0TR 3990X System76 Thelio49.371.077.5OpenBenchmarking.orgCelsius, Fewer Is BetterOpenFOAM 10CPU Temperature Monitor20406080100

OpenRadioss

MinAvgMaxTR 7980X DIY Build48.370.382.9TR 3990X System76 Thelio49.869.073.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build48.666.972.4TR 3990X System76 Thelio49.866.872.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.164.186.0TR 3990X System76 Thelio49.566.073.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build47.869.874.3TR 3990X System76 Thelio48.868.371.8OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build50.069.488.3TR 3990X System76 Thelio49.868.572.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

MinAvgMaxTR 7980X DIY Build49.167.192.4TR 3990X System76 Thelio50.568.675.0OpenBenchmarking.orgCelsius, Fewer Is BetterOpenRadioss 2023.09.15CPU Temperature Monitor20406080100

OpenVINO

This is a test of the Intel OpenVINO, a toolkit around neural networks, using its built-in benchmarking support and analyzing the throughput and latency for various models. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio400800120016002000SE +/- 2.22, N = 3SE +/- 6.80, N = 3405.371763.38MIN: 344.27 / MAX: 423.97MIN: 1658.83 / MAX: 1802.811. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500Min: 400.99 / Avg: 405.37 / Max: 408.25Min: 1750.34 / Avg: 1763.38 / Max: 1773.221. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio0.25650.5130.76951.0261.2825SE +/- 0.00, N = 3SE +/- 0.00, N = 30.401.14MIN: 0.18 / MAX: 27.23MIN: 0.58 / MAX: 11.741. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Age Gender Recognition Retail 0013 FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio246810Min: 0.39 / Avg: 0.4 / Max: 0.4Min: 1.14 / Avg: 1.14 / Max: 1.141. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio90180270360450SE +/- 3.04, N = 15SE +/- 1.75, N = 3145.95412.09MIN: 40.15 / MAX: 306.09MIN: 190.32 / MAX: 502.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio70140210280350Min: 114.46 / Avg: 145.95 / Max: 154.41Min: 410.31 / Avg: 412.09 / Max: 415.591. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio816243240SE +/- 0.02, N = 3SE +/- 0.05, N = 38.0935.94MIN: 3.7 / MAX: 19.86MIN: 18.09 / MAX: 65.011. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Weld Porosity Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 8.06 / Avg: 8.09 / Max: 8.11Min: 35.84 / Avg: 35.94 / Max: 361. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.01, N = 3SE +/- 0.08, N = 36.6722.91MIN: 3.42 / MAX: 32MIN: 12.08 / MAX: 49.521. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Vehicle Detection FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 6.65 / Avg: 6.67 / Max: 6.68Min: 22.76 / Avg: 22.91 / Max: 23.021. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.01, N = 3SE +/- 0.08, N = 37.4820.85MIN: 4.13 / MAX: 17.57MIN: 11.83 / MAX: 44.861. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Person Vehicle Bike Detection FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 7.46 / Avg: 7.48 / Max: 7.51Min: 20.69 / Avg: 20.85 / Max: 20.941. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300SE +/- 0.15, N = 3SE +/- 1.80, N = 374.42266.39MIN: 39.51 / MAX: 109.01MIN: 120.23 / MAX: 356.461. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Machine Translation EN To DE FP16 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250Min: 74.13 / Avg: 74.42 / Max: 74.58Min: 263.12 / Avg: 266.39 / Max: 269.321. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio246810SE +/- 0.01, N = 3SE +/- 0.02, N = 34.607.34MIN: 2.13 / MAX: 19.82MIN: 4.14 / MAX: 22.271. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Face Detection Retail FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio3691215Min: 4.58 / Avg: 4.6 / Max: 4.61Min: 7.3 / Avg: 7.34 / Max: 7.371. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.10, N = 3SE +/- 0.47, N = 337.31124.25MIN: 21.65 / MAX: 56.7MIN: 71.1 / MAX: 148.341. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Handwritten English Recognition FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 37.11 / Avg: 37.31 / Max: 37.42Min: 123.31 / Avg: 124.25 / Max: 124.771. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio1326395265SE +/- 0.02, N = 3SE +/- 0.46, N = 1519.9258.28MIN: 12.32 / MAX: 32.17MIN: 26.07 / MAX: 102.471. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie
OpenBenchmarking.orgms, Fewer Is BetterOpenVINO 2023.2.devModel: Road Segmentation ADAS FP16-INT8 - Device: CPUTR 7980X DIY BuildTR 3990X System76 Thelio1224364860Min: 19.89 / Avg: 19.92 / Max: 19.95Min: 55.37 / Avg: 58.28 / Max: 61.311. (CXX) g++ options: -fsigned-char -ffunction-sections -fdata-sections -O3 -fno-strict-overflow -fwrapv -pie

Neural Magic DeepSparse

This is a benchmark of Neural Magic's DeepSparse using its built-in deepsparse.benchmark utility and various models from their SparseZoo (https://sparsezoo.neuralmagic.com/). Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio714212835SE +/- 0.0108, N = 3SE +/- 0.0689, N = 38.814031.8335
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio714212835Min: 8.8 / Avg: 8.81 / Max: 8.84Min: 31.71 / Avg: 31.83 / Max: 31.94

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.01, N = 3SE +/- 0.04, N = 341.9692.58
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 41.94 / Avg: 41.96 / Max: 41.99Min: 92.49 / Avg: 92.58 / Max: 92.63

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1632486480SE +/- 0.02, N = 3SE +/- 0.07, N = 328.5470.37
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1428425670Min: 28.52 / Avg: 28.54 / Max: 28.58Min: 70.24 / Avg: 70.37 / Max: 70.46

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000SE +/- 0.44, N = 3SE +/- 4.97, N = 3359.86816.65
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio140280420560700Min: 359.31 / Avg: 359.86 / Max: 360.72Min: 807.78 / Avg: 816.65 / Max: 824.96

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.10, N = 3SE +/- 0.45, N = 361.21153.69
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio306090120150Min: 61.02 / Avg: 61.21 / Max: 61.34Min: 152.9 / Avg: 153.69 / Max: 154.46

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.05, N = 3SE +/- 0.87, N = 359.88148.80
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Detection, YOLOv5s COCO, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio306090120150Min: 59.82 / Avg: 59.88 / Max: 59.98Min: 147.7 / Avg: 148.8 / Max: 150.53

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000SE +/- 0.17, N = 3SE +/- 9.47, N = 3359.86832.62
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio150300450600750Min: 359.65 / Avg: 359.86 / Max: 360.19Min: 822.97 / Avg: 832.62 / Max: 851.54

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio160320480640800SE +/- 0.02, N = 3SE +/- 1.54, N = 3190.65722.51
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio130260390520650Min: 190.62 / Avg: 190.65 / Max: 190.68Min: 720.76 / Avg: 722.51 / Max: 725.57

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1632486480SE +/- 0.01, N = 3SE +/- 0.08, N = 328.5470.55
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Baseline - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1428425670Min: 28.53 / Avg: 28.54 / Max: 28.55Min: 70.39 / Avg: 70.55 / Max: 70.65

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio3691215SE +/- 0.0127, N = 3SE +/- 0.0526, N = 33.351812.0505
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: ResNet-50, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio48121620Min: 3.34 / Avg: 3.35 / Max: 3.38Min: 11.97 / Avg: 12.05 / Max: 12.15

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio140280420560700SE +/- 0.18, N = 3SE +/- 0.05, N = 3288.58641.77
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio110220330440550Min: 288.29 / Avg: 288.58 / Max: 288.9Min: 641.7 / Avg: 641.77 / Max: 641.87

OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1428425670SE +/- 0.01, N = 3SE +/- 0.03, N = 319.7061.98
OpenBenchmarking.orgms/batch, Fewer Is BetterNeural Magic DeepSparse 1.6Model: BERT-Large, NLP Question Answering, Sparse INT8 - Scenario: Asynchronous Multi-StreamTR 7980X DIY BuildTR 3990X System76 Thelio1224364860Min: 19.69 / Avg: 19.7 / Max: 19.71Min: 61.92 / Avg: 61.98 / Max: 62.01

Whisper.cpp

Whisper.cpp is a port of OpenAI's Whisper model in C/C++. Whisper.cpp is developed by Georgi Gerganov for transcribing WAV audio files to text / speech recognition. Whisper.cpp supports ARM NEON, x86 AVX, and other advanced CPU features. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-base.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250SE +/- 4.70, N = 12SE +/- 0.87, N = 3192.00248.001. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-base.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 165.04 / Avg: 192 / Max: 218.19Min: 246.26 / Avg: 248 / Max: 248.941. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-small.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio130260390520650SE +/- 15.22, N = 9SE +/- 6.62, N = 9445.32579.211. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-small.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio100200300400500Min: 364.49 / Avg: 445.32 / Max: 482.62Min: 552.59 / Avg: 579.21 / Max: 617.151. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-medium.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500SE +/- 4.81, N = 3SE +/- 11.88, N = 7925.981259.411. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread
OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.4Model: ggml-medium.en - Input: 2016 State of the UnionTR 7980X DIY BuildTR 3990X System76 Thelio2004006008001000Min: 917.12 / Avg: 925.98 / Max: 933.66Min: 1210.21 / Avg: 1259.41 / Max: 1289.891. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread

Timed Linux Kernel Compilation

This test times how long it takes to build the Linux kernel in a default configuration (defconfig) for the architecture being tested or alternatively an allmodconfig for building all possible kernel modules for the build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigTR 7980X DIY BuildTR 3990X System76 Thelio816243240SE +/- 0.23, N = 6SE +/- 0.29, N = 923.4135.86
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: defconfigTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 22.83 / Avg: 23.41 / Max: 24.5Min: 35.46 / Avg: 35.86 / Max: 38.15

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigTR 7980X DIY BuildTR 3990X System76 Thelio70140210280350SE +/- 0.36, N = 3SE +/- 0.52, N = 3216.69335.74
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Linux Kernel Compilation 6.1Build: allmodconfigTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300Min: 216.12 / Avg: 216.69 / Max: 217.36Min: 335.1 / Avg: 335.74 / Max: 336.77

Timed Mesa Compilation

This test profile times how long it takes to compile Mesa with Meson/Ninja. For minimizing build dependencies and avoid versioning conflicts, test this is just the core Mesa build without LLVM or the extra Gallium3D/Mesa drivers enabled. Learn more via the OpenBenchmarking.org test page.

Time To Compile

TR 7980X DIY Build: The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

TR 3990X System76 Thelio: The test quit with a non-zero exit status. E: ninja: error: loading 'build.ninja': No such file or directory

Timed Godot Game Engine Compilation

This test times how long it takes to compile the Godot Game Engine. Godot is a popular, open-source, cross-platform 2D/3D game engine and is built using the SCons build system and targeting the X11 platform. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.14, N = 3SE +/- 0.30, N = 379.84131.36
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Godot Game Engine Compilation 4.0Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 79.56 / Avg: 79.84 / Max: 80Min: 130.86 / Avg: 131.36 / Max: 131.9

Timed FFmpeg Compilation

This test times how long it takes to build the FFmpeg multimedia library. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio510152025SE +/- 0.03, N = 4SE +/- 0.05, N = 311.6719.38
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed FFmpeg Compilation 6.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio510152025Min: 11.62 / Avg: 11.67 / Max: 11.74Min: 19.27 / Avg: 19.38 / Max: 19.44

Timed LLVM Compilation

This test times how long it takes to compile/build the LLVM compiler stack. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 0.22, N = 3SE +/- 0.18, N = 3122.23204.00
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed LLVM Compilation 16.0Build System: NinjaTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 121.79 / Avg: 122.23 / Max: 122.46Min: 203.67 / Avg: 204 / Max: 204.27

Timed Node.js Compilation

This test profile times how long it takes to build/compile Node.js itself from source. Node.js is a JavaScript run-time built from the Chrome V8 JavaScript engine while itself is written in C/C++. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 0.78, N = 3SE +/- 1.78, N = 3113.78185.54
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Node.js Compilation 19.8.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio306090120150Min: 112.89 / Avg: 113.78 / Max: 115.34Min: 183.34 / Avg: 185.54 / Max: 189.07

Timed Gem5 Compilation

This test times how long it takes to compile Gem5. Gem5 is a simulator for computer system architecture research. Gem5 is widely used for computer architecture research within the industry, academia, and more. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300SE +/- 2.15, N = 3SE +/- 1.78, N = 3178.79281.54
OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Gem5 Compilation 23.0.1Time To CompileTR 7980X DIY BuildTR 3990X System76 Thelio50100150200250Min: 176.35 / Avg: 178.79 / Max: 183.09Min: 279.64 / Avg: 281.54 / Max: 285.09

Blender

Blender is an open-source 3D creation and modeling software project. This test is of Blender's Cycles performance with various sample files. GPU computing via NVIDIA OptiX and NVIDIA CUDA is currently supported as well as HIP for AMD Radeon GPUs and Intel oneAPI for Intel Graphics. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio714212835SE +/- 0.03, N = 3SE +/- 0.09, N = 318.4730.43
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: BMW27 - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio714212835Min: 18.42 / Avg: 18.47 / Max: 18.52Min: 30.27 / Avg: 30.43 / Max: 30.59

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.15, N = 3SE +/- 0.56, N = 347.1582.54
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Classroom - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio1632486480Min: 46.93 / Avg: 47.15 / Max: 47.44Min: 81.42 / Avg: 82.54 / Max: 83.14

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio918273645SE +/- 0.09, N = 3SE +/- 0.10, N = 323.8037.56
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Fishy Cat - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio816243240Min: 23.63 / Avg: 23.8 / Max: 23.91Min: 37.36 / Avg: 37.56 / Max: 37.69

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.15, N = 3SE +/- 0.24, N = 357.9496.76
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Pabellon Barcelona - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 57.64 / Avg: 57.94 / Max: 58.14Min: 96.28 / Avg: 96.76 / Max: 97.02

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio70140210280350SE +/- 0.09, N = 3SE +/- 1.16, N = 3166.88309.06
OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.0Blend File: Barbershop - Compute: CPU-OnlyTR 7980X DIY BuildTR 3990X System76 Thelio60120180240300Min: 166.74 / Avg: 166.88 / Max: 167.05Min: 307.31 / Avg: 309.06 / Max: 311.25

OpenFOAM

OpenFOAM is the leading free, open-source software for computational fluid dynamics (CFD). This test profile currently uses the drivaerFastback test case for analyzing automotive aerodynamics or alternatively the older motorBike input. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Mesh TimeTR 7980X DIY BuildTR 3990X System76 Thelio71421283519.5528.371. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Small Mesh Size - Execution TimeTR 7980X DIY BuildTR 3990X System76 Thelio163248648036.8674.111. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Mesh TimeTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200104.60184.711. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenFOAM 10Input: drivaerFastback, Medium Mesh Size - Execution TimeTR 7980X DIY BuildTR 3990X System76 Thelio30060090012001500617.271362.361. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfoamToVTK -ldynamicMesh -llagrangian -lgenericPatchFields -lfileFormats -lOpenFOAM -ldl -lm

OpenRadioss

OpenRadioss is an open-source AGPL-licensed finite element solver for dynamic event analysis OpenRadioss is based on Altair Radioss and open-sourced in 2022. This open-source finite element solver is benchmarked with various example models available from https://www.openradioss.org/models/ and https://github.com/OpenRadioss/ModelExchange/tree/main/Examples. This test is currently using a reference OpenRadioss binary build offered via GitHub. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on WindshieldTR 7980X DIY BuildTR 3990X System76 Thelio306090120150SE +/- 0.68, N = 3SE +/- 0.67, N = 3105.42153.62
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bird Strike on WindshieldTR 7980X DIY BuildTR 3990X System76 Thelio306090120150Min: 104.18 / Avg: 105.42 / Max: 106.51Min: 152.29 / Avg: 153.62 / Max: 154.37

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal InstallationTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.34, N = 3SE +/- 0.07, N = 353.1893.61
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Rubber O-Ring Seal InstallationTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 52.53 / Avg: 53.18 / Max: 53.7Min: 93.48 / Avg: 93.61 / Max: 93.72

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestTR 7980X DIY BuildTR 3990X System76 Thelio1122334455SE +/- 0.10, N = 3SE +/- 0.36, N = 323.4148.31
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Cell Phone Drop TestTR 7980X DIY BuildTR 3990X System76 Thelio1020304050Min: 23.23 / Avg: 23.41 / Max: 23.58Min: 47.68 / Avg: 48.31 / Max: 48.92

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper BeamTR 7980X DIY BuildTR 3990X System76 Thelio20406080100SE +/- 0.65, N = 3SE +/- 0.27, N = 375.61104.16
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Bumper BeamTR 7980X DIY BuildTR 3990X System76 Thelio20406080100Min: 74.9 / Avg: 75.61 / Max: 76.9Min: 103.64 / Avg: 104.16 / Max: 104.53

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200SE +/- 0.12, N = 3SE +/- 0.44, N = 3115.12204.54
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: INIVOL and Fluid Structure Interaction Drop ContainerTR 7980X DIY BuildTR 3990X System76 Thelio4080120160200Min: 114.89 / Avg: 115.12 / Max: 115.28Min: 203.67 / Avg: 204.54 / Max: 205.06

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MTR 7980X DIY BuildTR 3990X System76 Thelio140280420560700SE +/- 3.99, N = 3SE +/- 0.33, N = 3292.06671.04
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenRadioss 2023.09.15Model: Chrysler Neon 1MTR 7980X DIY BuildTR 3990X System76 Thelio120240360480600Min: 284.8 / Avg: 292.06 / Max: 298.57Min: 670.6 / Avg: 671.04 / Max: 671.68

215 Results Shown

CPU Temperature Monitor:
  Phoronix Test Suite System Monitoring:
    Celsius
    Megahertz
    Watts
  CPU - 1 - ResNet-50:
    batches/sec Per Watt
PyTorch:
  CPU - 1 - ResNet-152
  CPU - 1 - Efficientnet_v2_l
  CPU - 64 - ResNet-50
  CPU - 64 - ResNet-152
PyTorch
PyTorch:
  CPU - 1 - ResNet-50
  CPU - 64 - Efficientnet_v2_l
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
Embree:
  Pathtracer ISPC - Crown
  Preset 8 - Bosphorus 4K
  Preset 4 - Bosphorus 4K
Embree:
  Pathtracer ISPC - Asian Dragon
  Pathtracer ISPC - Crown
SVT-AV1:
  Preset 13 - Bosphorus 4K
  Preset 12 - Bosphorus 4K
  Preset 8 - Bosphorus 4K
  Preset 4 - Bosphorus 4K
TensorFlow:
  CPU - 1 - ResNet-50
  CPU - 16 - ResNet-50
  CPU - 256 - ResNet-50
OSPRay:
  gravity_spheres_volume/dim_512/ao/real_time
  gravity_spheres_volume/dim_512/pathtracer/real_time
  particle_volume/scivis/real_time
  particle_volume/pathtracer/real_time
  gravity_spheres_volume/dim_512/scivis/real_time
OSPRay
OSPRay
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  ResNet-50, Baseline - Asynchronous Multi-Stream
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream
IndigoBench:
  CPU - Supercar
  CPU - Bedroom
OpenVINO:
  CPU Peak Freq (Highest CPU Core Frequency) Monitor:
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
    Megahertz
QuantLib
7-Zip Compression:
  Compression Rating
  Decompression Rating
LeelaChessZero
LeelaChessZero:
  BLAS
  Eigen
Meta Performance Per Watts:
  Performance Per Watts
 
Numpy Benchmark
Llama.cpp:
  llama-2-7b.Q4_0.gguf
  llama-2-13b.Q4_0.gguf
  llama-2-70b-chat.Q5_0.gguf
Llama.cpp:
  llama-2-7b.Q4_0.gguf
  llama-2-13b.Q4_0.gguf
  llama-2-70b-chat.Q5_0.gguf
Chaos Group V-RAY
Chaos Group V-RAY
OpenVINO:
  CPU Temp Monitor:
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
    Celsius
OpenVINO:
  Face Detection FP16-INT8 - CPU
  Age Gender Recognition Retail 0013 FP16-INT8 - CPU
  Person Detection FP16 - CPU
  Weld Porosity Detection FP16-INT8 - CPU
  Vehicle Detection FP16-INT8 - CPU
  Person Vehicle Bike Detection FP16 - CPU
  Machine Translation EN To DE FP16 - CPU
  Face Detection Retail FP16-INT8 - CPU
  Handwritten English Recognition FP16-INT8 - CPU
  Road Segmentation ADAS FP16-INT8 - CPU
Neural Magic DeepSparse:
  NLP Text Classification, BERT base uncased SST2, Sparse INT8 - Asynchronous Multi-Stream
  NLP Text Classification, DistilBERT mnli - Asynchronous Multi-Stream
  CV Classification, ResNet-50 ImageNet - Asynchronous Multi-Stream
  NLP Token Classification, BERT base uncased conll2003 - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO - Asynchronous Multi-Stream
  CV Detection, YOLOv5s COCO, Sparse INT8 - Asynchronous Multi-Stream
  NLP Document Classification, oBERT base uncased on IMDB - Asynchronous Multi-Stream
  CV Segmentation, 90% Pruned YOLACT Pruned - Asynchronous Multi-Stream
  ResNet-50, Baseline - Asynchronous Multi-Stream
  ResNet-50, Sparse INT8 - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering - Asynchronous Multi-Stream
  BERT-Large, NLP Question Answering, Sparse INT8 - Asynchronous Multi-Stream
Whisper.cpp:
  ggml-base.en - 2016 State of the Union
  ggml-small.en - 2016 State of the Union
  ggml-medium.en - 2016 State of the Union
Timed Linux Kernel Compilation:
  defconfig
  allmodconfig
Timed Godot Game Engine Compilation
Timed FFmpeg Compilation
Timed LLVM Compilation
Timed Node.js Compilation
Timed Gem5 Compilation
Blender:
  BMW27 - CPU-Only
  Classroom - CPU-Only
  Fishy Cat - CPU-Only
  Pabellon Barcelona - CPU-Only
  Barbershop - CPU-Only
OpenFOAM:
  drivaerFastback, Small Mesh Size - Mesh Time
  drivaerFastback, Small Mesh Size - Execution Time
  drivaerFastback, Medium Mesh Size - Mesh Time
  drivaerFastback, Medium Mesh Size - Execution Time
OpenRadioss:
  Bird Strike on Windshield
  Rubber O-Ring Seal Installation
  Cell Phone Drop Test
  Bumper Beam
  INIVOL and Fluid Structure Interaction Drop Container
  Chrysler Neon 1M