DDR5 Memory Cooling Performance For AMD EPYC Turin AMD EPYC 9655P with 12 x DDR5-6000 memory comparing performance and thermals with Corsair Airflow memory cooling adapters. Benchmarks by Michael Larabel.
HTML result view exported from: https://openbenchmarking.org/result/2411275-NE-MEMORYTHE74&sor&grt .
DDR5 Memory Cooling Performance For AMD EPYC Turin Processor Motherboard Chipset Memory Disk Graphics Network OS Kernel Desktop Display Server Compiler File-System Screen Resolution Without Extra Cooling Corsair Airflow Memory Cooling AMD EPYC 9655P 96-Core @ 2.60GHz (96 Cores / 192 Threads) Supermicro Super Server H13SSL-N v1.01 (3.0 BIOS) AMD 1Ah 12 x 64GB DDR5-6000MT/s Micron MTC40F2046S1RC64BDY QSFF 3201GB Micron_7450_MTFDKCB3T2TFS ASPEED 2 x Broadcom NetXtreme BCM5720 PCIe Ubuntu 24.10 6.12.0-rc7-linux-pm-next-phx (x86_64) GNOME Shell 47.0 X Server GCC 14.2.0 ext4 1024x768 OpenBenchmarking.org Kernel Details - Transparent Huge Pages: madvise Compiler Details - --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2,rust --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-14-zdkDXv/gcc-14-14.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details - Scaling Governor: acpi-cpufreq performance (Boost: Enabled) - CPU Microcode: 0xb002116 Java Details - OpenJDK Runtime Environment (build 21.0.5+11-Ubuntu-1ubuntu124.10) Python Details - Python 3.12.7 Security Details - gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected
DDR5 Memory Cooling Performance For AMD EPYC Turin compress-7zip: Compression Rating compress-7zip: Decompression Rating blender: BMW27 - CPU-Only blender: Barbershop - CPU-Only blender: Junkshop - CPU-Only build2: Time To Compile graph500: 26 graph500: 26 graph500: 26 graph500: 26 gromacs: MPI CPU - water_GMX50_bare hpcg: 104 104 104 - 60 hpcg: 144 144 144 - 60 hpcg: 160 160 160 - 60 namd: ATPase with 327,506 Atoms namd: STMV with 1,066,628 Atoms nwchem: C240 Buckyball openfoam: drivaerFastback, Small Mesh Size - Mesh Time openfoam: drivaerFastback, Small Mesh Size - Execution Time openfoam: drivaerFastback, Medium Mesh Size - Mesh Time openfoam: drivaerFastback, Medium Mesh Size - Execution Time openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time To First Token openvino-genai: TinyLlama-1.1B-Chat-v1.0 - CPU - Time Per Output Token openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Token openvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Token openvino-genai: Falcon-7b-instruct-int4-ov - CPU openvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Token openvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Token openvino-genai: Gemma-7b-int4-ov - CPU openvino-genai: Gemma-7b-int4-ov - CPU - Time To First Token openvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Token renaissance: Apache Spark Bayes svt-av1: Preset 13 - Bosphorus 4K svt-av1: Preset 13 - Beauty 4K 10-bit svt-av1: Preset 3 - Bosphorus 4K svt-av1: Preset 3 - Beauty 4K 10-bit build-linux-kernel: defconfig build-linux-kernel: allmodconfig Without Extra Cooling Corsair Airflow Memory Cooling 756280 625450 13.18 124.49 16.86 52.511 1446300000 1491340000 497484000 671229000 15.686 31.6695 30.7154 30.6754 10.65783 2.78158 1360.8 23.742967 23.316389 110.45187 313.86866 58.01 20.69 17.24 47.52 27.15 21.05 37.53 32.91 26.65 28.67 42.15 34.88 205.5 421.997 17.148 15.690 1.844 22.313 195.491 784376 626810 13.24 124.23 16.89 53.202 1406690000 1448580000 541022000 723993000 17.776 62.6455 60.3562 58.6525 12.42704 4.22396 1354.7 23.547692 23.880443 103.58124 196.38242 66.07 18.60 15.14 55.68 24.11 17.96 51.06 29.21 19.59 37.91 36.10 26.38 185.4 425.023 17.111 15.591 1.842 22.385 195.566 OpenBenchmarking.org
7-Zip Compression Test: Compression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 24.05 Test: Compression Rating Corsair Airflow Memory Cooling Without Extra Cooling 200K 400K 600K 800K 1000K SE +/- 4235.99, N = 3 SE +/- 4691.61, N = 3 784376 756280 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Test: Decompression Rating OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 24.05 Test: Decompression Rating Corsair Airflow Memory Cooling Without Extra Cooling 130K 260K 390K 520K 650K SE +/- 486.33, N = 3 SE +/- 766.64, N = 3 626810 625450 1. (CXX) g++ options: -lpthread -ldl -O2 -fPIC
7-Zip Compression Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 47.0 48.9 50.0 Without Extra Cooling 88.0 89.2 90.0 OpenBenchmarking.org Celsius, Fewer Is Better 7-Zip Compression 24.05 Memory Temperature Monitor 20 40 60 80 100
Blender Blend File: BMW27 - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.3 Blend File: BMW27 - Compute: CPU-Only Without Extra Cooling Corsair Airflow Memory Cooling 3 6 9 12 15 SE +/- 0.05, N = 4 SE +/- 0.04, N = 4 13.18 13.24
Blender Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 51.0 54.3 59.0 Without Extra Cooling 99.0 102.0 106.0 OpenBenchmarking.org Celsius, Fewer Is Better Blender 4.3 Memory Temperature Monitor 20 40 60 80 100
Blender Blend File: Barbershop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.3 Blend File: Barbershop - Compute: CPU-Only Corsair Airflow Memory Cooling Without Extra Cooling 30 60 90 120 150 SE +/- 0.20, N = 3 SE +/- 0.24, N = 3 124.23 124.49
Blender Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 49.0 50.1 51.0 Without Extra Cooling 92.0 93.3 97.0 OpenBenchmarking.org Celsius, Fewer Is Better Blender 4.3 Memory Temperature Monitor 20 40 60 80 100
Blender Blend File: Junkshop - Compute: CPU-Only OpenBenchmarking.org Seconds, Fewer Is Better Blender 4.3 Blend File: Junkshop - Compute: CPU-Only Without Extra Cooling Corsair Airflow Memory Cooling 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.15, N = 3 16.86 16.89
Blender Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 49.0 49.3 50.0 Without Extra Cooling 90.0 90.7 91.0 OpenBenchmarking.org Celsius, Fewer Is Better Blender 4.3 Memory Temperature Monitor 20 40 60 80 100
Build2 Time To Compile OpenBenchmarking.org Seconds, Fewer Is Better Build2 0.17 Time To Compile Without Extra Cooling Corsair Airflow Memory Cooling 12 24 36 48 60 SE +/- 0.39, N = 3 SE +/- 0.11, N = 3 52.51 53.20
Build2 Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 45.0 46.3 48.0 Without Extra Cooling 82.0 84.9 87.0 OpenBenchmarking.org Celsius, Fewer Is Better Build2 0.17 Memory Temperature Monitor 20 40 60 80 100
Graph500 Scale: 26 OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 Without Extra Cooling Corsair Airflow Memory Cooling 300M 600M 900M 1200M 1500M 1446300000 1406690000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 Without Extra Cooling Corsair Airflow Memory Cooling 300M 600M 900M 1200M 1500M 1491340000 1448580000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 Corsair Airflow Memory Cooling Without Extra Cooling 120M 240M 360M 480M 600M 541022000 497484000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Scale: 26 OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 Corsair Airflow Memory Cooling Without Extra Cooling 160M 320M 480M 640M 800M 723993000 671229000 1. (CC) gcc options: -fcommon -O3 -lpthread -lm -lmpi
Graph500 Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 60.0 60.8 65.0 Without Extra Cooling 113.0 115.9 119.0 OpenBenchmarking.org Celsius, Fewer Is Better Graph500 3.0 Memory Temperature Monitor 40 80 120 160 200
GROMACS Implementation: MPI CPU - Input: water_GMX50_bare OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2024 Implementation: MPI CPU - Input: water_GMX50_bare Corsair Airflow Memory Cooling Without Extra Cooling 4 8 12 16 20 SE +/- 0.02, N = 3 SE +/- 0.02, N = 3 17.78 15.69 1. (CXX) g++ options: -O3 -lm
GROMACS Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 46.0 47.0 48.0 Without Extra Cooling 86.0 86.4 88.0 OpenBenchmarking.org Celsius, Fewer Is Better GROMACS 2024 Memory Temperature Monitor 20 40 60 80 100
High Performance Conjugate Gradient X Y Z: 104 104 104 - RT: 60 OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 104 104 104 - RT: 60 Corsair Airflow Memory Cooling Without Extra Cooling 14 28 42 56 70 SE +/- 0.10, N = 3 SE +/- 0.57, N = 12 62.65 31.67 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
High Performance Conjugate Gradient Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 30.0 58.4 68.0 Without Extra Cooling 36.0 105.9 115.0 OpenBenchmarking.org Celsius, Fewer Is Better High Performance Conjugate Gradient 3.1 Memory Temperature Monitor 40 80 120 160 200
High Performance Conjugate Gradient X Y Z: 144 144 144 - RT: 60 OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 144 144 144 - RT: 60 Corsair Airflow Memory Cooling Without Extra Cooling 14 28 42 56 70 SE +/- 0.74, N = 3 SE +/- 0.00, N = 3 60.36 30.72 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
High Performance Conjugate Gradient Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 60.0 68.5 70.0 Without Extra Cooling 111.0 114.6 116.0 OpenBenchmarking.org Celsius, Fewer Is Better High Performance Conjugate Gradient 3.1 Memory Temperature Monitor 40 80 120 160 200
High Performance Conjugate Gradient X Y Z: 160 160 160 - RT: 60 OpenBenchmarking.org GFLOP/s, More Is Better High Performance Conjugate Gradient 3.1 X Y Z: 160 160 160 - RT: 60 Corsair Airflow Memory Cooling Without Extra Cooling 13 26 39 52 65 SE +/- 0.20, N = 3 SE +/- 0.01, N = 3 58.65 30.68 1. (CXX) g++ options: -O3 -ffast-math -ftree-vectorize -lmpi_cxx -lmpi
High Performance Conjugate Gradient Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 62.0 69.3 70.0 Without Extra Cooling 113.0 116.4 118.0 OpenBenchmarking.org Celsius, Fewer Is Better High Performance Conjugate Gradient 3.1 Memory Temperature Monitor 40 80 120 160 200
NAMD Input: ATPase with 327,506 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0 Input: ATPase with 327,506 Atoms Corsair Airflow Memory Cooling Without Extra Cooling 3 6 9 12 15 SE +/- 0.04, N = 7 SE +/- 0.04, N = 7 12.43 10.66
NAMD Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 47.0 47.7 49.0 Without Extra Cooling 90.0 91.7 94.0 OpenBenchmarking.org Celsius, Fewer Is Better NAMD 3.0 Memory Temperature Monitor 20 40 60 80 100
NAMD Input: STMV with 1,066,628 Atoms OpenBenchmarking.org ns/day, More Is Better NAMD 3.0 Input: STMV with 1,066,628 Atoms Corsair Airflow Memory Cooling Without Extra Cooling 0.9504 1.9008 2.8512 3.8016 4.752 SE +/- 0.00252, N = 4 SE +/- 0.01539, N = 3 4.22396 2.78158
NAMD Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 45.0 47.3 49.0 Without Extra Cooling 87.0 88.5 90.0 OpenBenchmarking.org Celsius, Fewer Is Better NAMD 3.0 Memory Temperature Monitor 20 40 60 80 100
NWChem Input: C240 Buckyball OpenBenchmarking.org Seconds, Fewer Is Better NWChem 7.2.3 Input: C240 Buckyball Corsair Airflow Memory Cooling Without Extra Cooling 300 600 900 1200 1500 1354.7 1360.8 1. (F9X) gfortran options: -lnwctask -lccsd -lmcscf -lselci -lmp2 -lmoints -lstepper -ldriver -loptim -lnwdft -lgradients -lcphf -lesp -lddscf -ldangchang -lguess -lhessian -lvib -lnwcutil -lrimp2 -lproperty -lsolvation -lnwints -lprepar -lnwmd -lnwpw -lofpw -lpaw -lpspw -lband -lnwpwlib -lcafe -lspace -lanalyze -lqhop -lpfft -ldplot -ldrdy -lvscf -lqmmm -lqmd -letrans -ltce -lbq -lmm -lcons -lperfm -ldntmc -lccca -ldimqm -lfcidump -lgwmol -lga -larmci -lpeigs -l64to32 -llapack -lopenblas -lpthread -lrt -lcomex -lmpi_usempif08 -lmpi_mpifh -lmpi -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm -lz -ffast-math -std=legacy -fdefault-integer-8 -O0
NWChem Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 43.0 48.6 52.0 Without Extra Cooling 75.0 84.1 92.0 OpenBenchmarking.org Celsius, Fewer Is Better NWChem 7.2.3 Memory Temperature Monitor 20 40 60 80 100
OpenFOAM Input: drivaerFastback, Small Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Mesh Time Corsair Airflow Memory Cooling Without Extra Cooling 6 12 18 24 30 23.55 23.74 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Small Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time Without Extra Cooling Corsair Airflow Memory Cooling 6 12 18 24 30 23.32 23.88 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 45.0 45.5 47.0 Without Extra Cooling 83.0 83.5 85.0 OpenBenchmarking.org Celsius, Fewer Is Better OpenFOAM 10 Memory Temperature Monitor 20 40 60 80 100
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Mesh Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time Corsair Airflow Memory Cooling Without Extra Cooling 20 40 60 80 100 103.58 110.45 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Input: drivaerFastback, Medium Mesh Size - Execution Time OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time Corsair Airflow Memory Cooling Without Extra Cooling 70 140 210 280 350 196.38 313.87 1. (CXX) g++ options: -std=c++14 -m64 -O3 -ftemplate-depth-100 -fPIC -fuse-ld=bfd -Xlinker --add-needed --no-as-needed -lfiniteVolume -lmeshTools -lparallel -llagrangian -lregionModels -lgenericPatchFields -lOpenFOAM -ldl -lm
OpenFOAM Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 44.0 54.5 64.0 Without Extra Cooling 80.0 92.5 107.0 OpenBenchmarking.org Celsius, Fewer Is Better OpenFOAM 10 Memory Temperature Monitor 20 40 60 80 100
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU Corsair Airflow Memory Cooling Without Extra Cooling 15 30 45 60 75 SE +/- 0.32, N = 3 SE +/- 0.27, N = 3 66.07 58.01
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time To First Token Corsair Airflow Memory Cooling Without Extra Cooling 5 10 15 20 25 SE +/- 0.08, N = 3 SE +/- 0.14, N = 3 18.60 20.69
OpenVINO GenAI Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: TinyLlama-1.1B-Chat-v1.0 - Device: CPU - Time Per Output Token Corsair Airflow Memory Cooling Without Extra Cooling 4 8 12 16 20 SE +/- 0.07, N = 3 SE +/- 0.08, N = 3 15.14 17.24
OpenVINO GenAI Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 54.0 55.2 58.0 Without Extra Cooling 112.0 114.3 118.0 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO GenAI 2024.5 Memory Temperature Monitor 40 80 120 160 200
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU Corsair Airflow Memory Cooling Without Extra Cooling 13 26 39 52 65 SE +/- 0.09, N = 4 SE +/- 0.35, N = 4 55.68 47.52
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token Corsair Airflow Memory Cooling Without Extra Cooling 6 12 18 24 30 SE +/- 0.10, N = 4 SE +/- 0.15, N = 4 24.11 27.15
OpenVINO GenAI Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token Corsair Airflow Memory Cooling Without Extra Cooling 5 10 15 20 25 SE +/- 0.03, N = 4 SE +/- 0.16, N = 4 17.96 21.05
OpenVINO GenAI Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 50.0 50.6 52.0 Without Extra Cooling 104.0 106.9 110.0 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO GenAI 2024.5 Memory Temperature Monitor 20 40 60 80 100
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU Corsair Airflow Memory Cooling Without Extra Cooling 12 24 36 48 60 SE +/- 0.17, N = 3 SE +/- 0.06, N = 3 51.06 37.53
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token Corsair Airflow Memory Cooling Without Extra Cooling 8 16 24 32 40 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 29.21 32.91
OpenVINO GenAI Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token Corsair Airflow Memory Cooling Without Extra Cooling 6 12 18 24 30 SE +/- 0.07, N = 3 SE +/- 0.04, N = 3 19.59 26.65
OpenVINO GenAI Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 47.0 49.7 51.0 Without Extra Cooling 99.0 100.6 103.0 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO GenAI 2024.5 Memory Temperature Monitor 20 40 60 80 100
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU OpenBenchmarking.org tokens/s, More Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU Corsair Airflow Memory Cooling Without Extra Cooling 9 18 27 36 45 SE +/- 0.03, N = 3 SE +/- 0.14, N = 3 37.91 28.67
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token Corsair Airflow Memory Cooling Without Extra Cooling 10 20 30 40 50 SE +/- 0.03, N = 3 SE +/- 0.12, N = 3 36.10 42.15
OpenVINO GenAI Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token OpenBenchmarking.org ms, Fewer Is Better OpenVINO GenAI 2024.5 Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token Corsair Airflow Memory Cooling Without Extra Cooling 8 16 24 32 40 SE +/- 0.02, N = 3 SE +/- 0.17, N = 3 26.38 34.88
OpenVINO GenAI Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 48.0 50.2 52.0 Without Extra Cooling 95.0 95.9 97.0 OpenBenchmarking.org Celsius, Fewer Is Better OpenVINO GenAI 2024.5 Memory Temperature Monitor 20 40 60 80 100
Renaissance Test: Apache Spark Bayes OpenBenchmarking.org ms, Fewer Is Better Renaissance 0.16 Test: Apache Spark Bayes Corsair Airflow Memory Cooling Without Extra Cooling 50 100 150 200 250 SE +/- 0.13, N = 3 SE +/- 1.44, N = 3 185.4 205.5 MIN: 160 / MAX: 259.09 MIN: 185.67 / MAX: 247.59
Renaissance Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 42.0 45.4 47.0 Without Extra Cooling 79.0 81.1 83.0 OpenBenchmarking.org Celsius, Fewer Is Better Renaissance 0.16 Memory Temperature Monitor 20 40 60 80 100
SVT-AV1 Encoder Mode: Preset 13 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.3 Encoder Mode: Preset 13 - Input: Bosphorus 4K Corsair Airflow Memory Cooling Without Extra Cooling 90 180 270 360 450 SE +/- 10.67, N = 15 SE +/- 10.38, N = 15 425.02 422.00 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 46.0 47.2 48.0 Without Extra Cooling 85.0 86.1 88.0 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 2.3 Memory Temperature Monitor 20 40 60 80 100
SVT-AV1 Encoder Mode: Preset 13 - Input: Beauty 4K 10-bit OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.3 Encoder Mode: Preset 13 - Input: Beauty 4K 10-bit Without Extra Cooling Corsair Airflow Memory Cooling 4 8 12 16 20 SE +/- 0.00, N = 3 SE +/- 0.01, N = 3 17.15 17.11 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 41.0 42.2 45.0 Without Extra Cooling 69.0 75.7 83.0 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 2.3 Memory Temperature Monitor 20 40 60 80 100
SVT-AV1 Encoder Mode: Preset 3 - Input: Bosphorus 4K OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.3 Encoder Mode: Preset 3 - Input: Bosphorus 4K Without Extra Cooling Corsair Airflow Memory Cooling 4 8 12 16 20 SE +/- 0.06, N = 3 SE +/- 0.07, N = 3 15.69 15.59 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 39.0 43.1 45.0 Without Extra Cooling 67.0 67.9 69.0 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 2.3 Memory Temperature Monitor 20 40 60 80 100
SVT-AV1 Encoder Mode: Preset 3 - Input: Beauty 4K 10-bit OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 2.3 Encoder Mode: Preset 3 - Input: Beauty 4K 10-bit Without Extra Cooling Corsair Airflow Memory Cooling 0.4149 0.8298 1.2447 1.6596 2.0745 SE +/- 0.008, N = 3 SE +/- 0.004, N = 3 1.844 1.842 1. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq
SVT-AV1 Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 42.0 42.4 43.0 Without Extra Cooling 63.0 64.2 68.0 OpenBenchmarking.org Celsius, Fewer Is Better SVT-AV1 2.3 Memory Temperature Monitor 20 40 60 80 100
Timed Linux Kernel Compilation Build: defconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: defconfig Without Extra Cooling Corsair Airflow Memory Cooling 5 10 15 20 25 SE +/- 0.23, N = 3 SE +/- 0.22, N = 3 22.31 22.39
Timed Linux Kernel Compilation Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 41.0 42.0 43.0 Without Extra Cooling 62.0 63.8 65.0 OpenBenchmarking.org Celsius, Fewer Is Better Timed Linux Kernel Compilation 6.8 Memory Temperature Monitor 20 40 60 80 100
Timed Linux Kernel Compilation Build: allmodconfig OpenBenchmarking.org Seconds, Fewer Is Better Timed Linux Kernel Compilation 6.8 Build: allmodconfig Without Extra Cooling Corsair Airflow Memory Cooling 40 80 120 160 200 SE +/- 0.38, N = 3 SE +/- 0.35, N = 3 195.49 195.57
Timed Linux Kernel Compilation Memory Temperature Monitor Min Avg Max Corsair Airflow Memory Cooling 41.0 48.9 52.0 Without Extra Cooling 63.0 79.8 91.0 OpenBenchmarking.org Celsius, Fewer Is Better Timed Linux Kernel Compilation 6.8 Memory Temperature Monitor 20 40 60 80 100
Phoronix Test Suite v10.8.5