eoy2024

Benchmarks for a future article. AMD EPYC 4124P 4-Core testing with a Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2412200-NE-EOY20240400&sor.

eoy2024ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolutiona4484PXpx4464p4464p epyc4364P4584PXEPYC 4584PX amd454141 bAMD EPYC 4564P 16-Core @ 5.88GHz (16 Cores / 32 Threads)Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS)AMD Device 14d82 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07ASPEEDAMD Rembrandt Radeon HD AudioVA24312 x Intel I210Ubuntu 24.046.8.0-11-generic (x86_64)GNOME Shell 45.3X Server 1.21.1.11GCC 13.2.0ext41024x768AMD EPYC 4484PX 12-Core @ 5.66GHz (12 Cores / 24 Threads)6.12.2-061202-generic (x86_64)AMD EPYC 4464P 12-Core @ 5.48GHz (12 Cores / 24 Threads)AMD EPYC 4364P 8-Core @ 5.57GHz (8 Cores / 16 Threads)AMD EPYC 4584PX 16-Core @ 5.76GHz (16 Cores / 32 Threads)AMD EPYC 4124P 4-Core @ 5.17GHz (4 Cores / 8 Threads)960GB SAMSUNG MZ1L2960HCJR-00A07 + 3201GB Micron_7450_MTFDKCC3T2TFSOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-fxIygj/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-fxIygj/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- a: Scaling Governor: amd-pstate-epp performance (EPP: performance) - CPU Microcode: 0xa601209- 4484PX: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- px: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 4464p: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 4464p epyc: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 4364P: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 4584PX: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- EPYC 4584PX amd: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 45: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 41: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 41 b: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209Java Details- OpenJDK Runtime Environment (build 21.0.2+13-Ubuntu-2)Python Details- Python 3.12.3Security Details- a: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4484PX: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- px: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4464p: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4464p epyc: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4364P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4584PX: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 4584PX amd: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 45: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 41: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 41 b: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

eoy2024etcpak: Multi-Threaded - ETC2cp2k: H20-64cp2k: H20-256cp2k: Fayalite-FISTnamd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomsquantlib: Squantlib: XXSrelion: Basic - CPUsimdjson: Kostyasimdjson: TopTweetsimdjson: LargeRandsimdjson: PartialTweetssimdjson: DistinctUserIDrenaissance: Scala Dottyrenaissance: Rand Forestrenaissance: ALS Movie Lensrenaissance: Apache Spark Bayesrenaissance: Savina Reactors.IOrenaissance: Apache Spark PageRankrenaissance: Finagle HTTP Requestsrenaissance: Gaussian Mixture Modelrenaissance: In-Memory Database Shootoutrenaissance: Akka Unbalanced Cobwebbed Treerenaissance: Genetic Algorithm Using Jenetics + Futuresbyte: Pipebyte: Dhrystone 2byte: System Callbyte: Whetstone Doublesvt-av1: Preset 3 - Bosphorus 4Ksvt-av1: Preset 5 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 3 - Bosphorus 1080psvt-av1: Preset 5 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080psvt-av1: Preset 3 - Beauty 4K 10-bitsvt-av1: Preset 5 - Beauty 4K 10-bitsvt-av1: Preset 8 - Beauty 4K 10-bitsvt-av1: Preset 13 - Beauty 4K 10-bitx265: Bosphorus 4Kx265: Bosphorus 1080pmt-dgemm: Sustained Floating-Point Rateospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timecompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingstockfish: Chess Benchmarkstockfish: Chess Benchmarkbuild2: Time To Compileprimesieve: 1e12primesieve: 1e13y-cruncher: 1By-cruncher: 500Mpovray: Trace Timeonednn: IP Shapes 1D - CPUonednn: IP Shapes 3D - CPUonednn: Convolution Batch Shapes Auto - CPUonednn: Deconvolution Batch shapes_1d - CPUonednn: Deconvolution Batch shapes_3d - CPUonednn: Recurrent Neural Network Training - CPUonednn: Recurrent Neural Network Inference - CPUnumpy: build-eigen: Time To Compilegcrypt: rustls: handshake - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-resume - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake-ticket - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384rustls: handshake-resume - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-ticket - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-resume - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384rustls: handshake-ticket - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384openssl: ChaCha20openssl: AES-128-GCMopenssl: AES-256-GCMopenssl: ChaCha20-Poly1305couchdb: 100 - 1000 - 30couchdb: 100 - 3000 - 30couchdb: 300 - 1000 - 30couchdb: 300 - 3000 - 30couchdb: 500 - 1000 - 30couchdb: 500 - 3000 - 30financebench: Repo OpenMPfinancebench: Bonds OpenMPastcenc: Fastastcenc: Mediumastcenc: Thoroughastcenc: Exhaustiveastcenc: Very Thoroughgromacs: water_GMX50_barelitert: DeepLab V3litert: SqueezeNetlitert: Inception V4litert: NASNet Mobilelitert: Mobilenet Floatlitert: Mobilenet Quantlitert: Inception ResNet V2litert: Quantized COCO SSD MobileNet v1xnnpack: FP32MobileNetV1xnnpack: FP32MobileNetV2xnnpack: FP32MobileNetV3Largexnnpack: FP32MobileNetV3Smallxnnpack: FP16MobileNetV1xnnpack: FP16MobileNetV2xnnpack: FP16MobileNetV3Largexnnpack: FP16MobileNetV3Smallxnnpack: QS8MobileNetV2blender: BMW27 - CPU-Onlyblender: Junkshop - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlycassandra: Writespyperformance: gopyperformance: chaospyperformance: floatpyperformance: nbodypyperformance: pathlibpyperformance: raytracepyperformance: xml_etreepyperformance: gc_collectpyperformance: json_loadspyperformance: crypto_pyaespyperformance: async_tree_iopyperformance: regex_compilepyperformance: python_startuppyperformance: asyncio_tcp_sslpyperformance: django_templatepyperformance: asyncio_websocketspyperformance: pickle_pure_pythononnx: GPT-2 - CPU - Standardonnx: GPT-2 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: ZFNet-512 - CPU - Standardonnx: ZFNet-512 - CPU - Standardonnx: T5 Encoder - CPU - Standardonnx: T5 Encoder - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: ResNet101_DUC_HDC-12 - CPU - Standardonnx: ResNet101_DUC_HDC-12 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardwhisper-cpp: ggml-base.en - 2016 State of the Unionwhisper-cpp: ggml-small.en - 2016 State of the Unionwhisper-cpp: ggml-medium.en - 2016 State of the Unionwhisperfile: Tinywhisperfile: Smallwhisperfile: Mediumllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048llamafile: Llama-3.2-3B-Instruct.Q6_K - Text Generation 16llamafile: Llama-3.2-3B-Instruct.Q6_K - Text Generation 128llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 256llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 512llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 16llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 1024llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 2048llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 128llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 16llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 256llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 512llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 128llamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 16llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 1024llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 2048llamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 128llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 256llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 512llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 1024llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 2048llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 256llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 512llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 1024llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 2048openvino-genai: Gemma-7b-int4-ov - CPUopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPUopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Tokena4484PXpx4464p4464p epyc4364P4584PXEPYC 4584PX amd454141 b577.81758.191592.85794.0322.796320.7565612.747613.432944.275.9710.461.839.7610.46477.0414.49805.7490.03506.42412.22319.43399.53256.14403.8732.848806257.11866536062.749140426.6343491.99.5934.538102.005212.5229.573101.971339.023842.5581.4226.50412.46818.58832.57114.451141.1941049.009178.98486236.2457.639447.587898.82093163859165916547527964650703892.0536.34778.49818.4858.77218.5421.125734.0586.672872.976122.412941372.03700.859775.7558.655162.12576454.4580462.6388077.69404263.45423535.683563852.5726203321820810.211553632.14130588495050104784522170971727517009239352934069.929232.188106.13367.83148.049511.77521418.44531233061.21875396.6495156.221720.30251.68442.7411.6923579.671794.1121477.8169361211.48823.1719530.22129.5212521495181097911431190149892084453.5573.56143.3671.35506.2166.1227133377.838.250.75914.217535.867712.141.775569.85.7764520.7315165134.5967.4277611.055290.4523102.3319.76985156.4536.3911215.589964.141636.3181.570843.2167310.87542.453723.553390.5972.55898141.1177.086011.54196648.52247.069121.242987.48973245.07838700.9141.70935195.41642534.9196.8870.7670.8563.097.2468.469.2662.9747.72327.3355.09279.0419.0320.134096819224.59163843276826.2810.224096819210.471.7816384327681.99409681921638432768153630726144122889.83106.62101.7212.9386.0677.3419.2855.9351.86410.72653.005628.10492.212.381240.6511911.864712.1169729.46.1110.821.8410.110.76428.6422.09378.8513.23655.82138.12492.23860.63241.54038.4904.033443359.21346521770.330761218.9244075.37.68429.09485.201198.11225.44688.415287.047776.1151.1885.60210.96717.40627.16101.37842.7306426.527766.44913199.0235.631225.548886.411981412631256984526754633702298111.6519.116110.60818.3798.68825.2641.938062.730724.115513.402933.50841898.36965.015745.5967.364171.02357716.6459308.75333882.92344296.24306153.23035330.212282729.641586292.421329363.19710523569076496336760711602918706881654402075.901253.99117.566406.12164.468559.34622320.33203134600.773438278.2445109.026514.171.18871.94121.5772343.381809.1822083.38057.561244.7848.94319477.81420.1512571365151580913831217146777971774.0897.01197.296.67679.34226.3417496078.639.751.359.514.418236.869912.443.166671.76.0859021321169159.716.2581510.733893.1605110.949.01322208.1744.8028714.512268.9051941.4011.061882.81093355.75137.383226.7478356.4092.80544125.1727.988731.17627850.14140.093524.940292.70933268.23891809.7896937.13462173.38197473.550917.1169.1166.5763.87.4168.266.8563.6152.3243.14232.26222.7519.4920.394096819225.86163843276827.5910.454096819210.911.8316384327682.054096819216384327681536307261441228810.23121.4897.7913.493.0174.6520.2858.9149.31409.87552.724631.3194.8962.353790.6544811.83912.1057733.025.4510.511.848.358.97436.2453.29275.7474.93676.02229.72483.13815.23175.64002.3920.733381363.11340340196.630701622.82441317.64628.82484.998194.02425.44788.27286.962769.8181.1845.55110.85517.35526.94101.25842.0128316.522066.52304197.25.710845.61476.40741422131256054297339633871595113.789.147110.70918.3658.62325.3281.939132.729424.133213.406283.512431895.68966.013831.4267.076163.83957688.0859206.34333574.3342775.29304060.283038723.482292879.441572010.681340712.859701989745076184405610709026564806867895555076.389254.733119.349408.483164.812560.722318.73828134896.835938277.2994108.858814.14641.18621.93911.5752359.991821.3522752.47931.641244.51849.20919490.71417.3512721368157483713861248152779872373.1697.1197.5397.09678.4224.6417394679.439.450.859.214.418236.570612.543.365672.56.0959021.2322168157.8936.3303410.712793.3441110.8929.01687206.0914.8514214.574768.6104937.7781.0662.79638357.60237.104826.9485356.1942.80695125.0767.994861.1705854.33443.36223.060493.45463266.81425809.48938.71828167.89219475.510847.1267.9566.3563.797.4468.8166.5263.4152.37232.86244.77208.9919.520.514096819225.94163843276827.810.454096819210.931.8416384327682.054096819216384327681536307261441228810.24122.397.6113.419374.5420.2958.8649.28388.40458.397676.742100.4862.216450.6145210.287310.5788937.335.7810.661.819.810.54424.6415.39243.0515.33523.12366.12650.93647.23288.54084.6924.532471450.7127293878829969810.92426797.25227.3682.525192.17124.85486.96282.008752.1551.1295.44510.91418.00226.09101.23818.6781416.288076.29615199.5125.470435.357566.173991350331185694315885330315972121.7379.701118.66419.3649.04126.6091.887313.750036.364753.432873.389581911.441009.58781.6669.379156.34356047.3857954.19328877.92336267.09301017.233061522.262283083.541543373.121297646.729395674371072709954220674315359606654874747076.696259.196118.161401.989164.358551.34621588.9062533551.523438263.5475103.808913.5231.13651.85461.3982272.281820.3423141.47759.691248.12859.75720123.51431.1912671357147379914181208142975970379.19104.7212.3105.45739.91243.3517363378.33949.757.214.117735.36711241.873869.55.862620.6315164136.2997.3333110.498295.2507101.4139.85896168.0365.9503514.688568.0775724.5331.37972.58688386.56336.120527.6828360.3542.77422134.9417.410371.14581872.74246.354321.570897.94408280.03419838.1842540.847178.32917491.984127.0964.9663.7160.687.4265.2464.1560.4750.5235.94235.01213.0219.4720.484096819225.77163843276827.3610.484096819210.931.8316384327682.054096819216384327681536307261441228810.17124.3898.3313.349374.9419.8259.8750.45388.12858.864678.67697.4462.207280.6109310.253110.5616946.436.0210.691.739.6310.28442.9412.98980.8513.33688.62373.02708.13703.23275.54098.5884.032439611.61263644317.829923094.4242340.57.23227.56482.164190.34324.80586.386281.892748.1471.1325.42210.88517.94425.85101.33812.1470896.292116.27188199.5465.470575.361896.176241338041185874204295129940074117.0679.705118.84819.2789.06726.5951.889193.745786.37153.425473.388231913.861012.19783.4369.578156.71256176.958056.01326342.42335411.96301217.613082657.52304145.791532788.041300937.39390757287072667527300673962543806649773943076.577259.055116.417405.448163.363551.621612.04296933538.269531263.3662103.674413.51391.13681.85591.3932289.581822.722928.37640.811248.6857.48920503.51415.1112461327154279114141210142776670379.24104.01211.4105.24731.39245.121740257638.649.758.614.117635.66711242742705.8162820.6316164135.7187.3654410.486595.3576101.6189.83893166.5126.004714.68568.0934748.661.335162.59025386.06136.396827.4729361.2972.76714134.5177.433721.15632864.8146.092121.693397.54562280.47206839.9857538.57843177.87492.695197.164.4363.560.87.4464.6862.8460.350.43242.1227.71212.319.5320.54096819225.78163843276827.3510.454096819210.911.8316384327682.064096819216384327681536307261441228810.2124.5298.0313.3294.7775.0619.8259.8650.46304.24468.171740.089108.4361.740380.497718.026968.191531369.2256.0610.861.8110.0410.85464.5381.65993.4483.43349.52506.81705.53397.03244.83720.1749.923448988.5966576789.421559197174760.65.37319.8565.194156.59818.74465.318215.213652.9650.8723.8026.4589.18818.8588.71629.165124.639654.62423177.1183.917493.831524.52318101872882293151493724017024154.42912.273150.66823.88610.95434.9171.906864.450967.873673.786293.780082422.831270.76813.3184.477154.31743571.8645095.35272035.68265949.2225379.662874011.562353677.961298373.661187839.346804832966053755663700499309456004827810993073.237239.078118.317398.386163.915545.96721121.61328132715.808594205.014480.368610.33920.86121.40521.1041569.751654.6524502.13808.81044.53935.99421153.51494.511056708753335157810881067455400103.97141.99276.44136.51978.03320.5913911075.338.348.256.813.517434.764911.840.772668.16.3461020.1308162125.527.9606913.237275.541497.226810.2835141.5687.0607519.812750.4698762.2481.311212.05211487.30139.082825.5845376.5312.65482157.0786.365640.9163171091.3244.800222.3192103.71549314.47722966.0063841.29562193.93664528.332626.6460.8759.2755.957.0261.0959.5456.0551.86204.06185.97171.6818.8319.64096819224.27163843276825.529.924096819210.321.7616384327681.93409681921638432768153630726144122889.52154.83105.0912.59115.7379.411971.5852.64556.04343.167517.66484.8022.839130.7598714.017114.624551.7226.0711.251.829.8511.05441.9420.79891.4477.03582.42182.52627.33806.53232.84384.01050.344169926.71765175324.640531084329601.49.32934.164101.332217.90829.06798.789320.184842.3441.4266.32712.08617.84532.59113.371091.0115098.515738.49097218.1817.38767.323538.43752170361164581572477634444645891.7246.92684.48917.3438.17319.551.124652.746994.038083.072192.672191320.99672.506806.8358.818150.63972793.2674468.49379874.32393408.85435194.23397871.032528614.521863395.071559859.89127793294810100450008810931680875909071144714075.893252.825116.241397.426163.805553.80521948.93554734053.0625368.5451144.478218.70751.56972.56341.8172185.781769.5620102.89311.771165.5734.352182241337.7811941484176093312001224152787780955.2673.87149.3773.96514.7171.8223589378.439.251.15914.117636.168212.542.765371.46.0158220.8315166166.0476.0206911.355188.0632112.6718.87444203.9474.9028515.010666.61721005.50.9941933.38658295.28143.843622.8062383.1342.60974122.1688.185191.53619650.9648.263620.718384.68398233.68441686.8794435.91499155.13923425.50969792.8990.0186.177.3293.2491.1286.5649.9316.8290.1289.4119.2720.234096819225.32163843276827.210.34096819210.811.8216384327682.034096819216384327681536307261441228810.11105.3698.9113.3286.0475.0619.6756.0650.84556.41242.51517.91884.2112.854850.7564514.047214.6973553.7826.049.191.839.9811.14411.9402.29969.8515.63641.92227.92571.23773.13442.94344.8959.3443239201771958344.740718581.63312029.434.414101.537218.52929.20599.445327.264845.5841.4336.39111.89717.86332.22113.161093.0978678.571468.51233220.7997.445757.322848.47727169750165934586766364572479492.0216.90384.26317.5678.27920.3251.128012.777274.048773.063412.664291320.37670.234754.4158.692159.24772508.1374683.74382691.63394570436101.343431395.732558621.381874050.71569308.65128265416980100666591640935559913509092741803076.669253.493116.617400.399161.089554.39721848.07031233913.464844368.5734144.626218.74991.57432.56941.8082200.931765.3919859.49231.971175.5742.02918412.31339.6911921477175693111961222154287180755.7473.55148.9773.86513.66171.2523822779.639.15158.814.117636.268612.242.765169.86.0158621317165165.7696.0302411.316688.3622113.2948.82581203.4914.9138114.942766.9202999.9730.9997013.39064294.92744.05122.6984382.7712.61221122.2058.182651.54365647.81447.88520.881684.02813233.05316684.3866235.4262155.9745424.94666793.9191.3186.477.3793.4990.4886.4449.76326.16324.04289.0419.2420.264096819225.3163843276827.1910.374096819210.851.8316384327682.034096819216384327681536307261441228810.14104.3898.6413.2486.275.5119.7355.4750.68556.86542.469517.50284.0722.837980.7622714.043114.6226549.85.549.41.8310.329.15455.6407.79972.0500.03589.42179.02570.53829.93408.44359.3891.244309550.91766450267.140711986.9331193.79.34534.66101.522217.95729.17998.905325.945835.451.4276.32212.11217.83632.23113.311092.0884958.548788.54395220.7287.463997.315948.49646169373166180557627024879707991.0176.93784.31517.3648.11919.5211.130122.778354.03553.059182.662961320.23670.7833.6457.18167.63172140.7574672.57382067.3395112.39435926.43379343.722559245.218629381569479.7128278766110100742301290936145941809102509288076.662253.279116.222399.261161.473552.20922060.15234433906.6875369.0274144.613118.76611.57672.56961.8112152.481763.22196869245.761178.94730.16717824.61343.2211891478175492911951223154789880155.1873.69149.3773.48513.54170.0923682678.138.850.759.614.217936.168912.342.463370.46.0358120.9314163166.1686.0163111.310588.4104113.1718.83524203.9344.9031314.883767.18491013.190.9866433.40178293.96143.488622.9923380.8012.62573122.2198.181751.54988645.20847.672120.975384.11276232.58353684.1305635.11036154.43658424.57459791.7190.9686.687.3794.0891.1786.9150.33337.06291.02273.6719.1620.294096819225.38163843276827.2110.344096819210.821.8616384327682.034096819216384327681536307261441228810.17104.8798.3113.3687.3474.8619.7155.6750.74155.441123.6561281.082177.1440.888950.273524.430214.476432771.7785.710.021.79.329.92506.5439.97465.1566.23745.82267.11664.43087.02951.14474.8806.411669425.7478992410.71070771584017.42.80810.86935.84985.94810.57837.171123.792380.6330.4432.1784.3348.00710.9156.61259.1464912.302232.29544112.721.844071.908042.2385154079437811263026412024682300.7224.723301.59640.56218.16570.0643.831174.946899.186587.267387.536554726.082415.25705.99145.21165.54721499.7322255.23135362.96132265.65106833.782105346.651656876.39732992.32596141.193328083586025376123290238456531602370109276096.744314.485153.029515.495212.829695.35232271.66601647198.941406100.365939.32055.06550.42440.69230.6642950.83173.5549048.85153.492193.881781.6418442736.98236714251342412351221312018714623215.53292.14560.89280.262077.69667.716624378.439.952.860.414.618236.770212.44385572.66.9372321.2330171124.1668.048357.16015139.65973.884513.5323141.9557.0412210.518695.0664495.8362.016091.07903926.75623.841241.9418207.6054.815373.270713.64570.4647232151.8236.10727.6891187.28645581.27325154.248130.8131282.66179.1220.892410.273204.430914.464113046.8055.689.971.719.310.16515.8485.47147.4600.13818.52292.21669.93130.43681.94457.1801.411518844.2475486444.110629944.883540.72.79310.80535.64185.60310.55437.07122.921377.7910.4412.1724.3327.98410.8956.03263.2043922.266122.27718111.4831.904811.894692.2231853425432101494373711607502294.95124.821302.73739.24518.2970.7743.828854.958679.169567.281397.553154752.852441.27700.76146.655169.14121444.0922201.03135016.23132025.36105324.922103587.51571309.62690282.02602002.023328954286025582374640237605350102370113836096.554316.459154.041513.583212.528698.07432477.34960946851.42187599.399939.03775.04480.42230.69060.6612994.593179.5549101.95034.382190.791785.441757.92741.68240714431359414350820971998720623214.89294.04563.14282.192095.98671.426651978.740.252.96014.618036.670412.443.185872.76.9773721.3331171123.2698.107677.15712139.71873.004713.6955140.0347.1385710.624194.1216495.0782.019131.07829927.38823.910841.8199202.1184.9463673.836413.54170.4644852152.9238.529425.9499186.22906583.20451797.862566.11323310.38181845.176.5532.9731.9130.936.932.9432.5931.0451.5122.8115.67105.119.1720.084096819223.8163843276825.099.994096819210.461.7316384327681.93409681921638432768153630726144122888.05288.64124.2411.38217.8587.916.65130.4760.07OpenBenchmarking.org

Etcpak

Benchmark: Multi-Threaded - Configuration: ETC2

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 2.0Benchmark: Multi-Threaded - Configuration: ETC2a45EPYC 4584PX amd4584PX4484PXpx4464p4464p epyc4364P4141 b120240360480600577.82556.87556.41556.04410.73409.88388.40388.13304.24155.44154.251. (CXX) g++ options: -flto -pthread

CP2K Molecular Dynamics

Input: H20-64

OpenBenchmarking.orgSeconds, Fewer Is BetterCP2K Molecular Dynamics 2024.3Input: H20-6445EPYC 4584PX amd4584PXpx4484PXa4464p4464p epyc4364P4141 b30609012015042.4742.5143.1752.7253.0158.1958.4058.8668.17123.66130.811. (F9X) gfortran options: -fopenmp -march=native -mtune=native -O3 -funroll-loops -fbacktrace -ffree-form -fimplicit-none -std=f2008 -lcp2kstart -lcp2kmc -lcp2kswarm -lcp2kmotion -lcp2kthermostat -lcp2kemd -lcp2ktmc -lcp2kmain -lcp2kdbt -lcp2ktas -lcp2kgrid -lcp2kgriddgemm -lcp2kgridcpu -lcp2kgridref -lcp2kgridcommon -ldbcsrarnoldi -ldbcsrx -lcp2kdbx -lcp2kdbm -lcp2kshg_int -lcp2keri_mme -lcp2kminimax -lcp2khfxbase -lcp2ksubsys -lcp2kxc -lcp2kao -lcp2kpw_env -lcp2kinput -lcp2kpw -lcp2kgpu -lcp2kfft -lcp2kfpga -lcp2kfm -lcp2kcommon -lcp2koffload -lcp2kmpiwrap -lcp2kbase -ldbcsr -lsirius -lspla -lspfft -lsymspg -lvdwxc -l:libhdf5_fortran.a -l:libhdf5.a -lz -lgsl -lelpa_openmp -lcosma -lcosta -lscalapack -lxsmmf -lxsmm -ldl -lpthread -llibgrpp -lxcf03 -lxc -lint2 -lfftw3_mpi -lfftw3 -lfftw3_omp -lmpi_cxx -lmpi -l:libopenblas.a -lvori -lstdc++ -lmpi_usempif08 -lmpi_mpifh -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm

CP2K Molecular Dynamics

Input: H20-256

OpenBenchmarking.orgSeconds, Fewer Is BetterCP2K Molecular Dynamics 2024.3Input: H20-256454584PXEPYC 4584PX amda4484PXpx4464p4464p epyc4364P4141 b30060090012001500517.50517.66517.92592.86628.10631.31676.74678.68740.091281.081282.661. (F9X) gfortran options: -fopenmp -march=native -mtune=native -O3 -funroll-loops -fbacktrace -ffree-form -fimplicit-none -std=f2008 -lcp2kstart -lcp2kmc -lcp2kswarm -lcp2kmotion -lcp2kthermostat -lcp2kemd -lcp2ktmc -lcp2kmain -lcp2kdbt -lcp2ktas -lcp2kgrid -lcp2kgriddgemm -lcp2kgridcpu -lcp2kgridref -lcp2kgridcommon -ldbcsrarnoldi -ldbcsrx -lcp2kdbx -lcp2kdbm -lcp2kshg_int -lcp2keri_mme -lcp2kminimax -lcp2khfxbase -lcp2ksubsys -lcp2kxc -lcp2kao -lcp2kpw_env -lcp2kinput -lcp2kpw -lcp2kgpu -lcp2kfft -lcp2kfpga -lcp2kfm -lcp2kcommon -lcp2koffload -lcp2kmpiwrap -lcp2kbase -ldbcsr -lsirius -lspla -lspfft -lsymspg -lvdwxc -l:libhdf5_fortran.a -l:libhdf5.a -lz -lgsl -lelpa_openmp -lcosma -lcosta -lscalapack -lxsmmf -lxsmm -ldl -lpthread -llibgrpp -lxcf03 -lxc -lint2 -lfftw3_mpi -lfftw3 -lfftw3_omp -lmpi_cxx -lmpi -l:libopenblas.a -lvori -lstdc++ -lmpi_usempif08 -lmpi_mpifh -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm

CP2K Molecular Dynamics

Input: Fayalite-FIST

OpenBenchmarking.orgSeconds, Fewer Is BetterCP2K Molecular Dynamics 2024.3Input: Fayalite-FIST45EPYC 4584PX amd4584PX4484PXapx4464p epyc4464p4364P4141 b408012016020084.0784.2184.8092.2194.0394.9097.45100.49108.44177.14179.121. (F9X) gfortran options: -fopenmp -march=native -mtune=native -O3 -funroll-loops -fbacktrace -ffree-form -fimplicit-none -std=f2008 -lcp2kstart -lcp2kmc -lcp2kswarm -lcp2kmotion -lcp2kthermostat -lcp2kemd -lcp2ktmc -lcp2kmain -lcp2kdbt -lcp2ktas -lcp2kgrid -lcp2kgriddgemm -lcp2kgridcpu -lcp2kgridref -lcp2kgridcommon -ldbcsrarnoldi -ldbcsrx -lcp2kdbx -lcp2kdbm -lcp2kshg_int -lcp2keri_mme -lcp2kminimax -lcp2khfxbase -lcp2ksubsys -lcp2kxc -lcp2kao -lcp2kpw_env -lcp2kinput -lcp2kpw -lcp2kgpu -lcp2kfft -lcp2kfpga -lcp2kfm -lcp2kcommon -lcp2koffload -lcp2kmpiwrap -lcp2kbase -ldbcsr -lsirius -lspla -lspfft -lsymspg -lvdwxc -l:libhdf5_fortran.a -l:libhdf5.a -lz -lgsl -lelpa_openmp -lcosma -lcosta -lscalapack -lxsmmf -lxsmm -ldl -lpthread -llibgrpp -lxcf03 -lxc -lint2 -lfftw3_mpi -lfftw3 -lfftw3_omp -lmpi_cxx -lmpi -l:libopenblas.a -lvori -lstdc++ -lmpi_usempif08 -lmpi_mpifh -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm

NAMD

Input: ATPase with 327,506 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0Input: ATPase with 327,506 AtomsEPYC 4584PX amd4584PX45a4484PXpx4464p4464p epyc4364P41 b410.64231.28461.92692.56923.21152.854852.839132.837982.796322.381242.353792.216452.207281.740380.892410.88895

NAMD

Input: STMV with 1,066,628 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0Input: STMV with 1,066,628 Atoms454584PXaEPYC 4584PX amdpx4484PX4464p4464p epyc4364P4141 b0.17150.3430.51450.6860.85750.762270.759870.756560.756450.654480.651190.614520.610930.497710.273520.27320

QuantLib

Size: S

OpenBenchmarking.orgtasks/s, More Is BetterQuantLib 1.35-devSize: SEPYC 4584PX amd454584PXa4484PXpx4464p4464p epyc4364P41 b414812162014.0472014.0431014.0171012.7476011.8647011.8390010.2873010.253108.026964.430914.430211. (CXX) g++ options: -O3 -march=native -fPIE -pie

QuantLib

Size: XXS

OpenBenchmarking.orgtasks/s, More Is BetterQuantLib 1.35-devSize: XXSEPYC 4584PX amd4584PX45a4484PXpx4464p4464p epyc4364P4141 b4812162014.6973014.6240014.6226013.4320012.1169012.1057010.5788010.561608.191534.476434.464111. (CXX) g++ options: -O3 -march=native -fPIE -pie

RELION

Test: Basic - Device: CPU

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 5.0Test: Basic - Device: CPU454584PXEPYC 4584PX amd4484PXpx4464pa4464p epyc4364P4141 b7001400210028003500549.80551.72553.78729.40733.02937.33944.27946.431369.232771.783046.811. (CXX) g++ options: -fPIC -std=c++14 -fopenmp -O3 -rdynamic -lfftw3f -lfftw3 -ldl -ltiff -lpng -ljpeg -lmpi_cxx -lmpi

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: Kostya4484PX4584PX4364PEPYC 4584PX amd4464p epyca4464p4141 b45px2468106.116.076.066.046.025.975.785.705.685.545.451. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: TopTweet4584PX4364P4484PX4464p epyc4464ppxa4141 b45EPYC 4584PX amd369121511.2510.8610.8210.6910.6610.5110.4610.029.979.409.191. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: LargeRandompx4484PX45EPYC 4584PX amda4584PX4364P4464p4464p epyc41 b410.4140.8281.2421.6562.071.841.841.831.831.831.821.811.811.731.711.701. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: PartialTweets454484PX4364PEPYC 4584PX amd4584PX4464pa4464p epyc4141 bpx369121510.3210.1010.049.989.859.809.769.639.329.308.351. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: DistinctUserIDEPYC 4584PX amd4584PX4364P4484PX4464pa4464p epyc41 b4145px369121511.1411.0510.8510.7610.5410.4610.2810.169.929.158.971. (CXX) g++ options: -O3 -lrt

Renaissance

Test: Scala Dotty

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Scala DottyEPYC 4584PX amd4464p4484PXpx4584PX4464p epyc454364Pa4141 b110220330440550411.9424.6428.6436.2441.9442.9455.6464.5477.0506.5515.8MIN: 362.36 / MAX: 713.71MIN: 376.26 / MAX: 659.55MIN: 378.22 / MAX: 628.77MIN: 380.62 / MAX: 721.56MIN: 387.7 / MAX: 646.01MIN: 376.04 / MAX: 787.17MIN: 394.05 / MAX: 695.67MIN: 358.07 / MAX: 790.35MIN: 371.54 / MAX: 736.5MIN: 420.76 / MAX: 1038.72MIN: 426.08 / MAX: 1026.55

Renaissance

Test: Random Forest

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Random Forest4364PEPYC 4584PX amd454464p epyca4464p4584PX4484PX41px41 b110220330440550381.6402.2407.7412.9414.4415.3420.7422.0439.9453.2485.4MIN: 332.96 / MAX: 445.77MIN: 343.06 / MAX: 486.63MIN: 337.66 / MAX: 471.92MIN: 342.95 / MAX: 473.15MIN: 322.79 / MAX: 466.1MIN: 342.21 / MAX: 486.26MIN: 339.2 / MAX: 478.26MIN: 357.91 / MAX: 497.55MIN: 388.86 / MAX: 516.9MIN: 352.31 / MAX: 513.31MIN: 403.24 / MAX: 525.59

Renaissance

Test: ALS Movie Lens

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: ALS Movie Lens4364P41 b414464p epyc4464ppx4484PXa4584PXEPYC 4584PX amd452K4K6K8K10K5993.47147.47465.18980.89243.09275.79378.89805.79891.49969.89972.0MIN: 5836.57 / MAX: 6535.35MIN: 6653.82 / MAX: 7863.42MIN: 6716.72 / MAX: 7815.35MIN: 8480.95 / MAX: 9113.57MIN: 8920.42 / MAX: 9406.46MIN: 8821.09 / MAX: 9495.91MIN: 8718.36 / MAX: 9413.7MIN: 9253.4 / MAX: 10057.61MIN: 9364.27 / MAX: 10037.94MIN: 9680.91 / MAX: 9983.16MIN: 9479.38 / MAX: 10040.33

Renaissance

Test: Apache Spark Bayes

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark Bayespx4584PX4364Pa454484PX4464p epyc4464pEPYC 4584PX amd4141 b130260390520650474.9477.0483.4490.0500.0513.2513.3515.3515.6566.2600.1MIN: 454.77 / MAX: 514.32MIN: 460.78 / MAX: 515.59MIN: 456.88 / MAX: 535.94MIN: 459.29 / MAX: 580.9MIN: 457.03 / MAX: 581.14MIN: 453.66 / MAX: 554.7MIN: 455.04 / MAX: 535.53MIN: 456.38 / MAX: 531.31MIN: 459.35 / MAX: 536.06MIN: 493.35 / MAX: 1029.04MIN: 506.71 / MAX: 741.31

Renaissance

Test: Savina Reactors.IO

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Savina Reactors.IO4364Pa4464p4584PX45EPYC 4584PX amd4484PXpx4464p epyc4141 b80016002400320040003349.53506.43523.13582.43589.43641.93655.83676.03688.63745.83818.5MIN: 3349.49 / MAX: 4130.17MIN: 3506.38 / MAX: 4329.37MIN: 3523.09 / MAX: 4370.41MIN: 3582.35 / MAX: 4689.63MAX: 4472.27MAX: 4585.77MIN: 3655.76 / MAX: 4484.97MAX: 4536.84MAX: 4840.82MIN: 3745.79 / MAX: 4547.1MAX: 4702.95

Renaissance

Test: Apache Spark PageRank

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark PageRank4484PX454584PXEPYC 4584PX amdpx4141 b4464p4464p epyca4364P50010001500200025002138.12179.02182.52227.92229.72267.12292.22366.12373.02412.22506.8MIN: 1499.64MIN: 1591.55 / MAX: 2179.02MIN: 1564.17MIN: 1592.13 / MAX: 2227.91MIN: 1612.96 / MAX: 2229.74MIN: 2117.39 / MAX: 2335.98MIN: 2106.39 / MAX: 2374.31MIN: 1667.92 / MAX: 2366.13MIN: 1684.52MIN: 1691.04MIN: 1771.47

Renaissance

Test: Finagle HTTP Requests

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Finagle HTTP Requests4141 b4364Papx4484PX45EPYC 4584PX amd4584PX4464p4464p epyc60012001800240030001664.41669.91705.52319.42483.12492.22570.52571.22627.32650.92708.1MIN: 1625.17 / MAX: 1776.68MIN: 1612.75 / MAX: 1713.57MIN: 1676.49 / MAX: 1730.57MIN: 1832.84MIN: 1933.43MIN: 1947.63MIN: 1960.33 / MAX: 2570.51MIN: 1999.64MIN: 2034.59 / MAX: 2627.31MIN: 2066.79MIN: 2074.84 / MAX: 2708.11

Renaissance

Test: Gaussian Mixture Model

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Gaussian Mixture Model4141 b4364Pa4464p4464p epycEPYC 4584PX amd4584PXpx454484PX80016002400320040003087.03130.43397.03399.53647.23703.23773.13806.53815.23829.93860.6MIN: 2935.02 / MAX: 3439.02MIN: 2997.45 / MAX: 3481.57MIN: 2497.54 / MAX: 3397.03MIN: 2471.52MIN: 2576.86 / MAX: 3647.22MIN: 2648.51 / MAX: 3703.23MIN: 2755.26 / MAX: 3773.12MIN: 2770.53 / MAX: 3806.52MIN: 2749.56 / MAX: 3815.24MIN: 2792.29MIN: 2758.89 / MAX: 3860.61

Renaissance

Test: In-Memory Database Shootout

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: In-Memory Database Shootout41px4584PX4484PX4364Pa4464p epyc4464p45EPYC 4584PX amd41 b80016002400320040002951.13175.63232.83241.53244.83256.13275.53288.53408.43442.93681.9MIN: 2787.28 / MAX: 3070.94MIN: 2896.06 / MAX: 3367.44MIN: 3057.86 / MAX: 3585.74MIN: 3037.03 / MAX: 3491.91MIN: 2350.89MIN: 3019.89 / MAX: 3599.5MIN: 3012.8 / MAX: 3533.02MIN: 2991.78 / MAX: 3586.63MIN: 3187.55 / MAX: 3638.98MIN: 3258.62 / MAX: 3709.4MIN: 2559.5

Renaissance

Test: Akka Unbalanced Cobwebbed Tree

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Akka Unbalanced Cobwebbed Tree4364Ppx4484PX4464p4464p epycEPYC 4584PX amd454584PXa41 b41100020003000400050003720.14002.34038.44084.64098.54344.84359.34384.04403.84457.14474.8MIN: 3720.09 / MAX: 4686.78MIN: 4002.27 / MAX: 4983.72MIN: 4038.36 / MAX: 5089.28MAX: 5256.95MIN: 4098.48 / MAX: 5163.21MAX: 5622.35MIN: 4359.25 / MAX: 5618.71MIN: 4383.98 / MAX: 5691.67MAX: 5719.11MIN: 4457.08 / MAX: 5796.57MIN: 4474.77 / MAX: 5751.45

Renaissance

Test: Genetic Algorithm Using Jenetics + Futures

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Genetic Algorithm Using Jenetics + Futuresa4364P41 b414464p epyc454484PXpx4464pEPYC 4584PX amd4584PX2004006008001000732.8749.9801.4806.4884.0891.2904.0920.7924.5959.31050.3MIN: 713.67 / MAX: 813.49MIN: 737.7 / MAX: 777.92MIN: 786.46 / MAX: 836.72MIN: 786.25 / MAX: 832.34MIN: 863.46 / MAX: 897.46MIN: 861.29 / MAX: 903.79MIN: 886.83 / MAX: 919.31MIN: 888.75 / MAX: 934.44MIN: 821.03MIN: 844.95MIN: 1016.46 / MAX: 1068.02

BYTE Unix Benchmark

Computational Test: Pipe

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 5.1.3-gitComputational Test: PipeaEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b10M20M30M40M50M48806257.144323920.044309550.944169926.733443359.233381363.132471450.732439611.623448988.511669425.711518844.21. (CC) gcc options: -pedantic -O3 -ffast-math -march=native -mtune=native -lm

BYTE Unix Benchmark

Computational Test: Dhrystone 2

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 5.1.3-gitComputational Test: Dhrystone 2aEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b400M800M1200M1600M2000M1866536062.71771958344.71766450267.11765175324.61346521770.31340340196.61272938788.01263644317.8966576789.4478992410.7475486444.11. (CC) gcc options: -pedantic -O3 -ffast-math -march=native -mtune=native -lm

BYTE Unix Benchmark

Computational Test: System Call

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 5.1.3-gitComputational Test: System CallaEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b11M22M33M44M55M49140426.640718581.640711986.940531084.030761218.930701622.829969810.929923094.421559197.010707715.010629944.81. (CC) gcc options: -pedantic -O3 -ffast-math -march=native -mtune=native -lm

BYTE Unix Benchmark

Computational Test: Whetstone Double

OpenBenchmarking.orgMWIPS, More Is BetterBYTE Unix Benchmark 5.1.3-gitComputational Test: Whetstone DoubleaEPYC 4584PX amd454584PXpx4484PX4464p4464p epyc4364P4141 b70K140K210K280K350K343491.9331202.0331193.7329601.4244131.0244075.3242679.0242340.5174760.684017.483540.71. (CC) gcc options: -pedantic -O3 -ffast-math -march=native -mtune=native -lm

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 3 - Input: Bosphorus 4KaEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b36912159.5909.4009.3459.3297.6847.6467.2527.2325.3732.8082.7931. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 5 - Input: Bosphorus 4K45aEPYC 4584PX amd4584PX4484PXpx4464p epyc4464p4364P4141 b81624324034.6634.5434.4134.1629.0928.8227.5627.3619.8510.8710.811. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 8 - Input: Bosphorus 4KaEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b20406080100102.01101.54101.52101.3385.2085.0082.5382.1665.1935.8535.641. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 13 - Input: Bosphorus 4KEPYC 4584PX amd454584PXa4484PXpx4464p4464p epyc4364P4141 b50100150200250218.53217.96217.91212.52198.11194.02192.17190.34156.6085.9585.601. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 3 - Input: Bosphorus 1080paEPYC 4584PX amd454584PXpx4484PX4464p4464p epyc4364P4141 b71421283529.5729.2129.1829.0725.4525.4524.8524.8118.7410.5810.551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 5 - Input: Bosphorus 1080paEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b20406080100101.9799.4598.9198.7988.4288.2786.9686.3965.3237.1737.071. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 8 - Input: Bosphorus 1080paEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b70140210280350339.02327.26325.95320.18287.05286.96282.01281.89215.21123.79122.921. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 13 - Input: Bosphorus 1080pEPYC 4584PX amda4584PX454484PXpx4464p4464p epyc4364P4141 b2004006008001000845.58842.56842.34835.45776.12769.82752.16748.15652.97380.63377.791. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 3 - Input: Beauty 4K 10-bit

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 3 - Input: Beauty 4K 10-bitEPYC 4584PX amd454584PXa4484PXpx4464p epyc4464p4364P4141 b0.32240.64480.96721.28961.6121.4331.4271.4261.4221.1881.1841.1321.1290.8720.4430.4411. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 5 - Input: Beauty 4K 10-bit

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 5 - Input: Beauty 4K 10-bitaEPYC 4584PX amd4584PX454484PXpx4464p4464p epyc4364P4141 b2468106.5046.3916.3276.3225.6025.5515.4455.4223.8022.1782.1721. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Beauty 4K 10-bit

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 8 - Input: Beauty 4K 10-bita454584PXEPYC 4584PX amd4484PX4464p4464p epycpx4364P4141 b369121512.46812.11212.08611.89710.96710.91410.88510.8556.4584.3344.3321. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Beauty 4K 10-bit

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 13 - Input: Beauty 4K 10-bita4464p4464p epycEPYC 4584PX amd4584PX454484PXpx4364P4141 b51015202518.58818.00217.94417.86317.84517.83617.40617.3559.1888.0077.9841. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265Video Input: Bosphorus 4K4584PXa45EPYC 4584PX amd4484PXpx4464p4464p epyc4364P4141 b81624324032.5932.5732.2332.2227.1626.9426.0925.8518.8510.9110.891. x265 [info]: HEVC encoder version 3.5+1-f0c1022b6

x265

Video Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is Betterx265Video Input: Bosphorus 1080pa4584PX45EPYC 4584PX amd4484PX4464p epycpx4464p4364P4141 b306090120150114.45113.37113.31113.16101.37101.33101.25101.2388.7156.6156.031. x265 [info]: HEVC encoder version 3.5+1-f0c1022b6

ACES DGEMM

Sustained Floating-Point Rate

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point RateaEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P41 b4120040060080010001141.191093.101092.091091.01842.73842.01818.68812.15629.17263.20259.151. (CC) gcc options: -ffast-math -mavx2 -O3 -fopenmp -lopenblas

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: particle_volume/ao/real_timeaEPYC 4584PX amd454584PX4484PXpx4464p epyc4464p4364P4141 b36912159.009178.571468.548788.515736.527766.522066.292116.288074.639652.302232.26612

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: particle_volume/scivis/real_timea45EPYC 4584PX amd4584PXpx4484PX4464p4464p epyc4364P4141 b36912158.984868.543958.512338.490976.523046.449136.296156.271884.624232.295442.27718

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: particle_volume/pathtracer/real_timeaEPYC 4584PX amd454584PX4464p epyc4464p4484PXpx4364P4141 b50100150200250236.25220.80220.73218.18199.55199.51199.02197.20177.12112.72111.48

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_timea45EPYC 4584PX amd4584PXpx4484PX4464p epyc4464p4364P41 b412468107.639447.463997.445757.387605.710845.631225.470575.470433.917491.904811.84407

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_timea4584PXEPYC 4584PX amd45px4484PX4464p epyc4464p4364P4141 b2468107.587897.323537.322847.315945.614705.548885.361895.357563.831521.908041.89469

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_timea45EPYC 4584PX amd4584PX4484PXpx4464p epyc4464p4364P4141 b2468108.820938.496468.477278.437526.411986.407406.176246.173994.523182.238512.22318

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip CompressionTest: Compression Rating4584PXEPYC 4584PX amd45apx4484PX4464p4464p epyc4364P4141 b40K80K120K160K200K17036116975016937316385914221314126313503313380410187254079534251. 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip CompressionTest: Decompression Rating45EPYC 4584PX amda4584PX4484PXpx4464p epyc4464p4364P4141 b40K80K120K160K200K1661801659341659161645811256981256051185871185698822943781432101. 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20

Stockfish

Chess Benchmark

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 17Chess BenchmarkEPYC 4584PX amd4584PX45a4484PX4464ppx4464p epyc4364P41 b4113M26M39M52M65M58676636572477635576270254752796452675464315885342973396420429513151493714943737126302641. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

Stockfish

Chess Benchmark

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfishChess Benchmark45aEPYC 4584PX amd4584PXpx4484PX4464p4464p epyc4364P4141 b10M20M30M40M50M48797079465070384572479444446458338715953370229830315972299400742401702412024682116075021. Stockfish 16 by the Stockfish developers (see AUTHORS file)

Build2

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.17Time To Compile454584PXEPYC 4584PX amda4484PXpx4464p epyc4464p4364P41 b417014021028035091.0291.7292.0292.05111.65113.78117.07121.74154.43294.95300.72

Primesieve

Length: 1e12

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e12aEPYC 4584PX amd4584PX454484PXpx4464p4464p epyc4364P4141 b6121824306.3476.9036.9266.9379.1169.1479.7019.70512.27324.72324.8211. (CXX) g++ options: -O3

Primesieve

Length: 1e13

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e13aEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b7014021028035078.5084.2684.3284.49110.61110.71118.66118.85150.67301.60302.741. (CXX) g++ options: -O3

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 1B4584PX45EPYC 4584PX amdpx4484PXa4464p epyc4464p4364P41 b4191827364517.3417.3617.5718.3718.3818.4919.2819.3623.8939.2540.56

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 500M454584PXEPYC 4584PX amdpx4484PXa4464p4464p epyc4364P4141 b5101520258.1198.1738.2798.6238.6888.7729.0419.06710.95418.16518.290

POV-Ray

Trace Time

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-RayTrace Timea454584PXEPYC 4584PX amd4484PXpx4464p epyc4464p4364P4141 b163248648018.5419.5219.5520.3325.2625.3326.6026.6134.9270.0670.771. POV-Ray 3.7.0.10.unofficial

oneDNN

Harness: IP Shapes 1D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: IP Shapes 1D - Engine: CPU4584PXaEPYC 4584PX amd454464p4464p epyc4364P4484PXpx41 b410.8621.7242.5863.4484.311.124651.125731.128011.130121.887311.889191.906861.938061.939133.828853.83117MIN: 1.09MIN: 1.03MIN: 1.1MIN: 1.1MIN: 1.83MIN: 1.83MIN: 1.86MIN: 1.92MIN: 1.91MIN: 3.77MIN: 3.771. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: IP Shapes 3D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: IP Shapes 3D - Engine: CPUpx4484PX4584PXEPYC 4584PX amd454464p epyc4464pa4364P4141 b1.11572.23143.34714.46285.57852.729422.730722.746992.777272.778353.745783.750034.058004.450964.946894.95867MIN: 2.7MIN: 2.7MIN: 2.72MIN: 2.75MIN: 2.74MIN: 3.71MIN: 3.71MIN: 3.75MIN: 4.38MIN: 4.85MIN: 4.871. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Convolution Batch Shapes Auto - Engine: CPU454584PXEPYC 4584PX amd4484PXpx4464p4464p epyca4364P41 b4136912154.035504.038084.048774.115514.133216.364756.371506.672877.873679.169569.18658MIN: 3.98MIN: 3.98MIN: 3.99MIN: 4.05MIN: 4.07MIN: 6.28MIN: 6.28MIN: 6.2MIN: 7.77MIN: 9.03MIN: 9.061. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Deconvolution Batch shapes_1d - Engine: CPUa45EPYC 4584PX amd4584PX4484PXpx4464p epyc4464p4364P4141 b2468102.976123.059183.063413.072193.402933.406283.425473.432873.786297.267387.28139MIN: 2.42MIN: 2.56MIN: 2.58MIN: 2.59MIN: 3.03MIN: 3.03MIN: 2.9MIN: 2.96MIN: 3.55MIN: 6.92MIN: 6.941. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Deconvolution Batch shapes_3d - Engine: CPUa45EPYC 4584PX amd4584PX4464p epyc4464p4484PXpx4364P4141 b2468102.412942.662962.664292.672193.388233.389583.508403.512433.780087.536557.55315MIN: 2.34MIN: 2.62MIN: 2.62MIN: 2.62MIN: 3.28MIN: 3.28MIN: 3.46MIN: 3.47MIN: 3.64MIN: 7.53MIN: 7.521. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Recurrent Neural Network Training - Engine: CPU45EPYC 4584PX amd4584PXapx4484PX4464p4464p epyc4364P4141 b100020003000400050001320.231320.371320.991372.031895.681898.361911.441913.862422.834726.084752.85MIN: 1302.81MIN: 1301.96MIN: 1308.56MIN: 1342.06MIN: 1892.59MIN: 1894.26MIN: 1895MIN: 1899.63MIN: 2416.25MIN: 4716.28MIN: 4746.781. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Recurrent Neural Network Inference - Engine: CPUEPYC 4584PX amd454584PXa4484PXpx4464p4464p epyc4364P4141 b5001000150020002500670.23670.70672.51700.86965.02966.011009.581012.191270.762415.252441.27MIN: 663.39MIN: 662.66MIN: 665.03MIN: 679.89MIN: 963.27MIN: 963.43MIN: 994.85MIN: 999.17MIN: 1266.25MIN: 2406.21MIN: 2435.831. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

Numpy Benchmark

OpenBenchmarking.orgScore, More Is BetterNumpy Benchmark45px4364P4584PX4464p epyc4464paEPYC 4584PX amd4484PX4141 b2004006008001000833.64831.42813.31806.83783.43781.66775.75754.41745.59705.99700.76

Timed Eigen Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.4.0Time To Compile45aEPYC 4584PX amd4584PXpx4484PX4464p4464p epyc4364P4141 b30609012015057.1858.6658.6958.8267.0867.3669.3869.5884.48145.21146.66

Gcrypt Library

OpenBenchmarking.orgSeconds, Fewer Is BetterGcrypt Library 1.10.34584PX4364P4464p4464p epycEPYC 4584PX amdapx414541 b4484PX4080120160200150.64154.32156.34156.71159.25162.13163.84165.55167.63169.14171.021. (CC) gcc options: -O2 -fvisibility=hidden

Rustls

Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA256a4584PXEPYC 4584PX amd454484PXpx4464p epyc4464p4364P4141 b16K32K48K64K80K76454.4572793.2672508.1372140.7557716.6457688.0856176.9056047.3843571.8621499.7321444.091. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256aEPYC 4584PX amd454584PX4484PXpx4464p epyc4464p4364P4141 b20K40K60K80K100K80462.6074683.7474672.5774468.4959308.7559206.3458056.0157954.1945095.3522255.2322201.031. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA256aEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b80K160K240K320K400K388077.69382691.63382067.30379874.32333882.92333574.30328877.92326342.42272035.68135362.96135016.231. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA256a45EPYC 4584PX amd4584PX4484PXpx4464p4464p epyc4364P4141 b90K180K270K360K450K404263.45395112.39394570.00393408.85344296.24342775.29336267.09335411.96265949.20132265.65132025.361. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384EPYC 4584PX amd454584PXa4484PXpx4464p epyc4464p4364P4141 b90K180K270K360K450K436101.34435926.40435194.20423535.68306153.20304060.28301217.61301017.23225379.66106833.78105324.921. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256aEPYC 4584PX amd4584PX454464p epyc4464ppx4484PX4364P4141 b800K1600K2400K3200K4000K3563852.573431395.733397871.033379343.723082657.503061522.263038723.483035330.212874011.562105346.652103587.501. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256a45EPYC 4584PX amd4584PX4364P4464p epycpx4464p4484PX4141 b600K1200K1800K2400K3000K2620332.002559245.202558621.382528614.522353677.962304145.792292879.442283083.542282729.641656876.391571309.621. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384EPYC 4584PX amd4584PX45a4484PXpx4464p4464p epyc4364P4141 b400K800K1200K1600K2000K1874050.701863395.071862938.001820810.211586292.421572010.681543373.121532788.041298373.66732992.32690282.021. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA38445EPYC 4584PX amd4584PXapx4484PX4464p epyc4464p4364P41 b41300K600K900K1200K1500K1569479.701569308.651559859.891553632.141340712.851329363.101300937.301297646.721187839.34602002.02596141.191. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

OpenSSL

Algorithm: ChaCha20

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: ChaCha20a45EPYC 4584PX amd4584PX4484PXpx4464p4464p epyc4364P41 b4130000M60000M90000M120000M150000M130588495050128278766110128265416980127793294810971052356909701989745093956743710939075728706804832966033289542860332808358601. OpenSSL 3.0.13 30 Jan 2024 (Library: OpenSSL 3.0.13 30 Jan 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenSSL

Algorithm: AES-128-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: AES-128-GCMa45EPYC 4584PX amd4584PX4484PXpx4464p4464p epyc4364P41 b4120000M40000M60000M80000M100000M104784522170100742301290100666591640100450008810764963367607618440561072709954220726675273005375566370025582374640253761232901. OpenSSL 3.0.13 30 Jan 2024 (Library: OpenSSL 3.0.13 30 Jan 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenSSL

Algorithm: AES-256-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: AES-256-GCMa45EPYC 4584PX amd4584PX4484PXpx4464p4464p epyc4364P4141 b20000M40000M60000M80000M100000M97172751700936145941809355599135093168087590711602918707090265648067431535960673962543804993094560023845653160237605350101. OpenSSL 3.0.13 30 Jan 2024 (Library: OpenSSL 3.0.13 30 Jan 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenSSL

Algorithm: ChaCha20-Poly1305

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: ChaCha20-Poly1305a45EPYC 4584PX amd4584PX4484PXpx4464p4464p epyc4364P41 b4120000M40000M60000M80000M100000M92393529340910250928809092741803090711447140688165440206867895555066548747470664977394304827810993023701138360237010927601. OpenSSL 3.0.13 30 Jan 2024 (Library: OpenSSL 3.0.13 30 Jan 2024) - Additional Parameters: -engine qatengine -async_jobs 8

Apache CouchDB

Bulk Size: 100 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 100 - Inserts: 1000 - Rounds: 30a4364P4584PX4484PXpx4464p epyc45EPYC 4584PX amd4464p41 b412040608010069.9373.2475.8975.9076.3976.5876.6676.6776.7096.5596.741. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 100 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 100 - Inserts: 3000 - Rounds: 30a4364P4584PX45EPYC 4584PX amd4484PXpx4464p epyc4464p4141 b70140210280350232.19239.08252.83253.28253.49253.99254.73259.06259.20314.49316.461. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 300 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 300 - Inserts: 1000 - Rounds: 30a454584PX4464p epycEPYC 4584PX amd4484PX4464p4364Ppx4141 b306090120150106.13116.22116.24116.42116.62117.57118.16118.32119.35153.03154.041. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 300 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 300 - Inserts: 3000 - Rounds: 30a4584PX4364P45EPYC 4584PX amd4464p4464p epyc4484PXpx41 b41110220330440550367.83397.43398.39399.26400.40401.99405.45406.12408.48513.58515.501. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 500 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 500 - Inserts: 1000 - Rounds: 30aEPYC 4584PX amd454464p epyc4584PX4364P4464p4484PXpx41 b4150100150200250148.05161.09161.47163.36163.81163.92164.36164.47164.81212.53212.831. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 500 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 500 - Inserts: 3000 - Rounds: 30a4364P4464p4464p epyc454584PXEPYC 4584PX amd4484PXpx4141 b150300450600750511.78545.97551.35551.60552.21553.81554.40559.35560.70695.35698.071. (CXX) g++ options: -flto -lstdc++ -shared -lei

FinanceBench

Benchmark: Repo OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Repo OpenMP4364Pa4464p4464p epycEPYC 4584PX amd4584PX45px4484PX4141 b7K14K21K28K35K21121.6121418.4521588.9121612.0421848.0721948.9422060.1522318.7422320.3332271.6732477.351. (CXX) g++ options: -O3 -march=native -fopenmp

FinanceBench

Benchmark: Bonds OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Bonds OpenMP4364Pa4464p epyc4464p45EPYC 4584PX amd4584PX4484PXpx41 b4110K20K30K40K50K32715.8133061.2233538.2733551.5233906.6933913.4634053.0634600.7734896.8446851.4247198.941. (CXX) g++ options: -O3 -march=native -fopenmp

ASTC Encoder

Preset: Fast

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: Fasta45EPYC 4584PX amd4584PX4484PXpx4464p4464p epyc4364P4141 b90180270360450396.65369.03368.57368.55278.24277.30263.55263.37205.01100.3799.401. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: MediumaEPYC 4584PX amd454584PX4484PXpx4464p4464p epyc4364P4141 b306090120150156.22144.63144.61144.48109.03108.86103.81103.6780.3739.3239.041. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: Thorougha45EPYC 4584PX amd4584PX4484PXpx4464p4464p epyc4364P4141 b51015202520.302518.766118.749918.707514.170014.146413.523013.513910.33925.06555.04481. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: Exhaustivea45EPYC 4584PX amd4584PX4484PXpx4464p epyc4464p4364P4141 b0.3790.7581.1371.5161.8951.68441.57671.57431.56971.18871.18621.13681.13650.86120.42440.42231. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Very Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: Very Thorougha45EPYC 4584PX amd4584PX4484PXpx4464p epyc4464p4364P4141 b0.61671.23341.85012.46683.08352.74102.56962.56942.56341.94121.93911.85591.85461.40520.69230.69061. (CXX) g++ options: -O3 -flto -pthread

GROMACS

Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACSInput: water_GMX50_bare4584PX45EPYC 4584PX amda4484PXpx4464p4464p epyc4364P4141 b0.40880.81761.22641.63522.0441.8171.8111.8081.6921.5771.5751.3981.3931.1040.6640.6611. GROMACS version: 2023.3-Ubuntu_2023.3_1ubuntu3

LiteRT

Model: DeepLab V3

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: DeepLab V34364P454584PXEPYC 4584PX amd4464p4464p epyc4484PXpx4141 ba80016002400320040001569.752152.482185.782200.932272.282289.582343.382359.992950.802994.593579.67

LiteRT

Model: SqueezeNet

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: SqueezeNet4364P45EPYC 4584PX amd4584PXa4484PX4464ppx4464p epyc4141 b70014002100280035001654.651763.221765.391769.561794.111809.181820.341821.351822.703173.553179.55

LiteRT

Model: Inception V4

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Inception V445EPYC 4584PX amd4584PXa4484PXpx4464p epyc4464p4364P4141 b11K22K33K44K55K19686.019859.420102.821477.822083.322752.422928.323141.424502.149048.849101.9

LiteRT

Model: NASNet Mobile

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: NASNet Mobile4364P41 b414464p epyc4464ppx4484PXEPYC 4584PX amd454584PXa4K8K12K16K20K3808.805034.385153.497640.817759.697931.648057.569231.979245.769311.7716936.00

LiteRT

Model: Mobilenet Float

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Mobilenet Float4364P4584PXEPYC 4584PX amd45apx4484PX4464p4464p epyc41 b4150010001500200025001044.531165.501175.501178.941211.481244.511244.701248.121248.602190.792193.88

LiteRT

Model: Mobilenet Quant

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Mobilenet Quant454584PXEPYC 4584PX amda4484PXpx4464p epyc4464p4364P4141 b400800120016002000730.17734.35742.03823.17848.94849.21857.49859.76935.991781.601785.40

LiteRT

Model: Inception ResNet V2

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Inception ResNet V2454584PXEPYC 4584PX amd4484PXpxa4464p4464p epyc4364P41 b419K18K27K36K45K17824.618224.018412.319477.819490.719530.220123.520503.521153.541757.941844.0

LiteRT

Model: Quantized COCO SSD MobileNet v1

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Quantized COCO SSD MobileNet v14584PXEPYC 4584PX amd454464p epycpx4484PX4464p4364Pa4141 b60012001800240030001337.781339.691343.221415.111417.351420.151431.191494.512129.522736.982741.68

XNNPACK

Model: FP32MobileNetV1

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV14364P454584PXEPYC 4584PX amd4464p epyca4484PX4464ppx4141 b5001000150020002500105611891191119212461252125712671272236724071. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP32MobileNetV2

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV24364P4464p epyc4464p4484PXpx4141 bEPYC 4584PX amd454584PXa3006009001200150070813271357136513681425144314771478148114951. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP32MobileNetV3Large

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV3Large4364P4141 b4464p4484PX4464p epycpx4584PX45EPYC 4584PX amda40080012001600200075313421359147315151542157417491754175618101. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP32MobileNetV3Small

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV3Small4364P4141 b4464p epyc4464p4484PXpx45EPYC 4584PX amd4584PXa20040060080010003354124147917998098379299319339791. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP16MobileNetV1

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV1a45EPYC 4584PX amd4584PX4484PXpx4464p epyc4464p4364P41 b418001600240032004000114311951196120013831386141414181578350835121. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP16MobileNetV2

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV24364Pa4464p4464p epyc4584PX4484PXEPYC 4584PX amd45px41 b415001000150020002500108811901208121012121217122212231248209721311. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP16MobileNetV3Large

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV3Large4364P4464p epyc4464p4484PXapx4584PXEPYC 4584PX amd4541 b41400800120016002000106714271429146714981527152715421547199820181. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP16MobileNetV3Small

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV3Small4364P4141 b4464p4464p epyc4484PXpxEPYC 4584PX amd4584PX45a20040060080010004557147207597667797988718778989201. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: QS8MobileNetV2

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: QS8MobileNetV24364P4141 b4464p4464p epyc4484PXpx45EPYC 4584PX amd4584PXa20040060080010004006236237037037177238018078098441. (CXX) g++ options: -O3 -lrt -lm

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-Onlya454584PXEPYC 4584PX amdpx4484PX4464p4464p epyc4364P41 b415010015020025053.5555.1855.2655.7473.1674.0879.1979.24103.97214.89215.53

Blender

Blend File: Junkshop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-OnlyEPYC 4584PX amda454584PX4484PXpx4464p epyc4464p4364P4141 b6012018024030073.5573.5673.6973.8797.0197.10104.01104.70141.99292.14294.04

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-OnlyaEPYC 4584PX amd4584PX454484PXpx4464p epyc4464p4364P4141 b120240360480600143.36148.97149.37149.37197.20197.53211.40212.30276.44560.89563.14

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-Onlya45EPYC 4584PX amd4584PX4484PXpx4464p epyc4464p4364P4141 b6012018024030071.3573.4873.8673.9696.6797.09105.24105.45136.51280.26282.19

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: CPU-Onlya45EPYC 4584PX amd4584PXpx4484PX4464p epyc4464p4364P4141 b400800120016002000506.20513.54513.66514.70678.40679.34731.39739.91978.032077.692095.98

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-Onlya45EPYC 4584PX amd4584PXpx4484PX4464p4464p epyc4364P4141 b140280420560700166.12170.09171.25171.82224.64226.34243.35245.12320.59667.71671.42

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 5.0Test: WritesaEPYC 4584PX amd454584PX4484PX4464p epycpx4464p4364P41 b4160K120K180K240K300K2713332382272368262358931749601740251739461736331391106651966243

PyPerformance

Benchmark: go

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: go4364P4464p epyca454464p4584PX414484PX41 bpxEPYC 4584PX amd2040608010075.376.077.878.178.378.478.478.678.779.479.6

PyPerformance

Benchmark: chaos

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: chaosa4364P4464p epyc454464pEPYC 4584PX amd4584PXpx4484PX4141 b91827364538.238.338.638.839.039.139.239.439.739.940.2

PyPerformance

Benchmark: float

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: float4364P4464p4464p epyca45pxEPYC 4584PX amd4584PX4484PX4141 b122436486048.249.749.750.750.750.851.051.151.352.852.9

PyPerformance

Benchmark: nbody

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: nbody4364P4464p4464p epycEPYC 4584PX amda4584PXpx4484PX4541 b41142842567056.857.258.658.859.059.059.259.559.660.060.4

PyPerformance

Benchmark: pathlib

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: pathlib4364P4464p4464p epyc4584PXEPYC 4584PX amda454484PXpx4141 b4812162013.514.114.114.114.114.214.214.414.414.614.6

PyPerformance

Benchmark: raytrace

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: raytrace4364Pa4464p epyc4584PXEPYC 4584PX amd4464p4541 b4484PXpx414080120160200174175176176176177179180182182182

PyPerformance

Benchmark: xml_etree

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: xml_etree4364P4464p4464p epyca4584PX45EPYC 4584PX amdpx41 b414484PX81624324034.735.335.635.836.136.136.236.536.636.736.8

PyPerformance

Benchmark: gc_collect

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: gc_collect4364P4464p4464p epyca4584PXEPYC 4584PX amd454484PX4141 bpx150300450600750649671671677682686689699702704706

PyPerformance

Benchmark: json_loads

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: json_loads4364P4464p4464p epycaEPYC 4584PX amd454484PX4141 bpx4584PX369121511.812.012.012.112.212.312.412.412.412.512.5

PyPerformance

Benchmark: crypto_pyaes

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: crypto_pyaes4364Pa4464p4464p epyc454584PXEPYC 4584PX amd414484PX41 bpx102030405040.741.741.842.042.442.742.743.043.143.143.3

PyPerformance

Benchmark: async_tree_io

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: async_tree_io45EPYC 4584PX amd4584PXpx4484PX4364P4464p4464p epyca4141 b2004006008001000633651653656666726738742755855858

PyPerformance

Benchmark: regex_compile

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: regex_compile4364P4464paEPYC 4584PX amd4464p epyc454584PX4484PXpx4141 b163248648068.169.569.869.870.070.471.471.772.572.672.7

PyPerformance

Benchmark: python_startup

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: python_startupa4464p4464p epyc4584PXEPYC 4584PX amd454484PXpx4364P4141 b2468105.775.805.816.016.016.036.086.096.346.936.97

PyPerformance

Benchmark: asyncio_tcp_ssl

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: asyncio_tcp_ssl454584PXEPYC 4584PX amd4484PXpx4364P4464p4464p epyca4141 b160320480640800581582586590590610626628645723737

PyPerformance

Benchmark: django_template

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: django_template4364P4464p4464p epyca4584PX454484PXEPYC 4584PX amdpx4141 b51015202520.120.620.620.720.820.921.021.021.221.221.3

PyPerformance

Benchmark: asyncio_websockets

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: asyncio_websockets4364P45a4464p4584PX4464p epycEPYC 4584PX amd4484PXpx4141 b70140210280350308314315315315316317321322330331

PyPerformance

Benchmark: pickle_pure_python

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: pickle_pure_python4364P454464p4464p epycaEPYC 4584PX amd4584PXpx4484PX4141 b4080120160200162163164164165165166168169171171

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: GPT-2 - Device: CPU - Executor: Standard454584PXEPYC 4584PX amd4484PXpx4464p4464p epyca4364P4141 b4080120160200166.17166.05165.77159.71157.89136.30135.72134.60125.52124.17123.271. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: GPT-2 - Device: CPU - Executor: Standard454584PXEPYC 4584PX amd4484PXpx4464p4464p epyca4364P4141 b2468106.016316.020696.030246.258156.330347.333317.365447.427767.960698.048358.107671. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: yolov4 - Device: CPU - Executor: Standard4364P4584PXEPYC 4584PX amd45a4484PXpx4464p4464p epyc4141 b369121513.2372011.3551011.3166011.3105011.0552010.7338010.7127010.4982010.486507.160157.157121. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: yolov4 - Device: CPU - Executor: Standard4364P4584PXEPYC 4584PX amd45a4484PXpx4464p4464p epyc4141 b30609012015075.5488.0688.3688.4190.4593.1693.3495.2595.36139.66139.721. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ZFNet-512 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ZFNet-512 - Device: CPU - Executor: StandardEPYC 4584PX amd454584PX4484PXpxa4464p epyc4464p4364P4141 b306090120150113.29113.17112.67110.94110.89102.33101.62101.4197.2373.8873.001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ZFNet-512 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ZFNet-512 - Device: CPU - Executor: StandardEPYC 4584PX amd454584PX4484PXpxa4464p epyc4464p4364P4141 b481216208.825818.835248.874449.013229.016879.769859.838939.8589610.2835013.5323013.695501. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: T5 Encoder - Device: CPU - Executor: Standard4484PXpx4584PX45EPYC 4584PX amd4464p4464p epyca414364P41 b50100150200250208.17206.09203.95203.93203.49168.04166.51156.45141.96141.57140.031. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: T5 Encoder - Device: CPU - Executor: Standard4484PXpx4584PX45EPYC 4584PX amd4464p4464p epyca414364P41 b2468104.802874.851424.902854.903134.913815.950356.004706.391127.041227.060757.138571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: bertsquad-12 - Device: CPU - Executor: Standard4364Pa4584PXEPYC 4584PX amd454464p4464p epycpx4484PX41 b4151015202519.8115.5915.0114.9414.8814.6914.6914.5714.5110.6210.521. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: bertsquad-12 - Device: CPU - Executor: Standard4364Pa4584PXEPYC 4584PX amd454464p4464p epycpx4484PX41 b412040608010050.4764.1466.6266.9267.1868.0868.0968.6168.9194.1295.071. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard454584PXEPYC 4584PX amd4484PXpx4364P4464p epyc4464pa4141 b20040060080010001013.191005.50999.97941.40937.78762.25748.66724.53636.32495.84495.081. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard454584PXEPYC 4584PX amd4484PXpx4364P4464p epyc4464pa4141 b0.45430.90861.36291.81722.27150.9866430.9941930.9997011.0618801.0660001.3112101.3351601.3797001.5708402.0160902.0191301. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: fcn-resnet101-11 - Device: CPU - Executor: Standard45EPYC 4584PX amd4584PXa4484PXpx4464p epyc4464p4364P4141 b0.76541.53082.29623.06163.8273.401783.390643.386583.216702.810932.796382.590252.586882.052111.079031.078291. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: fcn-resnet101-11 - Device: CPU - Executor: Standard45EPYC 4584PX amd4584PXa4484PXpx4464p epyc4464p4364P4141 b2004006008001000293.96294.93295.28310.88355.75357.60386.06386.56487.30926.76927.391. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardEPYC 4584PX amd4584PX45a4364P4484PXpx4464p epyc4464p41 b41102030405044.0543.8443.4942.4539.0837.3837.1036.4036.1223.9123.841. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ArcFace ResNet-100 - Device: CPU - Executor: StandardEPYC 4584PX amd4584PX45a4364P4484PXpx4464p epyc4464p41 b41102030405022.7022.8122.9923.5525.5826.7526.9527.4727.6841.8241.941. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standarda4584PXEPYC 4584PX amd454364P4464p epyc4464p4484PXpx4141 b80160240320400390.60383.13382.77380.80376.53361.30360.35356.41356.19207.61202.121. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standarda4584PXEPYC 4584PX amd454364P4464p epyc4464p4484PXpx4141 b1.11292.22583.33874.45165.56452.558982.609742.612212.625732.654822.767142.774222.805442.806954.815304.946361. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: super-resolution-10 - Device: CPU - Executor: Standard4364Pa4464p4464p epyc4484PXpx45EPYC 4584PX amd4584PX41 b41306090120150157.08141.12134.94134.52125.17125.08122.22122.21122.1773.8473.271. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: super-resolution-10 - Device: CPU - Executor: Standard4364Pa4464p4464p epyc4484PXpx45EPYC 4584PX amd4584PX41 b41481216206.365647.086017.410377.433727.988737.994868.181758.182658.1851913.5417013.645701. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard45EPYC 4584PX amda4584PX4484PXpx4464p epyc4464p4364P4141 b0.34870.69741.04611.39481.74351.5498801.5436501.5419601.5361901.1762701.1705001.1563201.1458100.9163170.4647230.4644851. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard45EPYC 4584PX amda4584PX4484PXpx4464p epyc4464p4364P4141 b5001000150020002500645.21647.81648.52650.96850.14854.33864.81872.741091.322151.822152.921. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard4584PXEPYC 4584PX amd45a4464p4464p epyc4364Ppx4484PX41 b41112233445548.2647.8947.6747.0746.3546.0944.8043.3640.0938.5336.111. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard4584PXEPYC 4584PX amd45a4464p4464p epyc4364Ppx4484PX41 b4171421283520.7220.8820.9821.2421.5721.6922.3223.0624.9425.9527.691. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

Whisper.cpp

Model: ggml-base.en - Input: 2016 State of the Union

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-base.en - Input: 2016 State of the UnionEPYC 4584PX amd454584PXa4484PXpx4464p epyc4464p4364P41 b41408012016020084.0384.1184.6887.4992.7193.4597.5597.94103.72186.23187.291. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni

Whisper.cpp

Model: ggml-small.en - Input: 2016 State of the Union

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-small.en - Input: 2016 State of the Union45EPYC 4584PX amd4584PXapx4484PX4464p4464p epyc4364P4141 b130260390520650232.58233.05233.68245.08266.81268.24280.03280.47314.48581.27583.201. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni

Whisper.cpp

Model: ggml-medium.en - Input: 2016 State of the Union

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-medium.en - Input: 2016 State of the Union45EPYC 4584PX amd4584PXapx4484PX4464p4464p epyc4364P41 b400800120016002000684.13684.39686.88700.91809.49809.79838.18839.99966.011797.861. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni

Whisperfile

Model Size: Tiny

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisperfile 20Aug24Model Size: Tiny45EPYC 4584PX amd4584PX4484PX4464p epycpx4464p4364Pa41 b153045607535.1135.4335.9137.1338.5838.7240.8541.3041.7166.11

Whisperfile

Model Size: Small

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisperfile 20Aug24Model Size: Small454584PXEPYC 4584PX amdpx4484PX4464p epyc4464p4364Pa41 b70140210280350154.44155.14155.97167.89173.38177.87178.33193.94195.42310.38

Whisperfile

Model Size: Medium

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisperfile 20Aug24Model Size: Medium45EPYC 4584PX amd4584PX4484PXpx4464p4464p epyc4364Pa41 b2004006008001000424.57424.95425.51473.55475.51491.98492.70528.33534.92845.17

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128px4484PX4464p epyc4464p45EPYC 4584PX amd4584PXa4364P41 b2468107.127.117.107.097.007.007.006.886.646.551. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512EPYC 4584PX amd4584PX45a4484PXpx4464p4464p epyc4364P41 b2040608010093.9192.8991.7170.7669.1167.9564.9664.4360.8732.971. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024EPYC 4584PX amd454584PXa4484PXpx4464p4464p epyc4364P41 b2040608010091.3190.9690.0170.8566.5766.3563.7163.5059.2731.911. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 204845EPYC 4584PX amd4584PX4484PXpxa4464p epyc4464p4364P41 b2040608010086.6886.4786.1763.8063.7963.0960.8060.6855.9530.931. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 1284464p epycpx4464p4484PX45EPYC 4584PX amd4584PXa4364P41 b2468107.447.447.427.417.377.377.327.247.026.901. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 51245EPYC 4584PX amd4584PXpxa4484PX4464p4464p epyc4364P41 b2040608010094.0893.4993.2468.8168.4068.2065.2464.6861.0932.941. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024454584PXEPYC 4584PX amda4484PXpx4464p4464p epyc4364P41 b2040608010091.1791.1290.4869.2666.8566.5264.1562.8459.5432.591. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048454584PXEPYC 4584PX amd4484PXpxa4464p4464p epyc4364P41 b2040608010086.9186.5686.4463.6163.4162.9760.4760.3056.0531.041. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128px4484PX4364P41 b4464p4464p epyc454584PXEPYC 4584PX amda122436486052.3752.3051.8651.5050.5050.4350.3349.9049.7647.721. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 51245aEPYC 4584PX amd4584PX4484PX4464p epyc4464ppx4364P41 b70140210280350337.06327.30326.16316.80243.14242.10235.94232.86204.06122.801. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024aEPYC 4584PX amd454584PXpx4464p4484PX4464p epyc4364P41 b80160240320400355.09324.04291.02290.10244.77235.01232.26227.71185.97115.671. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 20484584PXEPYC 4584PX amda454484PX4464p4464p epycpx4364P41 b60120180240300289.41289.04279.04273.67222.75213.02212.30208.99171.68105.101. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 164464p epycpx4484PX4464p4584PXEPYC 4584PX amd41 b45a4364P51015202519.5319.5019.4919.4719.2719.2419.1719.1619.0318.83

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 128px4464p epyc4464p4484PX45EPYC 4584PX amd4584PXa41 b4364P51015202520.5120.5020.4820.3920.2920.2620.2320.1320.0819.60

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 25641 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa90018002700360045004096409640964096409640964096409640964096

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 51241 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa2K4K6K8K10K8192819281928192819281928192819281928192

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 16px4484PX4464p epyc4464p454584PXEPYC 4584PX amda4364P41 b61218243025.9425.8625.7825.7725.3825.3225.3024.5924.2723.80

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 102441 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa4K8K12K16K20K16384163841638416384163841638416384163841638416384

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 204841 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa7K14K21K28K35K32768327683276832768327683276832768327683276832768

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 128px4484PX4464p4464p epyc454584PXEPYC 4584PX amda4364P41 b71421283527.8027.5927.3627.3527.2127.2027.1926.2825.5225.09

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 164464p4464p epycpx4484PXEPYC 4584PX amd454584PXa41 b4364P369121510.4810.4510.4510.4510.3710.3410.3010.229.999.92

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 25641 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa90018002700360045004096409640964096409640964096409640964096

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 51241 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa2K4K6K8K10K8192819281928192819281928192819281928192

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 1284464ppx4464p epyc4484PXEPYC 4584PX amd454584PXa41 b4364P369121510.9310.9310.9110.9110.8510.8210.8110.4710.4610.32

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 1645pxEPYC 4584PX amd4464p epyc4464p4484PX4584PXa4364P41 b0.41850.8371.25551.6742.09251.861.841.831.831.831.831.821.781.761.73

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 102441 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa4K8K12K16K20K16384163841638416384163841638416384163841638416384

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 204841 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa7K14K21K28K35K32768327683276832768327683276832768327683276832768

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 1284464p epyc4464ppx4484PX45EPYC 4584PX amd4584PXa41 b4364P0.46350.9271.39051.8542.31752.062.052.052.052.032.032.031.991.931.93

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 25641 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa90018002700360045004096409640964096409640964096409640964096

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 51241 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa2K4K6K8K10K8192819281928192819281928192819281928192

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 102441 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa4K8K12K16K20K16384163841638416384163841638416384163841638416384

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 204841 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa7K14K21K28K35K32768327683276832768327683276832768327683276832768

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 25641 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa300600900120015001536153615361536153615361536153615361536

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 51241 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa70014002100280035003072307230723072307230723072307230723072

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 102441 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa130026003900520065006144614461446144614461446144614461446144

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 204841 b45EPYC 4584PX amd4584PX4364P4464p epyc4464ppx4484PXa3K6K9K12K15K12288122881228812288122881228812288122881228812288

OpenVINO GenAI

Model: Gemma-7b-int4-ov - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPUpx4484PX4464p epyc454464pEPYC 4584PX amd4584PXa4364P41 b369121510.2410.2310.2010.1710.1710.1410.119.839.528.05

OpenVINO GenAI

Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time To First TokenEPYC 4584PX amd454584PXa4484PXpx4464p4464p epyc4364P41 b60120180240300104.38104.87105.36106.62121.48122.30124.38124.52154.83288.64

OpenVINO GenAI

Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Tokenpx4484PX4464p epyc454464pEPYC 4584PX amd4584PXa4364P41 b30609012015097.6197.7998.0398.3198.3398.6498.91101.72105.09124.24

OpenVINO GenAI

Model: Falcon-7b-instruct-int4-ov - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPUpx4484PX454464p4584PX4464p epycEPYC 4584PX amda4364P41 b369121513.4113.4013.3613.3413.3213.3213.2412.9312.5911.38

OpenVINO GenAI

Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token4584PXaEPYC 4584PX amd45px4464p4484PX4464p epyc4364P41 b5010015020025086.0486.0686.2087.3493.0093.0093.0194.77115.73217.85

OpenVINO GenAI

Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Tokenpx4484PX454464p4464p epyc4584PXEPYC 4584PX amda4364P41 b2040608010074.5474.6574.8674.9475.0675.0675.5177.3479.4187.90

OpenVINO GenAI

Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPUpx4484PX4464p epyc4464pEPYC 4584PX amd454584PXa4364P41 b51015202520.2920.2819.8219.8219.7319.7119.6719.2819.0016.65

OpenVINO GenAI

Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First TokenEPYC 4584PX amd45a4584PXpx4484PX4464p epyc4464p4364P41 b30609012015055.4755.6755.9356.0658.8658.9159.8659.8771.58130.47

OpenVINO GenAI

Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Tokenpx4484PX4464p4464p epycEPYC 4584PX amd454584PXa4364P41 b132639526549.2849.3150.4550.4650.6850.7450.8451.8652.6460.07


Phoronix Test Suite v10.8.5