eoy2024

Benchmarks for a future article. AMD EPYC 4124P 4-Core testing with a Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS) and ASPEED on Ubuntu 24.04 via the Phoronix Test Suite.

HTML result view exported from: https://openbenchmarking.org/result/2412200-NE-EOY20240400&sro&gru.

eoy2024ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerCompilerFile-SystemScreen Resolutiona4484PXpx4464p4464p epyc4364P4584PXEPYC 4584PX amd454141 bAMD EPYC 4564P 16-Core @ 5.88GHz (16 Cores / 32 Threads)Supermicro AS-3015A-I H13SAE-MF v1.00 (2.1 BIOS)AMD Device 14d82 x 32GB DRAM-4800MT/s Micron MTC20C2085S1EC48BA1 BC3201GB Micron_7450_MTFDKCC3T2TFS + 960GB SAMSUNG MZ1L2960HCJR-00A07ASPEEDAMD Rembrandt Radeon HD AudioVA24312 x Intel I210Ubuntu 24.046.8.0-11-generic (x86_64)GNOME Shell 45.3X Server 1.21.1.11GCC 13.2.0ext41024x768AMD EPYC 4484PX 12-Core @ 5.66GHz (12 Cores / 24 Threads)6.12.2-061202-generic (x86_64)AMD EPYC 4464P 12-Core @ 5.48GHz (12 Cores / 24 Threads)AMD EPYC 4364P 8-Core @ 5.57GHz (8 Cores / 16 Threads)AMD EPYC 4584PX 16-Core @ 5.76GHz (16 Cores / 32 Threads)AMD EPYC 4124P 4-Core @ 5.17GHz (4 Cores / 8 Threads)960GB SAMSUNG MZ1L2960HCJR-00A07 + 3201GB Micron_7450_MTFDKCC3T2TFSOpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-backtrace --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-fxIygj/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-fxIygj/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- a: Scaling Governor: amd-pstate-epp performance (EPP: performance) - CPU Microcode: 0xa601209- 4484PX: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- px: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 4464p: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 4464p epyc: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 4364P: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 4584PX: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- EPYC 4584PX amd: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 45: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 41: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209- 41 b: Scaling Governor: amd-pstate-epp performance (Boost: Enabled EPP: performance) - CPU Microcode: 0xa601209Java Details- OpenJDK Runtime Environment (build 21.0.2+13-Ubuntu-2)Python Details- Python 3.12.3Security Details- a: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4484PX: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- px: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4464p: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4464p epyc: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4364P: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 4584PX: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- EPYC 4584PX amd: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 45: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 41: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected- 41 b: gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + reg_file_data_sampling: Not affected + retbleed: Not affected + spec_rstack_overflow: Mitigation of Safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Enhanced / Automatic IBRS; IBPB: conditional; STIBP: always-on; RSB filling; PBRSB-eIBRS: Not affected; BHI: Not affected + srbds: Not affected + tsx_async_abort: Not affected

eoy2024openssl: ChaCha20openssl: AES-128-GCMopenssl: AES-256-GCMopenssl: ChaCha20-Poly1305svt-av1: Preset 3 - Bosphorus 4Ksvt-av1: Preset 5 - Bosphorus 4Ksvt-av1: Preset 8 - Bosphorus 4Ksvt-av1: Preset 13 - Bosphorus 4Ksvt-av1: Preset 3 - Bosphorus 1080psvt-av1: Preset 5 - Bosphorus 1080psvt-av1: Preset 8 - Bosphorus 1080psvt-av1: Preset 13 - Bosphorus 1080psvt-av1: Preset 3 - Beauty 4K 10-bitsvt-av1: Preset 5 - Beauty 4K 10-bitsvt-av1: Preset 8 - Beauty 4K 10-bitsvt-av1: Preset 13 - Beauty 4K 10-bitx265: Bosphorus 4Kx265: Bosphorus 1080psimdjson: Kostyasimdjson: TopTweetsimdjson: LargeRandsimdjson: PartialTweetssimdjson: DistinctUserIDmt-dgemm: Sustained Floating-Point Raterustls: handshake - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-resume - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake-ticket - TLS13_CHACHA20_POLY1305_SHA256rustls: handshake - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384rustls: handshake-resume - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-ticket - TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256rustls: handshake-resume - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384rustls: handshake-ticket - TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384onnx: GPT-2 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: ZFNet-512 - CPU - Standardonnx: T5 Encoder - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: ResNet101_DUC_HDC-12 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardospray: particle_volume/ao/real_timeospray: particle_volume/scivis/real_timeospray: particle_volume/pathtracer/real_timeospray: gravity_spheres_volume/dim_512/ao/real_timeospray: gravity_spheres_volume/dim_512/scivis/real_timeospray: gravity_spheres_volume/dim_512/pathtracer/real_timebyte: Pipebyte: Dhrystone 2byte: System Callcompress-7zip: Compression Ratingcompress-7zip: Decompression Ratingetcpak: Multi-Threaded - ETC2astcenc: Fastastcenc: Mediumastcenc: Thoroughastcenc: Exhaustiveastcenc: Very Thoroughbyte: Whetstone Doublestockfish: Chess Benchmarkstockfish: Chess Benchmarkgromacs: water_GMX50_barenamd: ATPase with 327,506 Atomsnamd: STMV with 1,066,628 Atomscassandra: Writesnumpy: quantlib: Squantlib: XXSllama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Llama-3.1-Tulu-3-8B-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - Mistral-7B-Instruct-v0.3-Q8_0 - Prompt Processing 2048llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Text Generation 128llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 512llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 1024llama-cpp: CPU BLAS - granite-3.0-3b-a800m-instruct-Q8_0 - Prompt Processing 2048llamafile: Llama-3.2-3B-Instruct.Q6_K - Text Generation 16llamafile: Llama-3.2-3B-Instruct.Q6_K - Text Generation 128llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 256llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 512llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 16llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 1024llamafile: Llama-3.2-3B-Instruct.Q6_K - Prompt Processing 2048llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Text Generation 128llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 16llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 256llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 512llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Text Generation 128llamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 16llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 1024llamafile: TinyLlama-1.1B-Chat-v1.0.BF16 - Prompt Processing 2048llamafile: wizardcoder-python-34b-v1.0.Q6_K - Text Generation 128llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 256llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 512llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 1024llamafile: mistral-7b-instruct-v0.2.Q5_K_M - Prompt Processing 2048llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 256llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 512llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 1024llamafile: wizardcoder-python-34b-v1.0.Q6_K - Prompt Processing 2048openvino-genai: Gemma-7b-int4-ov - CPUopenvino-genai: Falcon-7b-instruct-int4-ov - CPUopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPUonnx: GPT-2 - CPU - Standardonnx: yolov4 - CPU - Standardonnx: ZFNet-512 - CPU - Standardonnx: T5 Encoder - CPU - Standardonnx: bertsquad-12 - CPU - Standardonnx: CaffeNet 12-int8 - CPU - Standardonnx: fcn-resnet101-11 - CPU - Standardonnx: ArcFace ResNet-100 - CPU - Standardonnx: ResNet50 v1-12-int8 - CPU - Standardonnx: super-resolution-10 - CPU - Standardonnx: ResNet101_DUC_HDC-12 - CPU - Standardonnx: Faster R-CNN R-50-FPN-int8 - CPU - Standardlitert: DeepLab V3litert: SqueezeNetlitert: Inception V4litert: NASNet Mobilelitert: Mobilenet Floatlitert: Mobilenet Quantlitert: Inception ResNet V2litert: Quantized COCO SSD MobileNet v1pyperformance: gopyperformance: chaospyperformance: floatpyperformance: nbodypyperformance: pathlibpyperformance: raytracepyperformance: xml_etreepyperformance: gc_collectpyperformance: json_loadspyperformance: crypto_pyaespyperformance: async_tree_iopyperformance: regex_compilepyperformance: python_startuppyperformance: asyncio_tcp_sslpyperformance: django_templatepyperformance: asyncio_websocketspyperformance: pickle_pure_pythonrenaissance: Scala Dottyrenaissance: Rand Forestrenaissance: ALS Movie Lensrenaissance: Apache Spark Bayesrenaissance: Savina Reactors.IOrenaissance: Apache Spark PageRankrenaissance: Finagle HTTP Requestsrenaissance: Gaussian Mixture Modelrenaissance: In-Memory Database Shootoutrenaissance: Akka Unbalanced Cobwebbed Treerenaissance: Genetic Algorithm Using Jenetics + Futuresonednn: IP Shapes 1D - CPUonednn: IP Shapes 3D - CPUonednn: Convolution Batch Shapes Auto - CPUonednn: Deconvolution Batch shapes_1d - CPUonednn: Deconvolution Batch shapes_3d - CPUonednn: Recurrent Neural Network Training - CPUonednn: Recurrent Neural Network Inference - CPUfinancebench: Repo OpenMPfinancebench: Bonds OpenMPopenvino-genai: Gemma-7b-int4-ov - CPU - Time To First Tokenopenvino-genai: Gemma-7b-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Falcon-7b-instruct-int4-ov - CPU - Time Per Output Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time To First Tokenopenvino-genai: Phi-3-mini-128k-instruct-int4-ov - CPU - Time Per Output Tokencp2k: H20-64cp2k: H20-256cp2k: Fayalite-FISTrelion: Basic - CPUbuild2: Time To Compileprimesieve: 1e12primesieve: 1e13y-cruncher: 1By-cruncher: 500Mpovray: Trace Timebuild-eigen: Time To Compilegcrypt: couchdb: 100 - 1000 - 30couchdb: 100 - 3000 - 30couchdb: 300 - 1000 - 30couchdb: 300 - 3000 - 30couchdb: 500 - 1000 - 30couchdb: 500 - 3000 - 30blender: BMW27 - CPU-Onlyblender: Junkshop - CPU-Onlyblender: Classroom - CPU-Onlyblender: Fishy Cat - CPU-Onlyblender: Barbershop - CPU-Onlyblender: Pabellon Barcelona - CPU-Onlywhisper-cpp: ggml-base.en - 2016 State of the Unionwhisper-cpp: ggml-small.en - 2016 State of the Unionwhisper-cpp: ggml-medium.en - 2016 State of the Unionwhisperfile: Tinywhisperfile: Smallwhisperfile: Mediumxnnpack: FP32MobileNetV1xnnpack: FP32MobileNetV2xnnpack: FP32MobileNetV3Largexnnpack: FP32MobileNetV3Smallxnnpack: FP16MobileNetV1xnnpack: FP16MobileNetV2xnnpack: FP16MobileNetV3Largexnnpack: FP16MobileNetV3Smallxnnpack: QS8MobileNetV2a4484PXpx4464p4464p epyc4364P4584PXEPYC 4584PX amd454141 b13058849505010478452217097172751700923935293409.5934.538102.005212.5229.573101.971339.023842.5581.4226.50412.46818.58832.57114.455.9710.461.839.7610.461141.19410476454.4580462.6388077.69404263.45423535.683563852.5726203321820810.211553632.14134.59611.0552102.331156.45315.5899636.3183.216742.4537390.597141.1171.5419647.06919.009178.98486236.2457.639447.587898.8209348806257.11866536062.749140426.6163859165916577.817396.6495156.221720.30251.68442.741343491.954752796465070381.6922.796320.75656271333775.7512.747613.4326.8870.7670.8563.097.2468.469.2662.9747.72327.3355.09279.0419.0320.134096819224.59163843276826.2810.224096819210.471.7816384327681.99409681921638432768153630726144122889.8312.9319.287.4277690.45239.769856.3911264.1411.57084310.87523.5532.558987.08601648.52221.24293579.671794.1121477.8169361211.48823.1719530.22129.5277.838.250.75914.217535.867712.141.775569.85.7764520.7315165477.0414.49805.7490.03506.42412.22319.43399.53256.14403.8732.81.125734.0586.672872.976122.412941372.03700.85921418.44531233061.21875106.62101.7286.0677.3455.9351.8658.191592.85794.032944.2792.0536.34778.49818.4858.77218.54258.655162.12569.929232.188106.13367.83148.049511.77553.5573.56143.3671.35506.2166.1287.48973245.07838700.9141.70935195.41642534.919125214951810979114311901498920844971052356907649633676071160291870688165440207.68429.09485.201198.11225.44688.415287.047776.1151.1885.60210.96717.40627.16101.376.1110.821.8410.110.76842.73064257716.6459308.75333882.92344296.24306153.23035330.212282729.641586292.421329363.1159.7110.7338110.94208.17414.5122941.4012.8109337.3832356.409125.1721.1762740.09356.527766.44913199.0235.631225.548886.4119833443359.21346521770.330761218.9141263125698410.726278.2445109.026514.171.18871.9412244075.345267546337022981.5772.381240.65119174960745.5911.864712.11697.1169.1166.5763.87.4168.266.8563.6152.3243.14232.26222.7519.4920.394096819225.86163843276827.5910.454096819210.911.8316384327682.054096819216384327681536307261441228810.2313.420.286.2581593.16059.013224.8028768.90511.06188355.75126.74782.805447.98873850.14124.94022343.381809.1822083.38057.561244.7848.94319477.81420.1578.639.751.359.514.418236.869912.443.166671.76.0859021321169428.6422.09378.8513.23655.82138.12492.23860.63241.54038.4904.01.938062.730724.115513.402933.50841898.36965.01522320.33203134600.773438121.4897.7993.0174.6558.9149.3153.005628.10492.21729.4111.6519.116110.60818.3798.68825.26467.364171.02375.901253.99117.566406.12164.468559.34674.0897.01197.296.67679.34226.3492.70933268.23891809.7896937.13462173.38197473.55091125713651515809138312171467779717970198974507618440561070902656480686789555507.64628.82484.998194.02425.44788.27286.962769.8181.1845.55110.85517.35526.94101.255.4510.511.848.358.97842.01283157688.0859206.34333574.3342775.29304060.283038723.482292879.441572010.681340712.85157.89310.7127110.892206.09114.5747937.7782.7963837.1048356.194125.0761.170543.3626.522066.52304197.25.710845.61476.407433381363.11340340196.630701622.8142213125605409.875277.2994108.858814.14641.18621.939124413142973396338715951.5752.353790.65448173946831.4211.83912.10577.1267.9566.3563.797.4468.8166.5263.4152.37232.86244.77208.9919.520.514096819225.94163843276827.810.454096819210.931.8416384327682.054096819216384327681536307261441228810.2413.4120.296.3303493.34419.016874.8514268.61041.066357.60226.94852.806957.99486854.33423.06042359.991821.3522752.47931.641244.51849.20919490.71417.3579.439.450.859.214.418236.570612.543.365672.56.0959021.2322168436.2453.29275.7474.93676.02229.72483.13815.23175.64002.3920.71.939132.729424.133213.406283.512431895.68966.01322318.73828134896.835938122.397.619374.5458.8649.2852.724631.3194.896733.02113.789.147110.70918.3658.62325.32867.076163.83976.389254.733119.349408.483164.812560.773.1697.1197.5397.09678.4224.6493.45463266.81425809.48938.71828167.89219475.51084127213681574837138612481527798723939567437107270995422067431535960665487474707.25227.3682.525192.17124.85486.96282.008752.1551.1295.44510.91418.00226.09101.235.7810.661.819.810.54818.67814156047.3857954.19328877.92336267.09301017.233061522.262283083.541543373.121297646.72136.29910.4982101.413168.03614.6885724.5332.5868836.1205360.354134.9411.1458146.35436.288076.29615199.5125.470435.357566.1739932471450.7127293878829969810.9135033118569388.404263.5475103.808913.5231.13651.854624267943158853303159721.3982.216450.61452173633781.6610.287310.57887.0964.9663.7160.687.4265.2464.1560.4750.5235.94235.01213.0219.4720.484096819225.77163843276827.3610.484096819210.931.8316384327682.054096819216384327681536307261441228810.1713.3419.827.3333195.25079.858965.9503568.07751.3797386.56327.68282.774227.41037872.74221.57082272.281820.3423141.47759.691248.12859.75720123.51431.1978.33949.757.214.117735.36711241.873869.55.862620.6315164424.6415.39243.0515.33523.12366.12650.93647.23288.54084.6924.51.887313.750036.364753.432873.389581911.441009.5821588.9062533551.523438124.3898.339374.9459.8750.4558.397676.742100.486937.33121.7379.701118.66419.3649.04126.60969.379156.34376.696259.196118.161401.989164.358551.34679.19104.7212.3105.45739.91243.3597.94408280.03419838.1842540.847178.32917491.98412126713571473799141812081429759703939075728707266752730067396254380664977394307.23227.56482.164190.34324.80586.386281.892748.1471.1325.42210.88517.94425.85101.336.0210.691.739.6310.28812.14708956176.958056.01326342.42335411.96301217.613082657.52304145.791532788.041300937.3135.71810.4865101.618166.51214.685748.662.5902536.3968361.297134.5171.1563246.09216.292116.27188199.5465.470575.361896.1762432439611.61263644317.829923094.4133804118587388.128263.3662103.674413.51391.13681.8559242340.542042951299400741.3932.207280.61093174025783.4310.253110.56167.164.4363.560.87.4464.6862.8460.350.43242.1227.71212.319.5320.54096819225.78163843276827.3510.454096819210.911.8316384327682.064096819216384327681536307261441228810.213.3219.827.3654495.35769.838936.004768.09341.33516386.06127.47292.767147.43372864.8121.69332289.581822.722928.37640.811248.6857.48920503.51415.117638.649.758.614.117635.66711242742705.8162820.6316164442.9412.98980.8513.33688.62373.02708.13703.23275.54098.5884.01.889193.745786.37153.425473.388231913.861012.1921612.04296933538.269531124.5298.0394.7775.0659.8650.4658.864678.67697.446946.43117.0679.705118.84819.2789.06726.59569.578156.71276.577259.055116.417405.448163.363551.679.24104.01211.4105.24731.39245.1297.54562280.47206839.9857538.57843177.87492.69519124613271542791141412101427766703680483296605375566370049930945600482781099305.37319.8565.194156.59818.74465.318215.213652.9650.8723.8026.4589.18818.8588.716.0610.861.8110.0410.85629.1651243571.8645095.35272035.68265949.2225379.662874011.562353677.961298373.661187839.34125.5213.237297.2268141.56819.8127762.2482.0521139.0828376.531157.0780.91631744.80024.639654.62423177.1183.917493.831524.5231823448988.5966576789.42155919710187288229304.244205.014480.368610.33920.86121.4052174760.631514937240170241.1041.740380.49771139110813.318.026968.191536.6460.8759.2755.957.0261.0959.5456.0551.86204.06185.97171.6818.8319.64096819224.27163843276825.529.924096819210.321.7616384327681.93409681921638432768153630726144122889.5212.59197.9606975.541410.28357.0607550.46981.31121487.30125.58452.654826.365641091.3222.31921569.751654.6524502.13808.81044.53935.99421153.51494.5175.338.348.256.813.517434.764911.840.772668.16.3461020.1308162464.5381.65993.4483.43349.52506.81705.53397.03244.83720.1749.91.906864.450967.873673.786293.780082422.831270.7621121.61328132715.808594154.83105.09115.7379.4171.5852.6468.171740.089108.4361369.225154.42912.273150.66823.88610.95434.91784.477154.31773.237239.078118.317398.386163.915545.967103.97141.99276.44136.51978.03320.59103.71549314.47722966.0063841.29562193.93664528.33262105670875333515781088106745540012779329481010045000881093168087590907114471409.32934.164101.332217.90829.06798.789320.184842.3441.4266.32712.08617.84532.59113.376.0711.251.829.8511.051091.01150972793.2674468.49379874.32393408.85435194.23397871.032528614.521863395.071559859.89166.04711.3551112.671203.94715.01061005.53.3865843.8436383.134122.1681.5361948.26368.515738.49097218.1817.38767.323538.4375244169926.71765175324.640531084170361164581556.043368.5451144.478218.70751.56972.5634329601.457247763444464581.8172.839130.75987235893806.8314.017114.624792.8990.0186.177.3293.2491.1286.5649.9316.8290.1289.4119.2720.234096819225.32163843276827.210.34096819210.811.8216384327682.034096819216384327681536307261441228810.1113.3219.676.0206988.06328.874444.9028566.61720.994193295.28122.80622.609748.18519650.9620.71832185.781769.5620102.89311.771165.5734.352182241337.7878.439.251.15914.117636.168212.542.765371.46.0158220.8315166441.9420.79891.4477.03582.42182.52627.33806.53232.84384.01050.31.124652.746994.038083.072192.672191320.99672.50621948.93554734053.0625105.3698.9186.0475.0656.0650.8443.167517.66484.802551.72291.7246.92684.48917.3438.17319.5558.818150.63975.893252.825116.241397.426163.805553.80555.2673.87149.3773.96514.7171.8284.68398233.68441686.8794435.91499155.13923425.5096911941484176093312001224152787780912826541698010066659164093555991350909274180309.434.414101.537218.52929.20599.445327.264845.5841.4336.39111.89717.86332.22113.166.049.191.839.9811.141093.09786772508.1374683.74382691.63394570436101.343431395.732558621.381874050.71569308.65165.76911.3166113.294203.49114.9427999.9733.3906444.051382.771122.2051.5436547.8858.571468.51233220.7997.445757.322848.47727443239201771958344.740718581.6169750165934556.412368.5734144.626218.74991.57432.569433120258676636457247941.8082.854850.75645238227754.4114.047214.6973793.9191.3186.477.3793.4990.4886.4449.76326.16324.04289.0419.2420.264096819225.3163843276827.1910.374096819210.851.8316384327682.034096819216384327681536307261441228810.1413.2419.736.0302488.36228.825814.9138166.92020.999701294.92722.69842.612218.18265647.81420.88162200.931765.3919859.49231.971175.5742.02918412.31339.6979.639.15158.814.117636.268612.242.765169.86.0158621317165411.9402.29969.8515.63641.92227.92571.23773.13442.94344.8959.31.128012.777274.048773.063412.664291320.37670.23421848.07031233913.464844104.3898.6486.275.5155.4750.6842.51517.91884.211553.78292.0216.90384.26317.5678.27920.32558.692159.24776.669253.493116.617400.399161.089554.39755.7473.55148.9773.86513.66171.2584.02813233.05316684.3866235.4262155.9745424.9466611921477175693111961222154287180712827876611010074230129093614594180910250928809.34534.66101.522217.95729.17998.905325.945835.451.4276.32212.11217.83632.23113.315.549.41.8310.329.151092.08849572140.7574672.57382067.3395112.39435926.43379343.722559245.218629381569479.7166.16811.3105113.171203.93414.88371013.193.4017843.4886380.801122.2191.5498847.67218.548788.54395220.7287.463997.315948.4964644309550.91766450267.140711986.9169373166180556.865369.0274144.613118.76611.57672.5696331193.755762702487970791.8112.837980.76227236826833.6414.043114.6226791.7190.9686.687.3794.0891.1786.9150.33337.06291.02273.6719.1620.294096819225.38163843276827.2110.344096819210.821.8616384327682.034096819216384327681536307261441228810.1713.3619.716.0163188.41048.835244.9031367.18490.986643293.96122.99232.625738.18175645.20820.97532152.481763.22196869245.761178.94730.16717824.61343.2278.138.850.759.614.217936.168912.342.463370.46.0358120.9314163455.6407.79972.0500.03589.42179.02570.53829.93408.44359.3891.21.130122.778354.03553.059182.662961320.23670.722060.15234433906.6875104.8798.3187.3474.8655.6750.7442.469517.50284.072549.891.0176.93784.31517.3648.11919.52157.18167.63176.662253.279116.222399.261161.473552.20955.1873.69149.3773.48513.54170.0984.11276232.58353684.1305635.11036154.43658424.57459118914781754929119512231547898801332808358602537612329023845653160237010927602.80810.86935.84985.94810.57837.171123.792380.6330.4432.1784.3348.00710.9156.615.710.021.79.329.92259.14649121499.7322255.23135362.96132265.65106833.782105346.651656876.39732992.32596141.19124.1667.1601573.8845141.95510.5186495.8361.0790323.8412207.60573.27070.46472336.1072.302232.29544112.721.844071.908042.2385111669425.7478992410.7107077155407943781155.441100.365939.32055.06550.42440.692384017.412630264120246820.6640.888950.2735266243705.994.430214.476438.04835139.65913.53237.0412295.06642.01609926.75641.94184.815313.64572151.8227.68912950.83173.5549048.85153.492193.881781.6418442736.9878.439.952.860.414.618236.770212.44385572.66.9372321.2330171506.5439.97465.1566.23745.82267.11664.43087.02951.14474.8806.43.831174.946899.186587.267387.536554726.082415.2532271.66601647198.941406123.6561281.082177.1442771.778300.7224.723301.59640.56218.16570.064145.21165.54796.744314.485153.029515.495212.829695.352215.53292.14560.89280.262077.69667.71187.28645581.27325236714251342412351221312018714623332895428602558237464023760535010237011383602.79310.80535.64185.60310.55437.07122.921377.7910.4412.1724.3327.98410.8956.035.689.971.719.310.16263.20439221444.0922201.03135016.23132025.36105324.922103587.51571309.62690282.02602002.02123.2697.1571273.0047140.03410.6241495.0781.0782923.9108202.11873.83640.46448538.52942.266122.27718111.4831.904811.894692.2231811518844.2475486444.110629944.85342543210154.24899.399939.03775.04480.42230.690683540.714943737116075020.6610.892410.2732066519700.764.430914.464116.5532.9731.9130.936.932.9432.5931.0451.5122.8115.67105.119.1720.084096819223.8163843276825.099.994096819210.461.7316384327681.93409681921638432768153630726144122888.0511.3816.658.10767139.71813.69557.1385794.12162.01913927.38841.81994.9463613.54172152.9225.94992994.593179.5549101.95034.382190.791785.441757.92741.6878.740.252.96014.618036.670412.443.185872.76.9773721.3331171515.8485.47147.4600.13818.52292.21669.93130.43681.94457.1801.43.828854.958679.169567.281397.553154752.852441.2732477.34960946851.421875288.64124.24217.8587.9130.4760.07130.8131282.66179.1223046.805294.95124.821302.73739.24518.2970.774146.655169.14196.554316.459154.041513.583212.528698.074214.89294.04563.14282.192095.98671.42186.22906583.20451797.862566.11323310.38181845.17240714431359414350820971998720623OpenBenchmarking.org

OpenSSL

Algorithm: ChaCha20

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: ChaCha204141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx30000M60000M90000M120000M150000M332808358603328954286068048329660939567437109390757287097105235690128278766110127793294810128265416980130588495050970198974501. OpenSSL 3.0.13 30 Jan 2024 (Library: OpenSSL 3.0.13 30 Jan 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenSSL

Algorithm: AES-128-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: AES-128-GCM4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx20000M40000M60000M80000M100000M253761232902558237464053755663700727099542207266752730076496336760100742301290100450008810100666591640104784522170761844056101. OpenSSL 3.0.13 30 Jan 2024 (Library: OpenSSL 3.0.13 30 Jan 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenSSL

Algorithm: AES-256-GCM

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: AES-256-GCM4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx20000M40000M60000M80000M100000M23845653160237605350104993094560067431535960673962543807116029187093614594180931680875909355599135097172751700709026564801. OpenSSL 3.0.13 30 Jan 2024 (Library: OpenSSL 3.0.13 30 Jan 2024) - Additional Parameters: -engine qatengine -async_jobs 8

OpenSSL

Algorithm: ChaCha20-Poly1305

OpenBenchmarking.orgbyte/s, More Is BetterOpenSSLAlgorithm: ChaCha20-Poly13054141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx20000M40000M60000M80000M100000M23701092760237011383604827810993066548747470664977394306881654402091025092880907114471409092741803092393529340686789555501. OpenSSL 3.0.13 30 Jan 2024 (Library: OpenSSL 3.0.13 30 Jan 2024) - Additional Parameters: -engine qatengine -async_jobs 8

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 3 - Input: Bosphorus 4K4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912152.8082.7935.3737.2527.2327.6849.3459.3299.4009.5907.6461. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 5 - Input: Bosphorus 4K4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx81624324010.8710.8119.8527.3627.5629.0934.6634.1634.4134.5428.821. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 8 - Input: Bosphorus 4K4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010035.8535.6465.1982.5382.1685.20101.52101.33101.54102.0185.001. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 13 - Input: Bosphorus 4K4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx5010015020025085.9585.60156.60192.17190.34198.11217.96217.91218.53212.52194.021. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 3 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 3 - Input: Bosphorus 1080p4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx71421283510.5810.5518.7424.8524.8125.4529.1829.0729.2129.5725.451. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 5 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 5 - Input: Bosphorus 1080p4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010037.1737.0765.3286.9686.3988.4298.9198.7999.45101.9788.271. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 8 - Input: Bosphorus 1080p4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70140210280350123.79122.92215.21282.01281.89287.05325.95320.18327.26339.02286.961. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 13 - Input: Bosphorus 1080p4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2004006008001000380.63377.79652.97752.16748.15776.12835.45842.34845.58842.56769.821. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 3 - Input: Beauty 4K 10-bit

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 3 - Input: Beauty 4K 10-bit4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.32240.64480.96721.28961.6120.4430.4410.8721.1291.1321.1881.4271.4261.4331.4221.1841. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 5 - Input: Beauty 4K 10-bit

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 5 - Input: Beauty 4K 10-bit4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468102.1782.1723.8025.4455.4225.6026.3226.3276.3916.5045.5511. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 8 - Input: Beauty 4K 10-bit

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 8 - Input: Beauty 4K 10-bit4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912154.3344.3326.45810.91410.88510.96712.11212.08611.89712.46810.8551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

SVT-AV1

Encoder Mode: Preset 13 - Input: Beauty 4K 10-bit

OpenBenchmarking.orgFrames Per Second, More Is BetterSVT-AV1 2.3Encoder Mode: Preset 13 - Input: Beauty 4K 10-bit4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx5101520258.0077.9849.18818.00217.94417.40617.83617.84517.86318.58817.3551. (CXX) g++ options: -march=native -mno-avx -mavx2 -mavx512f -mavx512bw -mavx512dq

x265

Video Input: Bosphorus 4K

OpenBenchmarking.orgFrames Per Second, More Is Betterx265Video Input: Bosphorus 4K4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx81624324010.9110.8918.8526.0925.8527.1632.2332.5932.2232.5726.941. x265 [info]: HEVC encoder version 3.5+1-f0c1022b6

x265

Video Input: Bosphorus 1080p

OpenBenchmarking.orgFrames Per Second, More Is Betterx265Video Input: Bosphorus 1080p4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx30609012015056.6156.0388.71101.23101.33101.37113.31113.37113.16114.45101.251. x265 [info]: HEVC encoder version 3.5+1-f0c1022b6

simdjson

Throughput Test: Kostya

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: Kostya4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468105.705.686.065.786.026.115.546.076.045.975.451. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: TopTweet

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: TopTweet4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx369121510.029.9710.8610.6610.6910.829.4011.259.1910.4610.511. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: LargeRandom

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: LargeRandom4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.4140.8281.2421.6562.071.701.711.811.811.731.841.831.821.831.831.841. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: PartialTweets

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: PartialTweets4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912159.329.3010.049.809.6310.1010.329.859.989.768.351. (CXX) g++ options: -O3 -lrt

simdjson

Throughput Test: DistinctUserID

OpenBenchmarking.orgGB/s, More Is Bettersimdjson 3.10Throughput Test: DistinctUserID4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912159.9210.1610.8510.5410.2810.769.1511.0511.1410.468.971. (CXX) g++ options: -O3 -lrt

ACES DGEMM

Sustained Floating-Point Rate

OpenBenchmarking.orgGFLOP/s, More Is BetterACES DGEMM 1.0Sustained Floating-Point Rate4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2004006008001000259.15263.20629.17818.68812.15842.731092.091091.011093.101141.19842.011. (CC) gcc options: -ffast-math -mavx2 -O3 -fopenmp -lopenblas

Rustls

Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS13_CHACHA20_POLY1305_SHA2564141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx16K32K48K64K80K21499.7321444.0943571.8656047.3856176.9057716.6472140.7572793.2672508.1376454.4557688.081. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA2564141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx20K40K60K80K100K22255.2322201.0345095.3557954.1958056.0159308.7574672.5774468.4974683.7480462.6059206.341. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS13_CHACHA20_POLY1305_SHA2564141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx80K160K240K320K400K135362.96135016.23272035.68328877.92326342.42333882.92382067.30379874.32382691.63388077.69333574.301. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS13_CHACHA20_POLY1305_SHA2564141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx90K180K270K360K450K132265.65132025.36265949.20336267.09335411.96344296.24395112.39393408.85394570.00404263.45342775.291. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA3844141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx90K180K270K360K450K106833.78105324.92225379.66301017.23301217.61306153.20435926.40435194.20436101.34423535.68304060.281. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA2564141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx800K1600K2400K3200K4000K2105346.652103587.502874011.563061522.263082657.503035330.213379343.723397871.033431395.733563852.573038723.481. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA2564141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx600K1200K1800K2400K3000K1656876.391571309.622353677.962283083.542304145.792282729.642559245.202528614.522558621.382620332.002292879.441. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-resume - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA3844141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx400K800K1200K1600K2000K732992.32690282.021298373.661543373.121532788.041586292.421862938.001863395.071874050.701820810.211572010.681. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

Rustls

Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA384

OpenBenchmarking.orghandshakes/s, More Is BetterRustls 0.23.17Benchmark: handshake-ticket - Suite: TLS_ECDHE_ECDSA_WITH_AES_256_GCM_SHA3844141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx300K600K900K1200K1500K596141.19602002.021187839.341297646.721300937.301329363.101569479.701559859.891569308.651553632.141340712.851. (CC) gcc options: -m64 -lgcc_s -lutil -lrt -lpthread -lm -ldl -lc -pie -nodefaultlibs

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: GPT-2 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4080120160200124.17123.27125.52136.30135.72159.71166.17166.05165.77134.60157.891. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: yolov4 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912157.160157.1571213.2372010.4982010.4865010.7338011.3105011.3551011.3166011.0552010.712701. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ZFNet-512 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ZFNet-512 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx30609012015073.8873.0097.23101.41101.62110.94113.17112.67113.29102.33110.891. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: T5 Encoder - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx50100150200250141.96140.03141.57168.04166.51208.17203.93203.95203.49156.45206.091. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: bertsquad-12 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx51015202510.5210.6219.8114.6914.6914.5114.8815.0114.9415.5914.571. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2004006008001000495.84495.08762.25724.53748.66941.401013.191005.50999.97636.32937.781. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: fcn-resnet101-11 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.76541.53082.29623.06163.8271.079031.078292.052112.586882.590252.810933.401783.386583.390643.216702.796381. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx102030405023.8423.9139.0836.1236.4037.3843.4943.8444.0542.4537.101. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx80160240320400207.61202.12376.53360.35361.30356.41380.80383.13382.77390.60356.191. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: super-resolution-10 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx30609012015073.2773.84157.08134.94134.52125.17122.22122.17122.21141.12125.081. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.34870.69741.04611.39481.74350.4647230.4644850.9163171.1458101.1563201.1762701.5498801.5361901.5436501.5419601.1705001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInferences Per Second, More Is BetterONNX Runtime 1.19Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx112233445536.1138.5344.8046.3546.0940.0947.6748.2647.8947.0743.361. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

OSPRay

Benchmark: particle_volume/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: particle_volume/ao/real_time4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912152.302232.266124.639656.288076.292116.527768.548788.515738.571469.009176.52206

OSPRay

Benchmark: particle_volume/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: particle_volume/scivis/real_time4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912152.295442.277184.624236.296156.271886.449138.543958.490978.512338.984866.52304

OSPRay

Benchmark: particle_volume/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: particle_volume/pathtracer/real_time4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx50100150200250112.72111.48177.12199.51199.55199.02220.73218.18220.80236.25197.20

OSPRay

Benchmark: gravity_spheres_volume/dim_512/ao/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/ao/real_time4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468101.844071.904813.917495.470435.470575.631227.463997.387607.445757.639445.71084

OSPRay

Benchmark: gravity_spheres_volume/dim_512/scivis/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/scivis/real_time4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468101.908041.894693.831525.357565.361895.548887.315947.323537.322847.587895.61470

OSPRay

Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time

OpenBenchmarking.orgItems Per Second, More Is BetterOSPRay 3.2Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468102.238512.223184.523186.173996.176246.411988.496468.437528.477278.820936.40740

BYTE Unix Benchmark

Computational Test: Pipe

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 5.1.3-gitComputational Test: Pipe4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx10M20M30M40M50M11669425.711518844.223448988.532471450.732439611.633443359.244309550.944169926.744323920.048806257.133381363.11. (CC) gcc options: -pedantic -O3 -ffast-math -march=native -mtune=native -lm

BYTE Unix Benchmark

Computational Test: Dhrystone 2

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 5.1.3-gitComputational Test: Dhrystone 24141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx400M800M1200M1600M2000M478992410.7475486444.1966576789.41272938788.01263644317.81346521770.31766450267.11765175324.61771958344.71866536062.71340340196.61. (CC) gcc options: -pedantic -O3 -ffast-math -march=native -mtune=native -lm

BYTE Unix Benchmark

Computational Test: System Call

OpenBenchmarking.orgLPS, More Is BetterBYTE Unix Benchmark 5.1.3-gitComputational Test: System Call4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx11M22M33M44M55M10707715.010629944.821559197.029969810.929923094.430761218.940711986.940531084.040718581.649140426.630701622.81. (CC) gcc options: -pedantic -O3 -ffast-math -march=native -mtune=native -lm

7-Zip Compression

Test: Compression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip CompressionTest: Compression Rating4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx40K80K120K160K200K54079534251018721350331338041412631693731703611697501638591422131. 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20

7-Zip Compression

Test: Decompression Rating

OpenBenchmarking.orgMIPS, More Is Better7-Zip CompressionTest: Decompression Rating4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx40K80K120K160K200K4378143210882291185691185871256981661801645811659341659161256051. 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20

Etcpak

Benchmark: Multi-Threaded - Configuration: ETC2

OpenBenchmarking.orgMpx/s, More Is BetterEtcpak 2.0Benchmark: Multi-Threaded - Configuration: ETC24141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx120240360480600155.44154.25304.24388.40388.13410.73556.87556.04556.41577.82409.881. (CXX) g++ options: -flto -pthread

ASTC Encoder

Preset: Fast

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: Fast4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx90180270360450100.3799.40205.01263.55263.37278.24369.03368.55368.57396.65277.301. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Medium

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: Medium4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx30609012015039.3239.0480.37103.81103.67109.03144.61144.48144.63156.22108.861. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: Thorough4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx5101520255.06555.044810.339213.523013.513914.170018.766118.707518.749920.302514.14641. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Exhaustive

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: Exhaustive4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.3790.7581.1371.5161.8950.42440.42230.86121.13651.13681.18871.57671.56971.57431.68441.18621. (CXX) g++ options: -O3 -flto -pthread

ASTC Encoder

Preset: Very Thorough

OpenBenchmarking.orgMT/s, More Is BetterASTC Encoder 5.0Preset: Very Thorough4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.61671.23341.85012.46683.08350.69230.69061.40521.85461.85591.94122.56962.56342.56942.74101.93911. (CXX) g++ options: -O3 -flto -pthread

BYTE Unix Benchmark

Computational Test: Whetstone Double

OpenBenchmarking.orgMWIPS, More Is BetterBYTE Unix Benchmark 5.1.3-gitComputational Test: Whetstone Double4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70K140K210K280K350K84017.483540.7174760.6242679.0242340.5244075.3331193.7329601.4331202.0343491.9244131.01. (CC) gcc options: -pedantic -O3 -ffast-math -march=native -mtune=native -lm

Stockfish

Chess Benchmark

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfish 17Chess Benchmark4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx13M26M39M52M65M12630264149437373151493743158853420429514526754655762702572477635867663654752796429733961. (CXX) g++ options: -lgcov -m64 -lpthread -fno-exceptions -std=c++17 -fno-peel-loops -fno-tracer -pedantic -O3 -funroll-loops -msse -msse3 -mpopcnt -mavx2 -mbmi -mavx512f -mavx512bw -mavx512vnni -mavx512dq -mavx512vl -msse4.1 -mssse3 -msse2 -mbmi2 -flto -flto-partition=one -flto=jobserver

Stockfish

Chess Benchmark

OpenBenchmarking.orgNodes Per Second, More Is BetterStockfishChess Benchmark4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx10M20M30M40M50M12024682116075022401702430315972299400743370229848797079444464584572479446507038338715951. Stockfish 16 by the Stockfish developers (see AUTHORS file)

GROMACS

Input: water_GMX50_bare

OpenBenchmarking.orgNs Per Day, More Is BetterGROMACSInput: water_GMX50_bare4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.40880.81761.22641.63522.0440.6640.6611.1041.3981.3931.5771.8111.8171.8081.6921.5751. GROMACS version: 2023.3-Ubuntu_2023.3_1ubuntu3

NAMD

Input: ATPase with 327,506 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0Input: ATPase with 327,506 Atoms4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.64231.28461.92692.56923.21150.888950.892411.740382.216452.207282.381242.837982.839132.854852.796322.35379

NAMD

Input: STMV with 1,066,628 Atoms

OpenBenchmarking.orgns/day, More Is BetterNAMD 3.0Input: STMV with 1,066,628 Atoms4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.17150.3430.51450.6860.85750.273520.273200.497710.614520.610930.651190.762270.759870.756450.756560.65448

Apache Cassandra

Test: Writes

OpenBenchmarking.orgOp/s, More Is BetterApache Cassandra 5.0Test: Writes4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx60K120K180K240K300K6624366519139110173633174025174960236826235893238227271333173946

Numpy Benchmark

OpenBenchmarking.orgScore, More Is BetterNumpy Benchmark4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2004006008001000705.99700.76813.31781.66783.43745.59833.64806.83754.41775.75831.42

QuantLib

Size: S

OpenBenchmarking.orgtasks/s, More Is BetterQuantLib 1.35-devSize: S4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx481216204.430214.430918.0269610.2873010.2531011.8647014.0431014.0171014.0472012.7476011.839001. (CXX) g++ options: -O3 -march=native -fPIE -pie

QuantLib

Size: XXS

OpenBenchmarking.orgtasks/s, More Is BetterQuantLib 1.35-devSize: XXS4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx481216204.476434.464118.1915310.5788010.5616012.1169014.6226014.6240014.6973013.4320012.105701. (CXX) g++ options: -O3 -march=native -fPIE -pie

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Text Generation 12841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468106.556.647.097.107.117.007.007.006.887.121. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 51241 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010032.9760.8764.9664.4369.1191.7192.8993.9170.7667.951. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 102441 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010031.9159.2763.7163.5066.5790.9690.0191.3170.8566.351. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Llama-3.1-Tulu-3-8B-Q8_0 - Test: Prompt Processing 204841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010030.9355.9560.6860.8063.8086.6886.1786.4763.0963.791. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Text Generation 12841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468106.907.027.427.447.417.377.327.377.247.441. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 51241 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010032.9461.0965.2464.6868.2094.0893.2493.4968.4068.811. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 102441 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010032.5959.5464.1562.8466.8591.1791.1290.4869.2666.521. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: Mistral-7B-Instruct-v0.3-Q8_0 - Test: Prompt Processing 204841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010031.0456.0560.4760.3063.6186.9186.5686.4462.9763.411. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Text Generation 12841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx122436486051.5051.8650.5050.4352.3050.3349.9049.7647.7252.371. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 51241 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70140210280350122.80204.06235.94242.10243.14337.06316.80326.16327.30232.861. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 102441 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx80160240320400115.67185.97235.01227.71232.26291.02290.10324.04355.09244.771. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llama.cpp

Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlama.cpp b4154Backend: CPU BLAS - Model: granite-3.0-3b-a800m-instruct-Q8_0 - Test: Prompt Processing 204841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx60120180240300105.10171.68213.02212.30222.75273.67289.41289.04279.04208.991. (CXX) g++ options: -std=c++11 -fPIC -O3 -pthread -fopenmp -march=native -mtune=native -lopenblas

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 1641 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx51015202519.1718.8319.4719.5319.4919.1619.2719.2419.0319.50

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Text Generation 12841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx51015202520.0819.6020.4820.5020.3920.2920.2320.2620.1320.51

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 25641 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx90018002700360045004096409640964096409640964096409640964096

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 51241 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2K4K6K8K10K8192819281928192819281928192819281928192

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 1641 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx61218243023.8024.2725.7725.7825.8625.3825.3225.3024.5925.94

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 102441 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4K8K12K16K20K16384163841638416384163841638416384163841638416384

Llamafile

Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: Llama-3.2-3B-Instruct.Q6_K - Test: Prompt Processing 204841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx7K14K21K28K35K32768327683276832768327683276832768327683276832768

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Text Generation 12841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx71421283525.0925.5227.3627.3527.5927.2127.2027.1926.2827.80

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 1641 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912159.999.9210.4810.4510.4510.3410.3010.3710.2210.45

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 25641 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx90018002700360045004096409640964096409640964096409640964096

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 51241 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2K4K6K8K10K8192819281928192819281928192819281928192

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Text Generation 12841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx369121510.4610.3210.9310.9110.9110.8210.8110.8510.4710.93

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 16

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 1641 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.41850.8371.25551.6742.09251.731.761.831.831.831.861.821.831.781.84

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 102441 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4K8K12K16K20K16384163841638416384163841638416384163841638416384

Llamafile

Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: TinyLlama-1.1B-Chat-v1.0.BF16 - Test: Prompt Processing 204841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx7K14K21K28K35K32768327683276832768327683276832768327683276832768

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 128

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Text Generation 12841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.46350.9271.39051.8542.31751.931.932.052.062.052.032.032.031.992.05

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 25641 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx90018002700360045004096409640964096409640964096409640964096

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 51241 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2K4K6K8K10K8192819281928192819281928192819281928192

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 102441 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4K8K12K16K20K16384163841638416384163841638416384163841638416384

Llamafile

Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: mistral-7b-instruct-v0.2.Q5_K_M - Test: Prompt Processing 204841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx7K14K21K28K35K32768327683276832768327683276832768327683276832768

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 256

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 25641 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx300600900120015001536153615361536153615361536153615361536

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 512

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 51241 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70014002100280035003072307230723072307230723072307230723072

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 1024

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 102441 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx130026003900520065006144614461446144614461446144614461446144

Llamafile

Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 2048

OpenBenchmarking.orgTokens Per Second, More Is BetterLlamafile 0.8.16Model: wizardcoder-python-34b-v1.0.Q6_K - Test: Prompt Processing 204841 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx3K6K9K12K15K12288122881228812288122881228812288122881228812288

OpenVINO GenAI

Model: Gemma-7b-int4-ov - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912158.059.5210.1710.2010.2310.1710.1110.149.8310.24

OpenVINO GenAI

Model: Falcon-7b-instruct-int4-ov - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx369121511.3812.5913.3413.3213.4013.3613.3213.2412.9313.41

OpenVINO GenAI

Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU

OpenBenchmarking.orgtokens/s, More Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx51015202516.6519.0019.8219.8220.2819.7119.6719.7319.2820.29

ONNX Runtime

Model: GPT-2 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: GPT-2 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468108.048358.107677.960697.333317.365446.258156.016316.020696.030247.427766.330341. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: yolov4 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: yolov4 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx306090120150139.66139.7275.5495.2595.3693.1688.4188.0688.3690.4593.341. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ZFNet-512 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ZFNet-512 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4812162013.5323013.6955010.283509.858969.838939.013228.835248.874448.825819.769859.016871. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: T5 Encoder - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: T5 Encoder - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468107.041227.138577.060755.950356.004704.802874.903134.902854.913816.391124.851421. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: bertsquad-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: bertsquad-12 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010095.0794.1250.4768.0868.0968.9167.1866.6266.9264.1468.611. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: CaffeNet 12-int8 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.45430.90861.36291.81722.27152.0160902.0191301.3112101.3797001.3351601.0618800.9866430.9941930.9997011.5708401.0660001. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: fcn-resnet101-11 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: fcn-resnet101-11 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2004006008001000926.76927.39487.30386.56386.06355.75293.96295.28294.93310.88357.601. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ArcFace ResNet-100 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx102030405041.9441.8225.5827.6827.4726.7522.9922.8122.7023.5526.951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx1.11292.22583.33874.45165.56454.815304.946362.654822.774222.767142.805442.625732.609742.612212.558982.806951. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: super-resolution-10 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: super-resolution-10 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4812162013.6457013.541706.365647.410377.433727.988738.181758.185198.182657.086017.994861. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: ResNet101_DUC_HDC-12 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx50010001500200025002151.822152.921091.32872.74864.81850.14645.21650.96647.81648.52854.331. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

ONNX Runtime

Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard

OpenBenchmarking.orgInference Time Cost (ms), Fewer Is BetterONNX Runtime 1.19Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx71421283527.6925.9522.3221.5721.6924.9420.9820.7220.8821.2423.061. (CXX) g++ options: -O3 -march=native -ffunction-sections -fdata-sections -mtune=native -flto=auto -fno-fat-lto-objects -ldl -lrt

LiteRT

Model: DeepLab V3

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: DeepLab V34141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx80016002400320040002950.802994.591569.752272.282289.582343.382152.482185.782200.933579.672359.99

LiteRT

Model: SqueezeNet

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: SqueezeNet4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70014002100280035003173.553179.551654.651820.341822.701809.181763.221769.561765.391794.111821.35

LiteRT

Model: Inception V4

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Inception V44141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx11K22K33K44K55K49048.849101.924502.123141.422928.322083.319686.020102.819859.421477.822752.4

LiteRT

Model: NASNet Mobile

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: NASNet Mobile4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4K8K12K16K20K5153.495034.383808.807759.697640.818057.569245.769311.779231.9716936.007931.64

LiteRT

Model: Mobilenet Float

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Mobilenet Float4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx50010001500200025002193.882190.791044.531248.121248.601244.701178.941165.501175.501211.481244.51

LiteRT

Model: Mobilenet Quant

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Mobilenet Quant4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4008001200160020001781.601785.40935.99859.76857.49848.94730.17734.35742.03823.17849.21

LiteRT

Model: Inception ResNet V2

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Inception ResNet V24141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx9K18K27K36K45K41844.041757.921153.520123.520503.519477.817824.618224.018412.319530.219490.7

LiteRT

Model: Quantized COCO SSD MobileNet v1

OpenBenchmarking.orgMicroseconds, Fewer Is BetterLiteRT 2024-10-15Model: Quantized COCO SSD MobileNet v14141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx60012001800240030002736.982741.681494.511431.191415.111420.151343.221337.781339.692129.521417.35

PyPerformance

Benchmark: go

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: go4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010078.478.775.378.376.078.678.178.479.677.879.4

PyPerformance

Benchmark: chaos

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: chaos4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx91827364539.940.238.339.038.639.738.839.239.138.239.4

PyPerformance

Benchmark: float

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: float4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx122436486052.852.948.249.749.751.350.751.151.050.750.8

PyPerformance

Benchmark: nbody

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: nbody4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx142842567060.460.056.857.258.659.559.659.058.859.059.2

PyPerformance

Benchmark: pathlib

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: pathlib4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4812162014.614.613.514.114.114.414.214.114.114.214.4

PyPerformance

Benchmark: raytrace

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: raytrace4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4080120160200182180174177176182179176176175182

PyPerformance

Benchmark: xml_etree

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: xml_etree4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx81624324036.736.634.735.335.636.836.136.136.235.836.5

PyPerformance

Benchmark: gc_collect

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: gc_collect4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx150300450600750702704649671671699689682686677706

PyPerformance

Benchmark: json_loads

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: json_loads4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx369121512.412.411.812.012.012.412.312.512.212.112.5

PyPerformance

Benchmark: crypto_pyaes

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: crypto_pyaes4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx102030405043.043.140.741.842.043.142.442.742.741.743.3

PyPerformance

Benchmark: async_tree_io

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: async_tree_io4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2004006008001000855858726738742666633653651755656

PyPerformance

Benchmark: regex_compile

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: regex_compile4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx163248648072.672.768.169.570.071.770.471.469.869.872.5

PyPerformance

Benchmark: python_startup

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: python_startup4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468106.936.976.345.805.816.086.036.016.015.776.09

PyPerformance

Benchmark: asyncio_tcp_ssl

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: asyncio_tcp_ssl4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx160320480640800723737610626628590581582586645590

PyPerformance

Benchmark: django_template

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: django_template4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx51015202521.221.320.120.620.621.020.920.821.020.721.2

PyPerformance

Benchmark: asyncio_websockets

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: asyncio_websockets4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70140210280350330331308315316321314315317315322

PyPerformance

Benchmark: pickle_pure_python

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.11Benchmark: pickle_pure_python4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4080120160200171171162164164169163166165165168

Renaissance

Test: Scala Dotty

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Scala Dotty4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx110220330440550506.5515.8464.5424.6442.9428.6455.6441.9411.9477.0436.2MIN: 420.76 / MAX: 1038.72MIN: 426.08 / MAX: 1026.55MIN: 358.07 / MAX: 790.35MIN: 376.26 / MAX: 659.55MIN: 376.04 / MAX: 787.17MIN: 378.22 / MAX: 628.77MIN: 394.05 / MAX: 695.67MIN: 387.7 / MAX: 646.01MIN: 362.36 / MAX: 713.71MIN: 371.54 / MAX: 736.5MIN: 380.62 / MAX: 721.56

Renaissance

Test: Random Forest

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Random Forest4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx110220330440550439.9485.4381.6415.3412.9422.0407.7420.7402.2414.4453.2MIN: 388.86 / MAX: 516.9MIN: 403.24 / MAX: 525.59MIN: 332.96 / MAX: 445.77MIN: 342.21 / MAX: 486.26MIN: 342.95 / MAX: 473.15MIN: 357.91 / MAX: 497.55MIN: 337.66 / MAX: 471.92MIN: 339.2 / MAX: 478.26MIN: 343.06 / MAX: 486.63MIN: 322.79 / MAX: 466.1MIN: 352.31 / MAX: 513.31

Renaissance

Test: ALS Movie Lens

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: ALS Movie Lens4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2K4K6K8K10K7465.17147.45993.49243.08980.89378.89972.09891.49969.89805.79275.7MIN: 6716.72 / MAX: 7815.35MIN: 6653.82 / MAX: 7863.42MIN: 5836.57 / MAX: 6535.35MIN: 8920.42 / MAX: 9406.46MIN: 8480.95 / MAX: 9113.57MIN: 8718.36 / MAX: 9413.7MIN: 9479.38 / MAX: 10040.33MIN: 9364.27 / MAX: 10037.94MIN: 9680.91 / MAX: 9983.16MIN: 9253.4 / MAX: 10057.61MIN: 8821.09 / MAX: 9495.91

Renaissance

Test: Apache Spark Bayes

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark Bayes4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx130260390520650566.2600.1483.4515.3513.3513.2500.0477.0515.6490.0474.9MIN: 493.35 / MAX: 1029.04MIN: 506.71 / MAX: 741.31MIN: 456.88 / MAX: 535.94MIN: 456.38 / MAX: 531.31MIN: 455.04 / MAX: 535.53MIN: 453.66 / MAX: 554.7MIN: 457.03 / MAX: 581.14MIN: 460.78 / MAX: 515.59MIN: 459.35 / MAX: 536.06MIN: 459.29 / MAX: 580.9MIN: 454.77 / MAX: 514.32

Renaissance

Test: Savina Reactors.IO

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Savina Reactors.IO4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx80016002400320040003745.83818.53349.53523.13688.63655.83589.43582.43641.93506.43676.0MIN: 3745.79 / MAX: 4547.1MAX: 4702.95MIN: 3349.49 / MAX: 4130.17MIN: 3523.09 / MAX: 4370.41MAX: 4840.82MIN: 3655.76 / MAX: 4484.97MAX: 4472.27MIN: 3582.35 / MAX: 4689.63MAX: 4585.77MIN: 3506.38 / MAX: 4329.37MAX: 4536.84

Renaissance

Test: Apache Spark PageRank

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Apache Spark PageRank4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx50010001500200025002267.12292.22506.82366.12373.02138.12179.02182.52227.92412.22229.7MIN: 2117.39 / MAX: 2335.98MIN: 2106.39 / MAX: 2374.31MIN: 1771.47MIN: 1667.92 / MAX: 2366.13MIN: 1684.52MIN: 1499.64MIN: 1591.55 / MAX: 2179.02MIN: 1564.17MIN: 1592.13 / MAX: 2227.91MIN: 1691.04MIN: 1612.96 / MAX: 2229.74

Renaissance

Test: Finagle HTTP Requests

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Finagle HTTP Requests4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx60012001800240030001664.41669.91705.52650.92708.12492.22570.52627.32571.22319.42483.1MIN: 1625.17 / MAX: 1776.68MIN: 1612.75 / MAX: 1713.57MIN: 1676.49 / MAX: 1730.57MIN: 2066.79MIN: 2074.84 / MAX: 2708.11MIN: 1947.63MIN: 1960.33 / MAX: 2570.51MIN: 2034.59 / MAX: 2627.31MIN: 1999.64MIN: 1832.84MIN: 1933.43

Renaissance

Test: Gaussian Mixture Model

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Gaussian Mixture Model4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx80016002400320040003087.03130.43397.03647.23703.23860.63829.93806.53773.13399.53815.2MIN: 2935.02 / MAX: 3439.02MIN: 2997.45 / MAX: 3481.57MIN: 2497.54 / MAX: 3397.03MIN: 2576.86 / MAX: 3647.22MIN: 2648.51 / MAX: 3703.23MIN: 2758.89 / MAX: 3860.61MIN: 2792.29MIN: 2770.53 / MAX: 3806.52MIN: 2755.26 / MAX: 3773.12MIN: 2471.52MIN: 2749.56 / MAX: 3815.24

Renaissance

Test: In-Memory Database Shootout

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: In-Memory Database Shootout4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx80016002400320040002951.13681.93244.83288.53275.53241.53408.43232.83442.93256.13175.6MIN: 2787.28 / MAX: 3070.94MIN: 2559.5MIN: 2350.89MIN: 2991.78 / MAX: 3586.63MIN: 3012.8 / MAX: 3533.02MIN: 3037.03 / MAX: 3491.91MIN: 3187.55 / MAX: 3638.98MIN: 3057.86 / MAX: 3585.74MIN: 3258.62 / MAX: 3709.4MIN: 3019.89 / MAX: 3599.5MIN: 2896.06 / MAX: 3367.44

Renaissance

Test: Akka Unbalanced Cobwebbed Tree

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Akka Unbalanced Cobwebbed Tree4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx100020003000400050004474.84457.13720.14084.64098.54038.44359.34384.04344.84403.84002.3MIN: 4474.77 / MAX: 5751.45MIN: 4457.08 / MAX: 5796.57MIN: 3720.09 / MAX: 4686.78MAX: 5256.95MIN: 4098.48 / MAX: 5163.21MIN: 4038.36 / MAX: 5089.28MIN: 4359.25 / MAX: 5618.71MIN: 4383.98 / MAX: 5691.67MAX: 5622.35MAX: 5719.11MIN: 4002.27 / MAX: 4983.72

Renaissance

Test: Genetic Algorithm Using Jenetics + Futures

OpenBenchmarking.orgms, Fewer Is BetterRenaissance 0.16Test: Genetic Algorithm Using Jenetics + Futures4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2004006008001000806.4801.4749.9924.5884.0904.0891.21050.3959.3732.8920.7MIN: 786.25 / MAX: 832.34MIN: 786.46 / MAX: 836.72MIN: 737.7 / MAX: 777.92MIN: 821.03MIN: 863.46 / MAX: 897.46MIN: 886.83 / MAX: 919.31MIN: 861.29 / MAX: 903.79MIN: 1016.46 / MAX: 1068.02MIN: 844.95MIN: 713.67 / MAX: 813.49MIN: 888.75 / MAX: 934.44

oneDNN

Harness: IP Shapes 1D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: IP Shapes 1D - Engine: CPU4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx0.8621.7242.5863.4484.313.831173.828851.906861.887311.889191.938061.130121.124651.128011.125731.93913MIN: 3.77MIN: 3.77MIN: 1.86MIN: 1.83MIN: 1.83MIN: 1.92MIN: 1.1MIN: 1.09MIN: 1.1MIN: 1.03MIN: 1.911. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: IP Shapes 3D - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: IP Shapes 3D - Engine: CPU4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx1.11572.23143.34714.46285.57854.946894.958674.450963.750033.745782.730722.778352.746992.777274.058002.72942MIN: 4.85MIN: 4.87MIN: 4.38MIN: 3.71MIN: 3.71MIN: 2.7MIN: 2.74MIN: 2.72MIN: 2.75MIN: 3.75MIN: 2.71. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Convolution Batch Shapes Auto - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Convolution Batch Shapes Auto - Engine: CPU4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx36912159.186589.169567.873676.364756.371504.115514.035504.038084.048776.672874.13321MIN: 9.06MIN: 9.03MIN: 7.77MIN: 6.28MIN: 6.28MIN: 4.05MIN: 3.98MIN: 3.98MIN: 3.99MIN: 6.2MIN: 4.071. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_1d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Deconvolution Batch shapes_1d - Engine: CPU4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468107.267387.281393.786293.432873.425473.402933.059183.072193.063412.976123.40628MIN: 6.92MIN: 6.94MIN: 3.55MIN: 2.96MIN: 2.9MIN: 3.03MIN: 2.56MIN: 2.59MIN: 2.58MIN: 2.42MIN: 3.031. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Deconvolution Batch shapes_3d - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Deconvolution Batch shapes_3d - Engine: CPU4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2468107.536557.553153.780083.389583.388233.508402.662962.672192.664292.412943.51243MIN: 7.53MIN: 7.52MIN: 3.64MIN: 3.28MIN: 3.28MIN: 3.46MIN: 2.62MIN: 2.62MIN: 2.62MIN: 2.34MIN: 3.471. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Recurrent Neural Network Training - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Recurrent Neural Network Training - Engine: CPU4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx100020003000400050004726.084752.852422.831911.441913.861898.361320.231320.991320.371372.031895.68MIN: 4716.28MIN: 4746.78MIN: 2416.25MIN: 1895MIN: 1899.63MIN: 1894.26MIN: 1302.81MIN: 1308.56MIN: 1301.96MIN: 1342.06MIN: 1892.591. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

oneDNN

Harness: Recurrent Neural Network Inference - Engine: CPU

OpenBenchmarking.orgms, Fewer Is BetteroneDNN 3.6Harness: Recurrent Neural Network Inference - Engine: CPU4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx50010001500200025002415.252441.271270.761009.581012.19965.02670.70672.51670.23700.86966.01MIN: 2406.21MIN: 2435.83MIN: 1266.25MIN: 994.85MIN: 999.17MIN: 963.27MIN: 662.66MIN: 665.03MIN: 663.39MIN: 679.89MIN: 963.431. (CXX) g++ options: -O3 -march=native -fopenmp -msse4.1 -fPIC -fcf-protection=full -pie -ldl

FinanceBench

Benchmark: Repo OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Repo OpenMP4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx7K14K21K28K35K32271.6732477.3521121.6121588.9121612.0422320.3322060.1521948.9421848.0721418.4522318.741. (CXX) g++ options: -O3 -march=native -fopenmp

FinanceBench

Benchmark: Bonds OpenMP

OpenBenchmarking.orgms, Fewer Is BetterFinanceBench 2016-07-25Benchmark: Bonds OpenMP4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx10K20K30K40K50K47198.9446851.4232715.8133551.5233538.2734600.7733906.6934053.0633913.4633061.2234896.841. (CXX) g++ options: -O3 -march=native -fopenmp

OpenVINO GenAI

Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time To First Token41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx60120180240300288.64154.83124.38124.52121.48104.87105.36104.38106.62122.30

OpenVINO GenAI

Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Gemma-7b-int4-ov - Device: CPU - Time Per Output Token41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx306090120150124.24105.0998.3398.0397.7998.3198.9198.64101.7297.61

OpenVINO GenAI

Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time To First Token41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx50100150200250217.85115.7393.0094.7793.0187.3486.0486.2086.0693.00

OpenVINO GenAI

Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Falcon-7b-instruct-int4-ov - Device: CPU - Time Per Output Token41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010087.9079.4174.9475.0674.6574.8675.0675.5177.3474.54

OpenVINO GenAI

Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time To First Token41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx306090120150130.4771.5859.8759.8658.9155.6756.0655.4755.9358.86

OpenVINO GenAI

Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token

OpenBenchmarking.orgms, Fewer Is BetterOpenVINO GenAI 2024.5Model: Phi-3-mini-128k-instruct-int4-ov - Device: CPU - Time Per Output Token41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx132639526560.0752.6450.4550.4649.3150.7450.8450.6851.8649.28

CP2K Molecular Dynamics

Input: H20-64

OpenBenchmarking.orgSeconds, Fewer Is BetterCP2K Molecular Dynamics 2024.3Input: H20-644141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx306090120150123.66130.8168.1758.4058.8653.0142.4743.1742.5158.1952.721. (F9X) gfortran options: -fopenmp -march=native -mtune=native -O3 -funroll-loops -fbacktrace -ffree-form -fimplicit-none -std=f2008 -lcp2kstart -lcp2kmc -lcp2kswarm -lcp2kmotion -lcp2kthermostat -lcp2kemd -lcp2ktmc -lcp2kmain -lcp2kdbt -lcp2ktas -lcp2kgrid -lcp2kgriddgemm -lcp2kgridcpu -lcp2kgridref -lcp2kgridcommon -ldbcsrarnoldi -ldbcsrx -lcp2kdbx -lcp2kdbm -lcp2kshg_int -lcp2keri_mme -lcp2kminimax -lcp2khfxbase -lcp2ksubsys -lcp2kxc -lcp2kao -lcp2kpw_env -lcp2kinput -lcp2kpw -lcp2kgpu -lcp2kfft -lcp2kfpga -lcp2kfm -lcp2kcommon -lcp2koffload -lcp2kmpiwrap -lcp2kbase -ldbcsr -lsirius -lspla -lspfft -lsymspg -lvdwxc -l:libhdf5_fortran.a -l:libhdf5.a -lz -lgsl -lelpa_openmp -lcosma -lcosta -lscalapack -lxsmmf -lxsmm -ldl -lpthread -llibgrpp -lxcf03 -lxc -lint2 -lfftw3_mpi -lfftw3 -lfftw3_omp -lmpi_cxx -lmpi -l:libopenblas.a -lvori -lstdc++ -lmpi_usempif08 -lmpi_mpifh -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm

CP2K Molecular Dynamics

Input: H20-256

OpenBenchmarking.orgSeconds, Fewer Is BetterCP2K Molecular Dynamics 2024.3Input: H20-2564141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx300600900120015001281.081282.66740.09676.74678.68628.10517.50517.66517.92592.86631.311. (F9X) gfortran options: -fopenmp -march=native -mtune=native -O3 -funroll-loops -fbacktrace -ffree-form -fimplicit-none -std=f2008 -lcp2kstart -lcp2kmc -lcp2kswarm -lcp2kmotion -lcp2kthermostat -lcp2kemd -lcp2ktmc -lcp2kmain -lcp2kdbt -lcp2ktas -lcp2kgrid -lcp2kgriddgemm -lcp2kgridcpu -lcp2kgridref -lcp2kgridcommon -ldbcsrarnoldi -ldbcsrx -lcp2kdbx -lcp2kdbm -lcp2kshg_int -lcp2keri_mme -lcp2kminimax -lcp2khfxbase -lcp2ksubsys -lcp2kxc -lcp2kao -lcp2kpw_env -lcp2kinput -lcp2kpw -lcp2kgpu -lcp2kfft -lcp2kfpga -lcp2kfm -lcp2kcommon -lcp2koffload -lcp2kmpiwrap -lcp2kbase -ldbcsr -lsirius -lspla -lspfft -lsymspg -lvdwxc -l:libhdf5_fortran.a -l:libhdf5.a -lz -lgsl -lelpa_openmp -lcosma -lcosta -lscalapack -lxsmmf -lxsmm -ldl -lpthread -llibgrpp -lxcf03 -lxc -lint2 -lfftw3_mpi -lfftw3 -lfftw3_omp -lmpi_cxx -lmpi -l:libopenblas.a -lvori -lstdc++ -lmpi_usempif08 -lmpi_mpifh -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm

CP2K Molecular Dynamics

Input: Fayalite-FIST

OpenBenchmarking.orgSeconds, Fewer Is BetterCP2K Molecular Dynamics 2024.3Input: Fayalite-FIST4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4080120160200177.14179.12108.44100.4997.4592.2184.0784.8084.2194.0394.901. (F9X) gfortran options: -fopenmp -march=native -mtune=native -O3 -funroll-loops -fbacktrace -ffree-form -fimplicit-none -std=f2008 -lcp2kstart -lcp2kmc -lcp2kswarm -lcp2kmotion -lcp2kthermostat -lcp2kemd -lcp2ktmc -lcp2kmain -lcp2kdbt -lcp2ktas -lcp2kgrid -lcp2kgriddgemm -lcp2kgridcpu -lcp2kgridref -lcp2kgridcommon -ldbcsrarnoldi -ldbcsrx -lcp2kdbx -lcp2kdbm -lcp2kshg_int -lcp2keri_mme -lcp2kminimax -lcp2khfxbase -lcp2ksubsys -lcp2kxc -lcp2kao -lcp2kpw_env -lcp2kinput -lcp2kpw -lcp2kgpu -lcp2kfft -lcp2kfpga -lcp2kfm -lcp2kcommon -lcp2koffload -lcp2kmpiwrap -lcp2kbase -ldbcsr -lsirius -lspla -lspfft -lsymspg -lvdwxc -l:libhdf5_fortran.a -l:libhdf5.a -lz -lgsl -lelpa_openmp -lcosma -lcosta -lscalapack -lxsmmf -lxsmm -ldl -lpthread -llibgrpp -lxcf03 -lxc -lint2 -lfftw3_mpi -lfftw3 -lfftw3_omp -lmpi_cxx -lmpi -l:libopenblas.a -lvori -lstdc++ -lmpi_usempif08 -lmpi_mpifh -lopen-rte -lopen-pal -lhwloc -levent_core -levent_pthreads -lm

RELION

Test: Basic - Device: CPU

OpenBenchmarking.orgSeconds, Fewer Is BetterRELION 5.0Test: Basic - Device: CPU4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70014002100280035002771.783046.811369.23937.33946.43729.40549.80551.72553.78944.27733.021. (CXX) g++ options: -fPIC -std=c++14 -fopenmp -O3 -rdynamic -lfftw3f -lfftw3 -ldl -ltiff -lpng -ljpeg -lmpi_cxx -lmpi

Build2

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterBuild2 0.17Time To Compile4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70140210280350300.72294.95154.43121.74117.07111.6591.0291.7292.0292.05113.78

Primesieve

Length: 1e12

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e124141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx61218243024.72324.82112.2739.7019.7059.1166.9376.9266.9036.3479.1471. (CXX) g++ options: -O3

Primesieve

Length: 1e13

OpenBenchmarking.orgSeconds, Fewer Is BetterPrimesieve 12.6Length: 1e134141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70140210280350301.60302.74150.67118.66118.85110.6184.3284.4984.2678.50110.711. (CXX) g++ options: -O3

Y-Cruncher

Pi Digits To Calculate: 1B

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 1B4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx91827364540.5639.2523.8919.3619.2818.3817.3617.3417.5718.4918.37

Y-Cruncher

Pi Digits To Calculate: 500M

OpenBenchmarking.orgSeconds, Fewer Is BetterY-Cruncher 0.8.5Pi Digits To Calculate: 500M4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx51015202518.16518.29010.9549.0419.0678.6888.1198.1738.2798.7728.623

POV-Ray

Trace Time

OpenBenchmarking.orgSeconds, Fewer Is BetterPOV-RayTrace Time4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx163248648070.0670.7734.9226.6126.6025.2619.5219.5520.3318.5425.331. POV-Ray 3.7.0.10.unofficial

Timed Eigen Compilation

Time To Compile

OpenBenchmarking.orgSeconds, Fewer Is BetterTimed Eigen Compilation 3.4.0Time To Compile4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx306090120150145.21146.6684.4869.3869.5867.3657.1858.8258.6958.6667.08

Gcrypt Library

OpenBenchmarking.orgSeconds, Fewer Is BetterGcrypt Library 1.10.34141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4080120160200165.55169.14154.32156.34156.71171.02167.63150.64159.25162.13163.841. (CC) gcc options: -O2 -fvisibility=hidden

Apache CouchDB

Bulk Size: 100 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 100 - Inserts: 1000 - Rounds: 304141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2040608010096.7496.5573.2476.7076.5875.9076.6675.8976.6769.9376.391. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 100 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 100 - Inserts: 3000 - Rounds: 304141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70140210280350314.49316.46239.08259.20259.06253.99253.28252.83253.49232.19254.731. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 300 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 300 - Inserts: 1000 - Rounds: 304141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx306090120150153.03154.04118.32118.16116.42117.57116.22116.24116.62106.13119.351. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 300 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 300 - Inserts: 3000 - Rounds: 304141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx110220330440550515.50513.58398.39401.99405.45406.12399.26397.43400.40367.83408.481. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 500 - Inserts: 1000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 500 - Inserts: 1000 - Rounds: 304141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx50100150200250212.83212.53163.92164.36163.36164.47161.47163.81161.09148.05164.811. (CXX) g++ options: -flto -lstdc++ -shared -lei

Apache CouchDB

Bulk Size: 500 - Inserts: 3000 - Rounds: 30

OpenBenchmarking.orgSeconds, Fewer Is BetterApache CouchDB 3.4.1Bulk Size: 500 - Inserts: 3000 - Rounds: 304141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx150300450600750695.35698.07545.97551.35551.60559.35552.21553.81554.40511.78560.701. (CXX) g++ options: -flto -lstdc++ -shared -lei

Blender

Blend File: BMW27 - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: BMW27 - Compute: CPU-Only4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx50100150200250215.53214.89103.9779.1979.2474.0855.1855.2655.7453.5573.16

Blender

Blend File: Junkshop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Junkshop - Compute: CPU-Only4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx60120180240300292.14294.04141.99104.70104.0197.0173.6973.8773.5573.5697.10

Blender

Blend File: Classroom - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Classroom - Compute: CPU-Only4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx120240360480600560.89563.14276.44212.30211.40197.20149.37149.37148.97143.36197.53

Blender

Blend File: Fishy Cat - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Fishy Cat - Compute: CPU-Only4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx60120180240300280.26282.19136.51105.45105.2496.6773.4873.9673.8671.3597.09

Blender

Blend File: Barbershop - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Barbershop - Compute: CPU-Only4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4008001200160020002077.692095.98978.03739.91731.39679.34513.54514.70513.66506.20678.40

Blender

Blend File: Pabellon Barcelona - Compute: CPU-Only

OpenBenchmarking.orgSeconds, Fewer Is BetterBlender 4.3Blend File: Pabellon Barcelona - Compute: CPU-Only4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx140280420560700667.71671.42320.59243.35245.12226.34170.09171.82171.25166.12224.64

Whisper.cpp

Model: ggml-base.en - Input: 2016 State of the Union

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-base.en - Input: 2016 State of the Union4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4080120160200187.29186.23103.7297.9497.5592.7184.1184.6884.0387.4993.451. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni

Whisper.cpp

Model: ggml-small.en - Input: 2016 State of the Union

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-small.en - Input: 2016 State of the Union4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx130260390520650581.27583.20314.48280.03280.47268.24232.58233.68233.05245.08266.811. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni

Whisper.cpp

Model: ggml-medium.en - Input: 2016 State of the Union

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisper.cpp 1.6.2Model: ggml-medium.en - Input: 2016 State of the Union41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx4008001200160020001797.86966.01838.18839.99809.79684.13686.88684.39700.91809.491. (CXX) g++ options: -O3 -std=c++11 -fPIC -pthread -msse3 -mssse3 -mavx -mf16c -mfma -mavx2 -mavx512f -mavx512cd -mavx512vl -mavx512dq -mavx512bw -mavx512vbmi -mavx512vnni

Whisperfile

Model Size: Tiny

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisperfile 20Aug24Model Size: Tiny41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx153045607566.1141.3040.8538.5837.1335.1135.9135.4341.7138.72

Whisperfile

Model Size: Small

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisperfile 20Aug24Model Size: Small41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx70140210280350310.38193.94178.33177.87173.38154.44155.14155.97195.42167.89

Whisperfile

Model Size: Medium

OpenBenchmarking.orgSeconds, Fewer Is BetterWhisperfile 20Aug24Model Size: Medium41 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx2004006008001000845.17528.33491.98492.70473.55424.57425.51424.95534.92475.51

XNNPACK

Model: FP32MobileNetV1

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV14141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx5001000150020002500236724071056126712461257118911911192125212721. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP32MobileNetV2

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV24141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx3006009001200150014251443708135713271365147814811477149513681. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP32MobileNetV3Large

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV3Large4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx40080012001600200013421359753147315421515175417491756181015741. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP32MobileNetV3Small

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP32MobileNetV3Small4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx20040060080010004124143357997918099299339319798371. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP16MobileNetV1

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV14141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx8001600240032004000351235081578141814141383119512001196114313861. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP16MobileNetV2

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV24141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx5001000150020002500213120971088120812101217122312121222119012481. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP16MobileNetV3Large

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV3Large4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx400800120016002000201819981067142914271467154715271542149815271. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: FP16MobileNetV3Small

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: FP16MobileNetV3Small4141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx20040060080010007147204557597667798988778719207981. (CXX) g++ options: -O3 -lrt -lm

XNNPACK

Model: QS8MobileNetV2

OpenBenchmarking.orgus, Fewer Is BetterXNNPACK b7b048Model: QS8MobileNetV24141 b4364P4464p4464p epyc4484PX454584PXEPYC 4584PX amdapx20040060080010006236234007037037178018098078447231. (CXX) g++ options: -O3 -lrt -lm


Phoronix Test Suite v10.8.5