r7i.4xlarge amazon testing on Amazon Linux 2023.4.20240401 via the Phoronix Test Suite. r7i.4xlarge: Processor: Intel Xeon Platinum 8488C (8 Cores / 16 Threads), Motherboard: Amazon EC2 r7i.4xlarge (1.0 BIOS), Chipset: Intel 440FX 82441FX PMC, Memory: 1 x 128 GB DDR5-4800MT/s, Disk: 215GB Amazon Elastic Block Store, Network: Amazon Elastic OS: Amazon Linux 2023.4.20240401, Kernel: 6.1.82-99.168.amzn2023.x86_64 (x86_64), Compiler: GCC 11.4.1 20230605, File-System: xfs, System Layer: amazon Stream 2013-01-17 Type: Copy MB/s > Higher Is Better r7i.4xlarge . 145926.4 |======================================================= Stream 2013-01-17 Type: Scale MB/s > Higher Is Better r7i.4xlarge . 96126.9 |======================================================== Stream 2013-01-17 Type: Triad MB/s > Higher Is Better r7i.4xlarge . 102686.7 |======================================================= Stream 2013-01-17 Type: Add MB/s > Higher Is Better r7i.4xlarge . 102591.5 |======================================================= Intel Memory Latency Checker 3.10 Test: Idle Latency ns < Lower Is Better r7i.4xlarge . 126.5 |========================================================== Intel Memory Latency Checker 3.10 Test: Max Bandwidth - All Reads MB/s > Higher Is Better r7i.4xlarge . 94678.97 |======================================================= Intel Memory Latency Checker 3.10 Test: Max Bandwidth - 3:1 Reads-Writes MB/s > Higher Is Better r7i.4xlarge . 129333.35 |====================================================== Intel Memory Latency Checker 3.10 Test: Max Bandwidth - 2:1 Reads-Writes MB/s > Higher Is Better r7i.4xlarge . 137636.75 |====================================================== Intel Memory Latency Checker 3.10 Test: Max Bandwidth - 1:1 Reads-Writes MB/s > Higher Is Better r7i.4xlarge . 151890.31 |====================================================== Intel Memory Latency Checker 3.10 Test: Max Bandwidth - Stream-Triad Like MB/s > Higher Is Better r7i.4xlarge . 121225.38 |====================================================== Intel Memory Latency Checker 3.10 Test: Peak Injection Bandwidth - All Reads MB/s > Higher Is Better r7i.4xlarge . 95050.7 |======================================================== Intel Memory Latency Checker 3.10 Test: Peak Injection Bandwidth - 3:1 Reads-Writes MB/s > Higher Is Better r7i.4xlarge . 129544.2 |======================================================= Intel Memory Latency Checker 3.10 Test: Peak Injection Bandwidth - 2:1 Reads-Writes MB/s > Higher Is Better r7i.4xlarge . 137915.7 |======================================================= Intel Memory Latency Checker 3.10 Test: Peak Injection Bandwidth - 1:1 Reads-Writes MB/s > Higher Is Better r7i.4xlarge . 152020.9 |======================================================= Intel Memory Latency Checker 3.10 Test: Peak Injection Bandwidth - Stream-Triad Like MB/s > Higher Is Better r7i.4xlarge . 121484.7 |======================================================= CacheBench Test: Read MB/s > Higher Is Better r7i.4xlarge . 14206.79 |======================================================= CacheBench Test: Write MB/s > Higher Is Better r7i.4xlarge . 52822.06 |======================================================= CacheBench Test: Read / Modify / Write MB/s > Higher Is Better r7i.4xlarge . 103702.32 |====================================================== GNU GMP GMPbench 6.2.1 GMPbench Score > Higher Is Better Zstd Compression 1.5.4 Compression Level: 3 - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 2044.3 |========================================================= Zstd Compression 1.5.4 Compression Level: 3 - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 1449.0 |========================================================= Zstd Compression 1.5.4 Compression Level: 8 - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 535.7 |========================================================== Zstd Compression 1.5.4 Compression Level: 8 - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 1529.1 |========================================================= Zstd Compression 1.5.4 Compression Level: 12 - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 198 |============================================================ Zstd Compression 1.5.4 Compression Level: 12 - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 1421.7 |========================================================= Zstd Compression 1.5.4 Compression Level: 19 - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 12.7 |=========================================================== Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 1210.5 |========================================================= Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 835.2 |========================================================== Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 1497.6 |========================================================= Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 565.0 |========================================================== Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 1524.6 |========================================================= Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 6.59 |=========================================================== Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 1183.8 |========================================================= LZ4 Compression 1.9.4 Compression Level: 1 - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 629.29 |========================================================= LZ4 Compression 1.9.4 Compression Level: 1 - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 3862.8 |========================================================= LZ4 Compression 1.9.4 Compression Level: 3 - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 104.35 |========================================================= LZ4 Compression 1.9.4 Compression Level: 3 - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 3633.3 |========================================================= LZ4 Compression 1.9.4 Compression Level: 9 - Compression Speed MB/s > Higher Is Better r7i.4xlarge . 34.20 |========================================================== LZ4 Compression 1.9.4 Compression Level: 9 - Decompression Speed MB/s > Higher Is Better r7i.4xlarge . 3827.2 |========================================================= OpenSSL 3.1 Algorithm: SHA256 byte/s > Higher Is Better r7i.4xlarge . 10073448825 |==================================================== OpenSSL 3.1 Algorithm: SHA512 byte/s > Higher Is Better r7i.4xlarge . 3640310667 |===================================================== OpenSSL 3.1 Algorithm: RSA4096 sign/s > Higher Is Better r7i.4xlarge . 4376.4 |========================================================= OpenSSL 3.1 Algorithm: RSA4096 verify/s > Higher Is Better r7i.4xlarge . 154454.4 |======================================================= OpenSSL 3.1 Algorithm: ChaCha20 byte/s > Higher Is Better r7i.4xlarge . 47868764070 |==================================================== OpenSSL 3.1 Algorithm: AES-128-GCM byte/s > Higher Is Better r7i.4xlarge . 122322369737 |=================================================== OpenSSL 3.1 Algorithm: AES-256-GCM byte/s > Higher Is Better r7i.4xlarge . 101060293063 |=================================================== OpenSSL 3.1 Algorithm: ChaCha20-Poly1305 byte/s > Higher Is Better r7i.4xlarge . 34675203733 |==================================================== Botan 2.17.3 Test: KASUMI MiB/s > Higher Is Better r7i.4xlarge . 90.60 |========================================================== Botan 2.17.3 Test: KASUMI - Decrypt MiB/s > Higher Is Better r7i.4xlarge . 86.25 |========================================================== Botan 2.17.3 Test: AES-256 MiB/s > Higher Is Better r7i.4xlarge . 5132.15 |======================================================== Botan 2.17.3 Test: AES-256 - Decrypt MiB/s > Higher Is Better r7i.4xlarge . 5119.29 |======================================================== Botan 2.17.3 Test: Twofish MiB/s > Higher Is Better r7i.4xlarge . 321.86 |========================================================= Botan 2.17.3 Test: Twofish - Decrypt MiB/s > Higher Is Better r7i.4xlarge . 326.70 |========================================================= Botan 2.17.3 Test: Blowfish MiB/s > Higher Is Better r7i.4xlarge . 389.04 |========================================================= Botan 2.17.3 Test: Blowfish - Decrypt MiB/s > Higher Is Better r7i.4xlarge . 388.88 |========================================================= Botan 2.17.3 Test: CAST-256 MiB/s > Higher Is Better r7i.4xlarge . 122.69 |========================================================= Botan 2.17.3 Test: CAST-256 - Decrypt MiB/s > Higher Is Better r7i.4xlarge . 122.81 |========================================================= Botan 2.17.3 Test: ChaCha20Poly1305 MiB/s > Higher Is Better r7i.4xlarge . 811.45 |========================================================= Botan 2.17.3 Test: ChaCha20Poly1305 - Decrypt MiB/s > Higher Is Better r7i.4xlarge . 816.48 |========================================================= x264 2022-02-22 Video Input: Bosphorus 4K Frames Per Second > Higher Is Better r7i.4xlarge . 26.09 |========================================================== x264 2022-02-22 Video Input: Bosphorus 1080p Frames Per Second > Higher Is Better r7i.4xlarge . 112.52 |========================================================= x265 3.6 Video Input: Bosphorus 4K Frames Per Second > Higher Is Better r7i.4xlarge . 12.83 |========================================================== x265 3.6 Video Input: Bosphorus 1080p Frames Per Second > Higher Is Better r7i.4xlarge . 57.00 |========================================================== PyPerformance 1.0.0 Benchmark: go Milliseconds < Lower Is Better r7i.4xlarge . 207 |============================================================ PyPerformance 1.0.0 Benchmark: 2to3 Milliseconds < Lower Is Better r7i.4xlarge . 268 |============================================================ PyPerformance 1.0.0 Benchmark: chaos Milliseconds < Lower Is Better r7i.4xlarge . 86.2 |=========================================================== PyPerformance 1.0.0 Benchmark: float Milliseconds < Lower Is Better r7i.4xlarge . 93.2 |=========================================================== PyPerformance 1.0.0 Benchmark: nbody Milliseconds < Lower Is Better r7i.4xlarge . 99.4 |=========================================================== PyPerformance 1.0.0 Benchmark: pathlib Milliseconds < Lower Is Better r7i.4xlarge . 13.9 |=========================================================== PyPerformance 1.0.0 Benchmark: raytrace Milliseconds < Lower Is Better r7i.4xlarge . 380 |============================================================ PyPerformance 1.0.0 Benchmark: json_loads Milliseconds < Lower Is Better r7i.4xlarge . 17.9 |=========================================================== PyPerformance 1.0.0 Benchmark: crypto_pyaes Milliseconds < Lower Is Better r7i.4xlarge . 89.8 |=========================================================== PyPerformance 1.0.0 Benchmark: regex_compile Milliseconds < Lower Is Better r7i.4xlarge . 140 |============================================================ PyPerformance 1.0.0 Benchmark: python_startup Milliseconds < Lower Is Better r7i.4xlarge . 8.19 |=========================================================== PyPerformance 1.0.0 Benchmark: django_template Milliseconds < Lower Is Better r7i.4xlarge . 39.5 |=========================================================== PyPerformance 1.0.0 Benchmark: pickle_pure_python Milliseconds < Lower Is Better r7i.4xlarge . 349 |============================================================ CppPerformanceBenchmarks 9 Test: Atol Seconds < Lower Is Better r7i.4xlarge . 40.77 |========================================================== CppPerformanceBenchmarks 9 Test: Ctype Seconds < Lower Is Better r7i.4xlarge . 28.82 |========================================================== CppPerformanceBenchmarks 9 Test: Math Library Seconds < Lower Is Better r7i.4xlarge . 207.30 |========================================================= CppPerformanceBenchmarks 9 Test: Random Numbers Seconds < Lower Is Better r7i.4xlarge . 892.62 |========================================================= CppPerformanceBenchmarks 9 Test: Stepanov Vector Seconds < Lower Is Better r7i.4xlarge . 63.33 |========================================================== CppPerformanceBenchmarks 9 Test: Function Objects Seconds < Lower Is Better r7i.4xlarge . 14.55 |========================================================== CppPerformanceBenchmarks 9 Test: Stepanov Abstraction Seconds < Lower Is Better r7i.4xlarge . 23.58 |========================================================== GraphicsMagick 1.3.43 Operation: Swirl Iterations Per Minute > Higher Is Better r7i.4xlarge . 121 |============================================================ GraphicsMagick 1.3.43 Operation: Rotate Iterations Per Minute > Higher Is Better r7i.4xlarge . 210 |============================================================ GraphicsMagick 1.3.43 Operation: Sharpen Iterations Per Minute > Higher Is Better r7i.4xlarge . 27 |============================================================= GraphicsMagick 1.3.43 Operation: Enhanced Iterations Per Minute > Higher Is Better r7i.4xlarge . 38 |============================================================= GraphicsMagick 1.3.43 Operation: Resizing Iterations Per Minute > Higher Is Better r7i.4xlarge . 199 |============================================================ GraphicsMagick 1.3.43 Operation: Noise-Gaussian Iterations Per Minute > Higher Is Better r7i.4xlarge . 53 |============================================================= GraphicsMagick 1.3.43 Operation: HWB Color Space Iterations Per Minute > Higher Is Better r7i.4xlarge . 217 |============================================================ Smallpt 1.0 Global Illumination Renderer; 128 Samples Seconds < Lower Is Better r7i.4xlarge . 10.29 |========================================================== Stockfish 16.1 Chess Benchmark Nodes Per Second > Higher Is Better r7i.4xlarge . 15595678 |======================================================= C-Ray 1.1 Total Time - 4K, 16 Rays Per Pixel Seconds < Lower Is Better r7i.4xlarge . 63.03 |========================================================== SciMark 2.0 Computational Test: Composite Mflops > Higher Is Better r7i.4xlarge . 929.36 |========================================================= SciMark 2.0 Computational Test: Monte Carlo Mflops > Higher Is Better r7i.4xlarge . 173.36 |========================================================= SciMark 2.0 Computational Test: Fast Fourier Transform Mflops > Higher Is Better r7i.4xlarge . 451.51 |========================================================= SciMark 2.0 Computational Test: Sparse Matrix Multiply Mflops > Higher Is Better r7i.4xlarge . 1102.64 |======================================================== SciMark 2.0 Computational Test: Dense LU Matrix Factorization Mflops > Higher Is Better r7i.4xlarge . 1635.74 |======================================================== SciMark 2.0 Computational Test: Jacobi Successive Over-Relaxation Mflops > Higher Is Better r7i.4xlarge . 1283.59 |======================================================== Renaissance 0.14 Test: Scala Dotty ms < Lower Is Better Renaissance 0.14 Test: Random Forest ms < Lower Is Better Renaissance 0.14 Test: ALS Movie Lens ms < Lower Is Better Renaissance 0.14 Test: Apache Spark ALS ms < Lower Is Better Renaissance 0.14 Test: Apache Spark Bayes ms < Lower Is Better Renaissance 0.14 Test: Savina Reactors.IO ms < Lower Is Better Renaissance 0.14 Test: Apache Spark PageRank ms < Lower Is Better Renaissance 0.14 Test: Finagle HTTP Requests ms < Lower Is Better Renaissance 0.14 Test: In-Memory Database Shootout ms < Lower Is Better Renaissance 0.14 Test: Akka Unbalanced Cobwebbed Tree ms < Lower Is Better Renaissance 0.14 Test: Genetic Algorithm Using Jenetics + Futures ms < Lower Is Better DaCapo Benchmark 23.11 Java Test: Jython msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Eclipse msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: GraphChi msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Tradesoap msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Tradebeans msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Spring Boot msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Apache Kafka msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Apache Tomcat msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: jMonkeyEngine msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Apache Cassandra msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Apache Xalan XSLT msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Batik SVG Toolkit msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: H2 Database Engine msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: FOP Print Formatter msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: PMD Source Code Analyzer msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Apache Lucene Search Index msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Apache Lucene Search Engine msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Avrora AVR Simulation Framework msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: BioJava Biological Data Framework msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: Zxing 1D/2D Barcode Image Processing msec < Lower Is Better DaCapo Benchmark 23.11 Java Test: H2O In-Memory Platform For Machine Learning msec < Lower Is Better BlogBench 1.1 Test: Read Final Score > Higher Is Better r7i.4xlarge . 2129586 |======================================================== BlogBench 1.1 Test: Write Final Score > Higher Is Better r7i.4xlarge . 10523 |========================================================== nginx 1.23.2 Connections: 1 Requests Per Second > Higher Is Better nginx 1.23.2 Connections: 20 Requests Per Second > Higher Is Better r7i.4xlarge . 72396.91 |======================================================= nginx 1.23.2 Connections: 100 Requests Per Second > Higher Is Better r7i.4xlarge . 89451.85 |======================================================= nginx 1.23.2 Connections: 200 Requests Per Second > Higher Is Better r7i.4xlarge . 89547.83 |======================================================= nginx 1.23.2 Connections: 500 Requests Per Second > Higher Is Better r7i.4xlarge . 88308.95 |======================================================= nginx 1.23.2 Connections: 1000 Requests Per Second > Higher Is Better r7i.4xlarge . 84460.86 |======================================================= nginx 1.23.2 Connections: 4000 Requests Per Second > Higher Is Better r7i.4xlarge . 75497.84 |======================================================= Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:1 Ops/sec > Higher Is Better r7i.4xlarge . 2377859.95 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:5 Ops/sec > Higher Is Better r7i.4xlarge . 2392374.78 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 50 - Set To Get Ratio: 5:1 Ops/sec > Higher Is Better r7i.4xlarge . 2126310.65 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:1 Ops/sec > Higher Is Better r7i.4xlarge . 2202452.49 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:5 Ops/sec > Higher Is Better r7i.4xlarge . 2327229.85 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 100 - Set To Get Ratio: 5:1 Ops/sec > Higher Is Better r7i.4xlarge . 2116120.69 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 50 - Set To Get Ratio: 10:1 Ops/sec > Higher Is Better r7i.4xlarge . 2101402.10 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 50 - Set To Get Ratio: 1:10 Ops/sec > Higher Is Better r7i.4xlarge . 2288104.64 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:1 Ops/sec > Higher Is Better r7i.4xlarge . 2295626.88 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:5 Ops/sec > Higher Is Better r7i.4xlarge . 2441638.84 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 500 - Set To Get Ratio: 5:1 Ops/sec > Higher Is Better r7i.4xlarge . 2186007.53 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 100 - Set To Get Ratio: 10:1 Ops/sec > Higher Is Better r7i.4xlarge . 2165021.05 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 100 - Set To Get Ratio: 1:10 Ops/sec > Higher Is Better r7i.4xlarge . 2384658.05 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 500 - Set To Get Ratio: 10:1 Ops/sec > Higher Is Better r7i.4xlarge . 2161766.83 |===================================================== Redis 7.0.12 + memtier_benchmark 2.0 Protocol: Redis - Clients: 500 - Set To Get Ratio: 1:10 Ops/sec > Higher Is Better r7i.4xlarge . 2368097.34 |===================================================== Apache Cassandra 4.1.3 Test: Writes Op/s > Higher Is Better Apache Cassandra 4.1.3 Test: Mixed 1:1 Op/s > Higher Is Better Apache Cassandra 4.1.3 Test: Mixed 1:3 Op/s > Higher Is Better libjpeg-turbo tjbench 2.1.0 Test: Decompression Throughput Megapixels/sec > Higher Is Better r7i.4xlarge . 194.83 |========================================================= VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Fast Frames Per Second > Higher Is Better r7i.4xlarge . 3.768 |========================================================== VVenC 1.11 Video Input: Bosphorus 4K - Video Preset: Faster Frames Per Second > Higher Is Better r7i.4xlarge . 8.736 |========================================================== VVenC 1.11 Video Input: Bosphorus 1080p - Video Preset: Fast Frames Per Second > Higher Is Better r7i.4xlarge . 12.03 |========================================================== VVenC 1.11 Video Input: Bosphorus 1080p - Video Preset: Faster Frames Per Second > Higher Is Better r7i.4xlarge . 30.57 |========================================================== NCNN 20230517 Target: CPU - Model: mobilenet ms < Lower Is Better r7i.4xlarge . 11.11 |========================================================== NCNN 20230517 Target: CPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better r7i.4xlarge . 3.79 |=========================================================== NCNN 20230517 Target: CPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better r7i.4xlarge . 3.50 |=========================================================== NCNN 20230517 Target: CPU - Model: shufflenet-v2 ms < Lower Is Better r7i.4xlarge . 3.41 |=========================================================== NCNN 20230517 Target: CPU - Model: mnasnet ms < Lower Is Better r7i.4xlarge . 3.51 |=========================================================== NCNN 20230517 Target: CPU - Model: efficientnet-b0 ms < Lower Is Better r7i.4xlarge . 4.69 |=========================================================== NCNN 20230517 Target: CPU - Model: blazeface ms < Lower Is Better r7i.4xlarge . 1.23 |=========================================================== NCNN 20230517 Target: CPU - Model: googlenet ms < Lower Is Better r7i.4xlarge . 9.93 |=========================================================== NCNN 20230517 Target: CPU - Model: vgg16 ms < Lower Is Better r7i.4xlarge . 27.40 |========================================================== NCNN 20230517 Target: CPU - Model: resnet18 ms < Lower Is Better r7i.4xlarge . 6.80 |=========================================================== NCNN 20230517 Target: CPU - Model: alexnet ms < Lower Is Better r7i.4xlarge . 4.73 |=========================================================== NCNN 20230517 Target: CPU - Model: resnet50 ms < Lower Is Better r7i.4xlarge . 13.87 |========================================================== NCNN 20230517 Target: CPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3 ms < Lower Is Better r7i.4xlarge . 11.11 |========================================================== NCNN 20230517 Target: CPU - Model: yolov4-tiny ms < Lower Is Better r7i.4xlarge . 17.87 |========================================================== NCNN 20230517 Target: CPU - Model: squeezenet_ssd ms < Lower Is Better r7i.4xlarge . 8.45 |=========================================================== NCNN 20230517 Target: CPU - Model: regnety_400m ms < Lower Is Better r7i.4xlarge . 8.78 |=========================================================== NCNN 20230517 Target: CPU - Model: vision_transformer ms < Lower Is Better r7i.4xlarge . 81.01 |========================================================== NCNN 20230517 Target: CPU - Model: FastestDet ms < Lower Is Better r7i.4xlarge . 4.05 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: mobilenet ms < Lower Is Better r7i.4xlarge . 11.12 |========================================================== NCNN 20230517 Target: Vulkan GPU-v2-v2 - Model: mobilenet-v2 ms < Lower Is Better r7i.4xlarge . 3.79 |=========================================================== NCNN 20230517 Target: Vulkan GPU-v3-v3 - Model: mobilenet-v3 ms < Lower Is Better r7i.4xlarge . 3.50 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: shufflenet-v2 ms < Lower Is Better r7i.4xlarge . 3.40 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: mnasnet ms < Lower Is Better r7i.4xlarge . 3.51 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: efficientnet-b0 ms < Lower Is Better r7i.4xlarge . 4.69 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: blazeface ms < Lower Is Better r7i.4xlarge . 1.24 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: googlenet ms < Lower Is Better r7i.4xlarge . 9.97 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: vgg16 ms < Lower Is Better r7i.4xlarge . 28.53 |========================================================== NCNN 20230517 Target: Vulkan GPU - Model: resnet18 ms < Lower Is Better r7i.4xlarge . 6.90 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: alexnet ms < Lower Is Better r7i.4xlarge . 4.72 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: resnet50 ms < Lower Is Better r7i.4xlarge . 13.73 |========================================================== NCNN 20230517 Target: Vulkan GPUv2-yolov3v2-yolov3 - Model: mobilenetv2-yolov3 ms < Lower Is Better r7i.4xlarge . 11.12 |========================================================== NCNN 20230517 Target: Vulkan GPU - Model: yolov4-tiny ms < Lower Is Better r7i.4xlarge . 17.84 |========================================================== NCNN 20230517 Target: Vulkan GPU - Model: squeezenet_ssd ms < Lower Is Better r7i.4xlarge . 8.41 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: regnety_400m ms < Lower Is Better r7i.4xlarge . 8.85 |=========================================================== NCNN 20230517 Target: Vulkan GPU - Model: vision_transformer ms < Lower Is Better r7i.4xlarge . 81.37 |========================================================== NCNN 20230517 Target: Vulkan GPU - Model: FastestDet ms < Lower Is Better r7i.4xlarge . 4.13 |=========================================================== libxsmm 2-1.17-3645 M N K: 128 GFLOPS/s > Higher Is Better r7i.4xlarge . 386.4 |========================================================== libxsmm 2-1.17-3645 M N K: 256 GFLOPS/s > Higher Is Better r7i.4xlarge . 224.3 |========================================================== libxsmm 2-1.17-3645 M N K: 32 GFLOPS/s > Higher Is Better r7i.4xlarge . 215.2 |========================================================== libxsmm 2-1.17-3645 M N K: 64 GFLOPS/s > Higher Is Better r7i.4xlarge . 291.8 |========================================================== Apache Spark 3.3 Row Count: 1000000 - Partitions: 100 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 500 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 1000 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 1000000 - Partitions: 2000 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 100 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 500 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 100 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 500 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 100 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 500 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 1000 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 10000000 - Partitions: 2000 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 1000 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 20000000 - Partitions: 2000 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 1000 Seconds < Lower Is Better Apache Spark 3.3 Row Count: 40000000 - Partitions: 2000 Seconds < Lower Is Better ClickHouse 22.12.3.5 100M Rows Hits Dataset, First Run / Cold Cache Queries Per Minute, Geo Mean > Higher Is Better r7i.4xlarge . 213.02 |========================================================= ClickHouse 22.12.3.5 100M Rows Hits Dataset, Second Run Queries Per Minute, Geo Mean > Higher Is Better r7i.4xlarge . 219.93 |========================================================= ClickHouse 22.12.3.5 100M Rows Hits Dataset, Third Run Queries Per Minute, Geo Mean > Higher Is Better r7i.4xlarge . 221.94 |========================================================= InfluxDB 1.8.2 Concurrent Streams: 4 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 val/sec > Higher Is Better r7i.4xlarge . 1462786.8 |====================================================== InfluxDB 1.8.2 Concurrent Streams: 64 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 val/sec > Higher Is Better r7i.4xlarge . 1549335.1 |====================================================== InfluxDB 1.8.2 Concurrent Streams: 1024 - Batch Size: 10000 - Tags: 2,5000,1 - Points Per Series: 10000 val/sec > Higher Is Better r7i.4xlarge . 1546093.6 |======================================================