Add Processor To Compare: 641 Processors With Sufficient Data Collected AMD A4-6300 APU AMD A6-3410MX APU AMD A6-5400K APU AMD A6-7400K Radeon R5 6 Compute Cores 2C AMD A8-3870 APU AMD A8-5600K APU AMD A8-7600 Radeon R7 10 Compute Cores 4C AMD A10-5800K APU AMD A10-6700 APU AMD A10-7850K APU AMD A10-7850K APU with Radeon R7 AMD A10-7850K Radeon R7 12 Compute Cores 4C AMD A10-7870K Radeon R7 12 Compute Cores 4C AMD Athlon 200GE AMD Athlon 3000G AMD Athlon 5150 APU with Radeon R3 AMD Athlon 5350 APU with Radeon R3 AMD Athlon II X2 250 AMD Athlon II X3 425 AMD Athlon II X4 630 AMD Athlon II X4 640 AMD Athlon X4 860K Quad Core AMD Custom APU 0405 AMD E-350 AMD EPYC 7F32 8-Core AMD EPYC 7F32 8-Core 2P AMD EPYC 7F52 16-Core AMD EPYC 7F52 16-Core 2P AMD EPYC 7F72 24-Core AMD EPYC 7F72 24-Core 2P AMD EPYC 72F3 8-Core AMD EPYC 72F3 8-Core 2P AMD EPYC 73F3 16-Core AMD EPYC 73F3 16-Core 2P AMD EPYC 74F3 24-Core AMD EPYC 74F3 24-Core 2P AMD EPYC 75F3 32-Core AMD EPYC 75F3 32-Core 2P AMD EPYC 3255 8-Core Temp AMD EPYC 7232P 8-Core AMD EPYC 7251 8-Core AMD EPYC 7252 8-Core AMD EPYC 7252 8-Core 2P AMD EPYC 7262 8-Core AMD EPYC 7262 8-Core 2P AMD EPYC 7272 12-Core AMD EPYC 7272 12-Core 2P AMD EPYC 7281 16-Core AMD EPYC 7282 16-Core AMD EPYC 7282 16-Core 2P AMD EPYC 7302 16-Core AMD EPYC 7302 16-Core 2P AMD EPYC 7302P 16-Core AMD EPYC 7313 16-Core AMD EPYC 7313 16-Core 2P AMD EPYC 7313P 16-Core AMD EPYC 7343 16-Core AMD EPYC 7343 16-Core 2P AMD EPYC 7351P 16-Core AMD EPYC 7352 24-Core AMD EPYC 7352 24-Core 2P AMD EPYC 7371 16-Core AMD EPYC 7371 16-Core 2P AMD EPYC 7373X 16-Core AMD EPYC 7373X 16-Core 2P AMD EPYC 7401P 24-Core AMD EPYC 7402 24-Core AMD EPYC 7402 24-Core 2P AMD EPYC 7402P 24-Core AMD EPYC 7413 24-Core AMD EPYC 7413 24-Core 2P AMD EPYC 7443 24-Core AMD EPYC 7443 24-Core 2P AMD EPYC 7452 32-Core AMD EPYC 7452 32-Core 2P AMD EPYC 7453 28-Core AMD EPYC 7453 28-Core 2P AMD EPYC 7473X 24-Core AMD EPYC 7502 32-Core AMD EPYC 7502 32-Core 2P AMD EPYC 7502P 32-Core AMD EPYC 7513 32-Core AMD EPYC 7513 32-Core 2P AMD EPYC 7532 32-Core AMD EPYC 7532 32-Core 2P AMD EPYC 7542 32-Core AMD EPYC 7542 32-Core 2P AMD EPYC 7543 32-Core AMD EPYC 7543 32-Core 2P AMD EPYC 7543P 32-Core AMD EPYC 7551 32-Core AMD EPYC 7551 32-Core 2P AMD EPYC 7551P 32-Core AMD EPYC 7552 48-Core AMD EPYC 7552 48-Core 2P AMD EPYC 7573X 32-Core AMD EPYC 7573X 32-Core 2P AMD EPYC 7601 32-Core AMD EPYC 7601 32-Core 2P AMD EPYC 7642 48-Core AMD EPYC 7642 48-Core 2P AMD EPYC 7643 48-Core AMD EPYC 7643 48-Core 2P AMD EPYC 7662 64-Core AMD EPYC 7663 56-Core AMD EPYC 7663 56-Core 2P AMD EPYC 7702 64-Core AMD EPYC 7702 64-Core 2P AMD EPYC 7702P 64-Core AMD EPYC 7713 64-Core AMD EPYC 7713 64-Core 2P AMD EPYC 7713P 64-Core AMD EPYC 7742 64-Core AMD EPYC 7742 64-Core 2P AMD EPYC 7763 64-Core AMD EPYC 7763 64-Core 2P AMD EPYC 7773X 64-Core AMD EPYC 7773X 64-Core 2P AMD EPYC 9374F 32-Core AMD EPYC 9374F 32-Core 2P AMD EPYC 9534 64-Core 2P AMD EPYC 9554 64-Core AMD EPYC 9554 64-Core 2P AMD EPYC 9634 84-Core AMD EPYC 9634 84-Core 2P AMD EPYC 9654 96-Core 2P AMD FX-4100 AMD FX-6300 Six-Core AMD FX-6350 Six-Core AMD FX-8120 Eight-Core AMD FX-8150 Eight-Core AMD FX-8300 Eight-Core AMD FX-8320 Eight-Core AMD FX-8320E Eight-Core AMD FX-8350 Eight-Core AMD FX-8370 Eight-Core AMD FX-8370E Eight-Core AMD FX-9590 Eight-Core AMD Opteron 6272 2P AMD Opteron 6308 AMD Opteron 8378 4P AMD Phenom II X2 560 AMD Phenom II X4 955 AMD Phenom II X4 B55 AMD Phenom II X6 1055T AMD Phenom II X6 1090T AMD Phenom II X6 1100T AMD PRO A12-9800 R7 12 COMPUTE CORES 4C AMD Ryzen 3 1200 AMD Ryzen 3 1300X AMD Ryzen 3 2200G AMD Ryzen 3 2200G with Radeon Vega AMD Ryzen 3 3100 4-Core AMD Ryzen 3 3200G AMD Ryzen 3 3200U AMD Ryzen 3 3300X 4-Core AMD Ryzen 3 PRO 4350G AMD Ryzen 5 1500X AMD Ryzen 5 1600 Six-Core AMD Ryzen 5 1600X Six-Core AMD Ryzen 5 2400G AMD Ryzen 5 2400G with Radeon Vega AMD Ryzen 5 2600 Six-Core AMD Ryzen 5 2600X Six-Core AMD Ryzen 5 3400G AMD Ryzen 5 3500U AMD Ryzen 5 3500X 6-Core AMD Ryzen 5 3550H AMD Ryzen 5 3600 6-Core AMD Ryzen 5 3600X 6-Core AMD Ryzen 5 3600XT 6-Core AMD Ryzen 5 4500U AMD Ryzen 5 5500 AMD Ryzen 5 5500U AMD Ryzen 5 5600 6-Core AMD Ryzen 5 5600G AMD Ryzen 5 5600X 6-Core AMD Ryzen 5 7600 6-Core AMD Ryzen 5 7600X 6-Core AMD Ryzen 5 PRO 3600 6-Core AMD Ryzen 5 PRO 4650G AMD Ryzen 5 PRO 6650U AMD Ryzen 7 1700 Eight-Core AMD Ryzen 7 1700X Eight-Core AMD Ryzen 7 1800X Eight-Core AMD Ryzen 7 2700 Eight-Core AMD Ryzen 7 2700U AMD Ryzen 7 2700X Eight-Core AMD Ryzen 7 3700X 8-Core AMD Ryzen 7 3800X 8-Core AMD Ryzen 7 3800XT 8-Core AMD Ryzen 7 4700U AMD Ryzen 7 4800H AMD Ryzen 7 4800U AMD Ryzen 7 5700G AMD Ryzen 7 5700X 8-Core AMD Ryzen 7 5800X3D 8-Core AMD Ryzen 7 5800X 8-Core AMD Ryzen 7 6800U AMD Ryzen 7 7700 8-Core AMD Ryzen 7 7700X 8-Core AMD Ryzen 7 7800X3D 8-Core AMD Ryzen 7 PRO 3700 8-Core AMD Ryzen 7 PRO 4750G AMD Ryzen 7 PRO 4750U AMD Ryzen 7 PRO 5850U AMD Ryzen 7 PRO 6850U AMD Ryzen 9 3900X 12-Core AMD Ryzen 9 3900XT 12-Core AMD Ryzen 9 3950X 16-Core AMD Ryzen 9 5900HX AMD Ryzen 9 5900X 12-Core AMD Ryzen 9 5950X 16-Core AMD Ryzen 9 6900HX AMD Ryzen 9 7900 12-Core AMD Ryzen 9 7900X3D 12-Core AMD Ryzen 9 7900X 12-Core AMD Ryzen 9 7950X3D 16-Core AMD Ryzen 9 7950X 16-Core AMD Ryzen 9 PRO 3900 12-Core AMD Ryzen Threadripper 1920X 12-Core AMD Ryzen Threadripper 1950X 16-Core AMD Ryzen Threadripper 2920X 12-Core AMD Ryzen Threadripper 2950X 16-Core AMD Ryzen Threadripper 2970WX 24-Core AMD Ryzen Threadripper 2990WX 32-Core AMD Ryzen Threadripper 3960X 24-Core AMD Ryzen Threadripper 3970X 32-Core AMD Ryzen Threadripper 3990X 64-Core AMD Ryzen Threadripper PRO 3955WX 16-Cores AMD Ryzen Threadripper PRO 3975WX 32-Cores AMD Ryzen Threadripper PRO 5965WX 24-Cores Ampere Altra ARMv8 Neoverse-N1 160-Core Ampere ARMv8 Neoverse-N1 128-Core Ampere ARMv8 Neoverse-N1 256-Core Ampere eMAG ARMv8 32-Core Apple M1 Apple M2 ARMv7 4-Core ARMv7 Cortex-A15 8-Core ARMv7 Cortex-A53 4-Core ARMv7 Cortex-A72 4-Core ARMv8 Cortex-A53 4-Core ARMv8 Cortex-A57 4-Core ARMv8 Cortex-A57 6-Core ARMv8 Cortex-A57 8-Core ARMv8 Cortex-A72 4-Core ARMv8 Cortex-A72 6-Core ARMv8 Cortex-A72 16-Core ARMv8 Cortex-A73 2-Core ARMv8 Cortex-A73 6-Core ARMv8 Cortex-A73 8-Core ARMv8 Neoverse-N1 8-Core ARMv8 Neoverse-N1 32-Core ARMv8 Neoverse-N1 64-Core ARMv8 Neoverse-V1 64-Core Intel Atom C2750 Intel Atom C3950 Intel Atom C3958 Intel Atom E3845 Intel Atom N450 Intel Atom N2600 Intel Atom P5362 Intel Atom x5-Z8350 Intel Atom x6425RE Intel Celeron B820 Intel Celeron G5900 Intel Celeron G6900 Intel Celeron J1900 Intel Celeron J3455 Intel Celeron N2820 Intel Celeron N3050 Intel Celeron N3060 Intel Celeron N3450 Intel Core 2 6300 Intel Core 2 6400 Intel Core 2 Duo E8400 Intel Core 2 Duo P7350 Intel Core 2 Duo P8600 Intel Core 2 Duo P8700 Intel Core 2 Duo T7100 Intel Core 2 Duo T7250 Intel Core 2 Extreme Q9300 Intel Core 2 Quad Q6600 Intel Core 2 Quad Q8400 Intel Core 2 Quad Q9400 Intel Core 2 Quad Q9550 Intel Core 2 Quad Q9650 Intel Core i3 370M Intel Core i3 380U Intel Core i3-2100 Intel Core i3-2120 Intel Core i3-3110M Intel Core i3-3217U Intel Core i3-3220 Intel Core i3-4130 Intel Core i3-5005U Intel Core i3-5010U Intel Core i3-7100 Intel Core i3-7100U Intel Core i3-8100 Intel Core i3-8100T Intel Core i3-9100 Intel Core i3-9100F Intel Core i3-10100 Intel Core i3-10105 Intel Core i3-10110U Intel Core i3-12100 Intel Core i5 520M Intel Core i5 650 Intel Core i5-1035G1 Intel Core i5-1135G7 Intel Core i5-1145G7 Intel Core i5-1240P Intel Core i5-2400 Intel Core i5-2400S Intel Core i5-2410M Intel Core i5-2430M Intel Core i5-2500 Intel Core i5-2500K Intel Core i5-2520M Intel Core i5-3210M Intel Core i5-3230M Intel Core i5-3320M Intel Core i5-3360M Intel Core i5-3470 Intel Core i5-3470S Intel Core i5-3570 Intel Core i5-3570K Intel Core i5-4200U Intel Core i5-4210U Intel Core i5-4250U Intel Core i5-4278U Intel Core i5-4440 Intel Core i5-4460 Intel Core i5-4590 Intel Core i5-4670 Intel Core i5-4670K Intel Core i5-4690 Intel Core i5-4690K Intel Core i5-5200U Intel Core i5-5300U Intel Core i5-6200U Intel Core i5-6260U Intel Core i5-6300U Intel Core i5-6500 Intel Core i5-6500T Intel Core i5-6600 Intel Core i5-6600K Intel Core i5-7200U Intel Core i5-7500 Intel Core i5-7600K Intel Core i5-8250U Intel Core i5-8265U Intel Core i5-8400 Intel Core i5-8500 Intel Core i5-9400F Intel Core i5-9500 Intel Core i5-10210U Intel Core i5-10500E Intel Core i5-10600K Intel Core i5-11600K Intel Core i5-12400 Intel Core i5-12600K Intel Core i5-13400 Intel Core i5-13600K Intel Core i7 Intel Core i7 720Q Intel Core i7 740Q Intel Core i7 920 Intel Core i7 950 Intel Core i7 990X Intel Core i7-1065G7 Intel Core i7-1165G7 Intel Core i7-1185G7 Intel Core i7-1185GRE Intel Core i7-1280P Intel Core i7-2600 Intel Core i7-2600K Intel Core i7-2630QM Intel Core i7-2670QM Intel Core i7-2700K Intel Core i7-3517U Intel Core i7-3517UE Intel Core i7-3520M Intel Core i7-3615QM Intel Core i7-3630QM Intel Core i7-3632QM Intel Core i7-3770 Intel Core i7-3770K Intel Core i7-3820 Intel Core i7-3930K Intel Core i7-3960X Intel Core i7-4558U Intel Core i7-4600U Intel Core i7-4700HQ Intel Core i7-4700MQ Intel Core i7-4720HQ Intel Core i7-4770 Intel Core i7-4770K Intel Core i7-4790 Intel Core i7-4790K Intel Core i7-4930K Intel Core i7-4960X Intel Core i7-5500U Intel Core i7-5557U Intel Core i7-5600U Intel Core i7-5775C Intel Core i7-5820K Intel Core i7-5930K Intel Core i7-5960X Intel Core i7-6500U Intel Core i7-6700 Intel Core i7-6700HQ Intel Core i7-6700K Intel Core i7-6800K Intel Core i7-6820HQ Intel Core i7-7500U Intel Core i7-7600U Intel Core i7-7700 Intel Core i7-7700HQ Intel Core i7-7700K Intel Core i7-7700T Intel Core i7-7740K Intel Core i7-7800X Intel Core i7-7820HQ Intel Core i7-7820X Intel Core i7-7900X Intel Core i7-8086K Intel Core i7-8550U Intel Core i7-8565U Intel Core i7-8650U Intel Core i7-8700 Intel Core i7-8700B Intel Core i7-8700K Intel Core i7-8750H Intel Core i7-8809G Intel Core i7-8850H Intel Core i7-9700K Intel Core i7-9700TE Intel Core i7-9750H Intel Core i7-9850H Intel Core i7-10510U Intel Core i7-10610U Intel Core i7-10700T Intel Core i7-10750H Intel Core i7-10875H Intel Core i7-11700B Intel Core i7-11700K Intel Core i7-11800H Intel Core i7-12700K Intel Core i7-13700K Intel Core i7-13700KF Intel Core i9-7920X Intel Core i9-7960X Intel Core i9-7980XE Intel Core i9-9900K Intel Core i9-9900KS Intel Core i9-10850K Intel Core i9-10885H Intel Core i9-10900K Intel Core i9-10980XE Intel Core i9-11900K Intel Core i9-11980HK Intel Core i9-12900H Intel Core i9-12900K Intel Core i9-13900K Intel Pentium 4 Intel Pentium D1517 Intel Pentium Dual E2220 Intel Pentium G3220 Intel Pentium G3258 Intel Pentium G3260 Intel Pentium G4400 Intel Pentium G4560 Intel Pentium G4600 Intel Pentium Gold G5400 Intel Pentium Gold G6400 Intel Pentium Silver J5005 Intel Xeon D-2183IT Intel Xeon E-2278G Intel Xeon E-2278GEL Intel Xeon E-2286M Intel Xeon E-2288G Intel Xeon E-2388G Intel Xeon E3-1220 v3 Intel Xeon E3-1225 v6 Intel Xeon E3-1230 V2 Intel Xeon E3-1231 v3 Intel Xeon E3-1235L v5 Intel Xeon E3-1240 v5 Intel Xeon E3-1245 v5 Intel Xeon E3-1260L v5 Intel Xeon E3-1270 v5 Intel Xeon E3-1275 v5 Intel Xeon E3-1275 v6 Intel Xeon E3-1280 v5 Intel Xeon E3-1505M v6 Intel Xeon E5-26xx v3 4P Intel Xeon E5-1620 v3 Intel Xeon E5-1650 v2 Intel Xeon E5-1650 v4 Intel Xeon E5-1680 v3 Intel Xeon E5-2403 v2 2P Intel Xeon E5-2450L 0 2P Intel Xeon E5-2603 v2 2P Intel Xeon E5-2609 v4 Intel Xeon E5-2620 0 Intel Xeon E5-2620 0 2P Intel Xeon E5-2620 v2 2P Intel Xeon E5-2620 v3 Intel Xeon E5-2620 v3 2P Intel Xeon E5-2620 v4 2P Intel Xeon E5-2630 0 2P Intel Xeon E5-2630 v3 2P Intel Xeon E5-2630 v4 2P Intel Xeon E5-2637 v4 2P Intel Xeon E5-2640 0 2P Intel Xeon E5-2640 v3 2P Intel Xeon E5-2640 v4 Intel Xeon E5-2643 0 2P Intel Xeon E5-2643 v3 2P Intel Xeon E5-2650 0 Intel Xeon E5-2650 v2 2P Intel Xeon E5-2650 v3 2P Intel Xeon E5-2650 v4 2P Intel Xeon E5-2658 v2 2P Intel Xeon E5-2660 0 2P Intel Xeon E5-2660 v3 2P Intel Xeon E5-2665 0 2P Intel Xeon E5-2667 0 2P Intel Xeon E5-2667 v3 2P Intel Xeon E5-2667 v4 Intel Xeon E5-2670 0 2P Intel Xeon E5-2678 v3 Intel Xeon E5-2680 0 2P Intel Xeon E5-2680 v2 2P Intel Xeon E5-2680 v3 2P Intel Xeon E5-2683 v4 2P Intel Xeon E5-2687W v3 Intel Xeon E5-2690 0 2P Intel Xeon E5-2690 v2 2P Intel Xeon E5-2690 v3 2P Intel Xeon E5-2690 v4 2P Intel Xeon E5-2697 v3 2P Intel Xeon E5-2699 v3 2P Intel Xeon E5-4650 0 4P Intel Xeon E312xx Intel Xeon E5420 2P Intel Xeon E5506 2P Intel Xeon E5530 2P Intel Xeon E5540 2P Intel Xeon E5620 2P Intel Xeon E5645 2P Intel Xeon E5649 2P Intel Xeon Gold 5117 2P Intel Xeon Gold 5118 2P Intel Xeon Gold 5217 Intel Xeon Gold 5218 Intel Xeon Gold 5218R Intel Xeon Gold 5218R 2P Intel Xeon Gold 5220R Intel Xeon Gold 5220R 2P Intel Xeon Gold 5222 2P Intel Xeon Gold 6138 Intel Xeon Gold 6138 2P Intel Xeon Gold 6140 2P Intel Xeon Gold 6210U Intel Xeon Gold 6212U Intel Xeon Gold 6226R Intel Xeon Gold 6226R 2P Intel Xeon Gold 6230 2P Intel Xeon Gold 6230R Intel Xeon Gold 6230R 2P Intel Xeon Gold 6238R Intel Xeon Gold 6248R 2P Intel Xeon Gold 6250 Intel Xeon Gold 6250 2P Intel Xeon Gold 6254 2P Intel Xeon Gold 6258R Intel Xeon Gold 6258R 2P Intel Xeon Gold 6312U Intel Xeon Gold 6338 Intel Xeon Gold 6338 2P Intel Xeon Gold 6342 Intel Xeon Gold 6342 2P Intel Xeon Gold 6346 Intel Xeon Gold 6346 2P Intel Xeon L5420 2P Intel Xeon L5640 2P Intel Xeon Platinum 8124M Intel Xeon Platinum 8168 2P Intel Xeon Platinum 8175M 2P Intel Xeon Platinum 8252C 2P Intel Xeon Platinum 8253 Intel Xeon Platinum 8259CL Intel Xeon Platinum 8259CL 2P Intel Xeon Platinum 8259L 2P Intel Xeon Platinum 8268 2P Intel Xeon Platinum 8272CL 2P Intel Xeon Platinum 8280 Intel Xeon Platinum 8280 2P Intel Xeon Platinum 8362 Intel Xeon Platinum 8362 2P Intel Xeon Platinum 8380 Intel Xeon Platinum 8380 2P Intel Xeon Platinum 8490H Intel Xeon Silver 4108 Intel Xeon Silver 4110 2P Intel Xeon Silver 4114 2P Intel Xeon Silver 4208 2P Intel Xeon Silver 4210 2P Intel Xeon Silver 4210R Intel Xeon Silver 4210R 2P Intel Xeon Silver 4214 2P Intel Xeon Silver 4214R Intel Xeon Silver 4214R 2P Intel Xeon Silver 4215R Intel Xeon Silver 4215R 2P Intel Xeon Silver 4216 Intel Xeon Silver 4216 2P Intel Xeon W-1370P Intel Xeon W-2123 Intel Xeon W-2295 Intel Xeon W-3235 Intel Xeon W3530 Intel Xeon X5550 2P Intel Xeon X5650 2P Intel Xeon X5670 2P Intel Xeon X5675 2P Intel Xeon X5680 2P Intel Xeon X5687 Mobile AMD Sempron 3500 Phytium FT-2000 POWER9 4-Core POWER9 44-Core POWER9 altivec supported 44-Core POWER9 altivec supported 64-Core Rockchip ARMv8 Cortex-A72 6-Core Rockchip ARMv8 Cortex-A76 4-Core Rockchip ARMv8 Cortex-A76 6-Core
* Note: Due to differences in Linux drivers/interfaces, the reported CPU clock may be displayed different depending upon the CPU - i.e. base vs. boost frequency. * Disclosure: OpenBenchmarking.org may earn a commission/referral on affiliate shopping links should you decide to make any purchases from the third-party shopping links.
Of the components selected for comparison, there were 323 benchmarks in common (matching test profile, test version and any configurable test options) and where that data was statistically significant and at least three independent data points for each component of the public test results on OpenBenchmarking.org.
OpenBenchmarking.org Geometric Mean, More Is Better Geometric Mean Of All Test Results Result Composite AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 80 160 240 320 400 351.16 334.26
AMD EPYC 9654 96-Core had the most wins, coming in first place for 58% of the tests.
Based on the geometric mean of all complete results, the fastest (AMD EPYC 9654 96-Core) was 1.051x the speed of the slowest (2 x Intel Xeon Platinum 8490H).
The results with the greatest spread from best to worst included:
OpenCV (Test: Core ) at 5.083x, PJSIP (Method: OPTIONS, Stateless ) at 2.545x, Stress-NG (Test: MMAP ) at 2.45x, Neural Magic DeepSparse (Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream ) at 2.077x, Neural Magic DeepSparse (Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream ) at 2.076x, Stress-NG (Test: NUMA ) at 1.94x, Neural Magic DeepSparse (Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ) at 1.921x, Neural Magic DeepSparse (Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ) at 1.921x, Neural Magic DeepSparse (Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ) at 1.881x, Neural Magic DeepSparse (Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream ) at 1.874x.
323 Benchmarks Found In Common - Sort By: Greatest Spread
OpenBenchmarking.org MIPS, More Is Better 7-Zip Compression 22.01 Test: Decompression Rating AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 150K 300K 450K 600K 750K SE +/- 10341.63, N = 18 SE +/- 784.99, N = 16 706337 560839
OpenBenchmarking.org GFLOP/s, More Is Better ACES DGEMM 1.0 Sustained Floating-Point Rate 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 10 20 30 40 50 SE +/- 0.81, N = 4 SE +/- 0.84, N = 9 44.30 41.30
OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Degridding AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 9K 18K 27K 36K 45K SE +/- 702.01, N = 8 SE +/- 101.30, N = 3 44224 34329
OpenBenchmarking.org Mpix/sec, More Is Better ASKAP 1.0 Test: tConvolve MPI - Gridding AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 11K 22K 33K 44K 55K SE +/- 728.73, N = 8 SE +/- 100.07, N = 3 49413 42375
OpenBenchmarking.org Nodes/second, More Is Better asmFish 2018-07-23 1024 Hash Memory, 26 Depth AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 60M 120M 180M 240M 300M SE +/- 4258872.82, N = 13 SE +/- 2427798.41, N = 4 267795140 228477787
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.3 Blend File: BMW27 - Compute: CPU-Only 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 4 8 12 16 20 SE +/- 0.01, N = 4 SE +/- 0.26, N = 15 14.10 14.60
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.3 Blend File: Classroom - Compute: CPU-Only AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 8 16 24 32 40 SE +/- 0.70, N = 15 SE +/- 0.02, N = 4 35.90 35.90
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.3 Blend File: Fishy Cat - Compute: CPU-Only AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 5 10 15 20 25 SE +/- 0.32, N = 15 SE +/- 0.06, N = 4 19.20 20.10
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.3 Blend File: Barbershop - Compute: CPU-Only AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 2.18, N = 15 SE +/- 0.16, N = 4 135 150
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.3 Blend File: Pabellon Barcelona - Compute: CPU-Only AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 11 22 33 44 55 SE +/- 0.77, N = 15 SE +/- 0.05, N = 4 45.90 47.10
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: BMW27 - Compute: CPU-Only AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 4 8 12 16 20 SE +/- 0.68, N = 5 SE +/- 0.38, N = 13 14.30 14.90
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Classroom - Compute: CPU-Only 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 9 18 27 36 45 SE +/- 0.22, N = 8 SE +/- 1.98, N = 6 37.10 37.70
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Fishy Cat - Compute: CPU-Only AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 5 10 15 20 25 SE +/- 0.88, N = 5 SE +/- 0.10, N = 4 19.30 19.90
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Barbershop - Compute: CPU-Only AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 5.90, N = 5 SE +/- 0.52, N = 12 133 150
OpenBenchmarking.org Seconds, Fewer Is Better Blender 3.4 Blend File: Pabellon Barcelona - Compute: CPU-Only AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 11 22 33 44 55 SE +/- 2.14, N = 5 SE +/- 0.25, N = 4 45.80 47.30
OpenBenchmarking.org Seconds, Fewer Is Better Build2 0.15 Time To Compile AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 15 30 45 60 75 SE +/- 0.04, N = 6 SE +/- 0.16, N = 4 63 65
OpenBenchmarking.org Iterations/Sec, More Is Better Coremark 1.0 CoreMark Size 666 - Iterations Per Second 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 900K 1800K 2700K 3600K 4500K SE +/- 60227.15, N = 4 SE +/- 62829.40, N = 9 4404258 3912868
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Deepcoin 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 20K 40K 60K 80K 100K SE +/- 1317.56, N = 11 SE +/- 157.02, N = 5 103358 88372
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Garlicoin 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 12K 24K 36K 48K 60K SE +/- 3002.20, N = 7 SE +/- 951.67, N = 5 56546 47240
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Skeincoin AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 200K 400K 600K 800K 1000K SE +/- 426.49, N = 5 SE +/- 35053.50, N = 11 1049028 1019797
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: LBC, LBRY Credits 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 140K 280K 420K 560K 700K SE +/- 2078.56, N = 14 SE +/- 970.30, N = 5 670690 582034
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Quad SHA-256, Pyrite 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 300K 600K 900K 1200K 1500K SE +/- 6536.12, N = 10 SE +/- 2854.62, N = 5 1473030 1298098
OpenBenchmarking.org kH/s, More Is Better Cpuminer-Opt 3.20.3 Algorithm: Triple SHA-256, Onecoin 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 500K 1000K 1500K 2000K 2500K SE +/- 13805.19, N = 12 SE +/- 4095.34, N = 5 2123578 1846170
OpenBenchmarking.org FPS, More Is Better dav1d 1.1 Video Input: Chimera 1080p AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 140 280 420 560 700 SE +/- 0.23, N = 6 SE +/- 0.92, N = 3 657 538
OpenBenchmarking.org FPS, More Is Better dav1d 1.1 Video Input: Summer Nature 4K AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 80 160 240 320 400 SE +/- 0.77, N = 6 SE +/- 0.08, N = 3 382 276
OpenBenchmarking.org FPS, More Is Better dav1d 1.1 Video Input: Chimera 1080p 10-bit AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 130 260 390 520 650 SE +/- 0.16, N = 6 SE +/- 0.18, N = 3 603 487
OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer - Model: Crown AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 2.38, N = 8 SE +/- 0.75, N = 4 109 86
OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Crown AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 2.59, N = 8 SE +/- 4.02, N = 10 117 86
OpenBenchmarking.org Frames Per Second, More Is Better Embree 3.13 Binary: Pathtracer ISPC - Model: Asian Dragon AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 3.26, N = 9 SE +/- 4.59, N = 9 144 117
OpenBenchmarking.org Mpx/s, More Is Better Etcpak 1.0 Benchmark: Multi-Threaded - Configuration: ETC2 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 2K 4K 6K 8K 10K SE +/- 14.72, N = 8 SE +/- 179.34, N = 3 9297 6597
OpenBenchmarking.org bfs median_TEPS, More Is Better Graph500 3.0 Scale: 26 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200M 400M 600M 800M 1000M SE +/- 7216666.67, N = 3 SE +/- 4525368.64, N = 8 1036953333 875341000
OpenBenchmarking.org bfs max_TEPS, More Is Better Graph500 3.0 Scale: 26 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200M 400M 600M 800M 1000M SE +/- 8686666.67, N = 3 SE +/- 4702633.97, N = 8 1083063333 894171000
OpenBenchmarking.org sssp median_TEPS, More Is Better Graph500 3.0 Scale: 26 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 90M 180M 270M 360M 450M SE +/- 862072.03, N = 9 SE +/- 402990.49, N = 4 415467111 373958000
OpenBenchmarking.org sssp max_TEPS, More Is Better Graph500 3.0 Scale: 26 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 110M 220M 330M 440M 550M SE +/- 846436.32, N = 9 SE +/- 200629.22, N = 4 525609667 512262500
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Sharpen 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 1.63, N = 8 SE +/- 27.41, N = 9 1159 912
OpenBenchmarking.org Iterations Per Minute, More Is Better GraphicsMagick 1.3.38 Operation: Enhanced 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 400 800 1200 1600 2000 SE +/- 2.18, N = 8 SE +/- 41.46, N = 9 1766 1534
OpenBenchmarking.org Ns Per Day, More Is Better GROMACS 2022.1 Implementation: MPI CPU - Input: water_GMX50_bare 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 4 8 12 16 20 SE +/- 0.12, N = 10 SE +/- 0.35, N = 10 14.70 11.80
OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: PNG - Quality: 100 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 0.1845 0.369 0.5535 0.738 0.9225 SE +/- 0.00, N = 4 SE +/- 0.00, N = 6 0.80 0.60
OpenBenchmarking.org MP/s, More Is Better JPEG XL libjxl 0.7 Input: JPEG - Quality: 100 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 0.1665 0.333 0.4995 0.666 0.8325 SE +/- 0.01, N = 4 SE +/- 0.00, N = 6 0.70 0.60
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Slow AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 0.32, N = 3 SE +/- 0.30, N = 6 140 103
OpenBenchmarking.org Frames Per Second, More Is Better Kvazaar 2.2 Video Input: Bosphorus 1080p - Video Preset: Medium AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 0.26, N = 3 SE +/- 0.28, N = 6 144 108
OpenBenchmarking.org Nodes Per Second, More Is Better LeelaChessZero 0.28 Backend: Eigen 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 2K 4K 6K 8K 10K SE +/- 449.73, N = 8 SE +/- 157.59, N = 9 11019 9657
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 2021.01.31 Threads: 32 - Buffer Length: 256 - Filter Length: 57 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 500M 1000M 1500M 2000M 2500M SE +/- 2929224.67, N = 8 SE +/- 14974499.24, N = 4 2276550000 2191141667
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 2021.01.31 Threads: 64 - Buffer Length: 256 - Filter Length: 57 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 900M 1800M 2700M 3600M 4500M SE +/- 81719371.69, N = 10 SE +/- 47913356.99, N = 6 4354603333 4248333333
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 2021.01.31 Threads: 128 - Buffer Length: 256 - Filter Length: 57 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 1400M 2800M 4200M 5600M 7000M SE +/- 91259106.99, N = 11 SE +/- 138757546.87, N = 13 6316515152 5782323077
OpenBenchmarking.org samples/s, More Is Better Liquid-DSP 2021.01.31 Threads: 256 - Buffer Length: 256 - Filter Length: 57 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 1400M 2800M 4200M 5600M 7000M SE +/- 60217633.08, N = 4 SE +/- 166335804.92, N = 9 6524866667 5614266667
OpenBenchmarking.org z/s, More Is Better LULESH 2.0.3 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 10K 20K 30K 40K 50K SE +/- 72.49, N = 4 SE +/- 177.88, N = 9 45956 29959
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: DLSC - Acceleration: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 4 8 12 16 20 SE +/- 0.44, N = 10 SE +/- 0.08, N = 3 15.90 10.50
OpenBenchmarking.org M samples/sec, More Is Better LuxCoreRender 2.6 Scene: Orange Juice - Acceleration: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 5 10 15 20 25 SE +/- 0.33, N = 10 SE +/- 0.24, N = 3 22.70 17.20
OpenBenchmarking.org days/ns, Fewer Is Better NAMD 2.14 ATPase Simulation - 327,506 Atoms AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 0.0583 0.1166 0.1749 0.2332 0.2915 SE +/- 0.00405, N = 13 SE +/- 0.00226, N = 10 0.23000 0.26000
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 20 40 60 80 100 SE +/- 2.57, N = 10 SE +/- 0.76, N = 18 90.00 47.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 27.10, N = 9 SE +/- 31.09, N = 6 673 1017
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 8 16 24 32 40 SE +/- 0.21, N = 15 SE +/- 0.63, N = 9 37.00 26.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 9 18 27 36 45 SE +/- 0.17, N = 13 SE +/- 1.10, N = 9 27.00 39.00
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 90 180 270 360 450 SE +/- 3.21, N = 18 SE +/- 12.93, N = 10 418 348
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 120 240 360 480 600 SE +/- 18.80, N = 10 SE +/- 6.12, N = 18 575 479
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 1.52, N = 14 SE +/- 5.18, N = 9 101 106
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 1.15, N = 11 SE +/- 2.93, N = 9 195 102
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Detection,YOLOv5s COCO - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.030, N = 11 SE +/- 0.304, N = 9 5.120 9.880
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 300 600 900 1200 1500 SE +/- 66.40, N = 10 SE +/- 14.14, N = 18 1430 1086
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 60 120 180 240 300 SE +/- 9.19, N = 10 SE +/- 0.19, N = 14 269 192
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 1.1702 2.3404 3.5106 4.6808 5.851 SE +/- 0.1748, N = 10 SE +/- 0.0052, N = 14 3.7600 5.2000
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 32.71, N = 9 SE +/- 4.69, N = 17 846 651
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 0.83, N = 13 SE +/- 0.30, N = 7 193 103
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.022, N = 13 SE +/- 0.029, N = 7 5.180 9.730
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 90 180 270 360 450 SE +/- 17.80, N = 9 SE +/- 2.50, N = 17 407 330
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 0.28, N = 13 SE +/- 0.22, N = 7 89.00 53.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 5 10 15 20 25 SE +/- 0.04, N = 13 SE +/- 0.08, N = 7 11.30 19.00
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 20 40 60 80 100 SE +/- 2.55, N = 10 SE +/- 0.77, N = 18 90.00 47.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 26.75, N = 9 SE +/- 30.04, N = 6 674 1016
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 8 16 24 32 40 SE +/- 0.22, N = 15 SE +/- 0.62, N = 9 37.00 26.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.1 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 9 18 27 36 45 SE +/- 0.18, N = 13 SE +/- 1.09, N = 9 27.00 38.00
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 20 40 60 80 100 SE +/- 1.46, N = 5 SE +/- 0.12, N = 9 88.00 43.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 10.55, N = 5 SE +/- 1.67, N = 9 675 1113
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 8 16 24 32 40 SE +/- 0.10, N = 9 SE +/- 0.09, N = 3 35.00 26.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Document Classification, oBERT base uncased on IMDB - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 9 18 27 36 45 SE +/- 0.08, N = 9 SE +/- 0.13, N = 3 28.00 38.00
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 0.78, N = 9 SE +/- 2.31, N = 5 1569 1200
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 11 22 33 44 55 SE +/- 0.01, N = 9 SE +/- 0.09, N = 5 31.00 50.00
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 0.54, N = 9 SE +/- 0.20, N = 3 197 178
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Sentiment Analysis, 80% Pruned Quantized BERT Base Uncased - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 1.2598 2.5196 3.7794 5.0392 6.299 SE +/- 0.014, N = 9 SE +/- 0.006, N = 3 5.080 5.600
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 90 180 270 360 450 SE +/- 0.23, N = 9 SE +/- 0.34, N = 5 400 360
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 0.06, N = 9 SE +/- 0.14, N = 5 120 166
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 0.45, N = 9 SE +/- 0.48, N = 3 101 82
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Question Answering, BERT base uncased SQuaD 12layer Pruned90 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.044, N = 9 SE +/- 0.070, N = 3 9.950 12.170
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 130 260 390 520 650 SE +/- 0.95, N = 5 SE +/- 0.28, N = 9 591 440
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Detection, YOLOv5s COCO - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 20 40 60 80 100 SE +/- 0.16, N = 5 SE +/- 0.08, N = 9 101 109
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 300 600 900 1200 1500 SE +/- 0.82, N = 5 SE +/- 1.48, N = 9 1483 1006
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 11 22 33 44 55 SE +/- 0.03, N = 5 SE +/- 0.07, N = 9 40.40 47.60
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 60 120 180 240 300 SE +/- 0.48, N = 3 SE +/- 1.95, N = 9 273 191
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Classification, ResNet-50 ImageNet - Scenario: Synchronous Single-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 1.177 2.354 3.531 4.708 5.885 SE +/- 0.0066, N = 3 SE +/- 0.0548, N = 9 3.6600 5.2300
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 36.82, N = 5 SE +/- 0.83, N = 9 787 624
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 0.10, N = 9 SE +/- 3.47, N = 5 77 77
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 0.36, N = 9 SE +/- 0.23, N = 3 194 101
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, DistilBERT mnli - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.010, N = 9 SE +/- 0.022, N = 3 5.140 9.880
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 0.10, N = 9 SE +/- 0.05, N = 5 149 144
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 90 180 270 360 450 SE +/- 0.21, N = 9 SE +/- 0.28, N = 5 321 416
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 14 28 42 56 70 SE +/- 0.34, N = 9 SE +/- 0.03, N = 3 62.00 38.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: CV Segmentation, 90% Pruned YOLACT Pruned - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 6 12 18 24 30 SE +/- 0.09, N = 9 SE +/- 0.02, N = 3 16.20 26.10
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 80 160 240 320 400 SE +/- 17.14, N = 5 SE +/- 0.59, N = 9 382 317
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Asynchronous Multi-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 0.26, N = 9 SE +/- 6.81, N = 5 151 158
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 0.15, N = 9 SE +/- 0.04, N = 3 89.00 52.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Text Classification, BERT base uncased SST2 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 5 10 15 20 25 SE +/- 0.02, N = 9 SE +/- 0.02, N = 3 11.30 19.10
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 20 40 60 80 100 SE +/- 1.48, N = 5 SE +/- 0.14, N = 9 88.00 43.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Asynchronous Multi-Stream 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 10.61, N = 5 SE +/- 1.24, N = 9 675 1112
OpenBenchmarking.org items/sec, More Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 8 16 24 32 40 SE +/- 0.09, N = 9 SE +/- 0.04, N = 3 35.00 26.00
OpenBenchmarking.org ms/batch, Fewer Is Better Neural Magic DeepSparse 1.3.2 Model: NLP Token Classification, BERT base uncased conll2003 - Scenario: Synchronous Single-Stream AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 9 18 27 36 45 SE +/- 0.07, N = 9 SE +/- 0.06, N = 3 28.00 38.00
OpenBenchmarking.org Requests Per Second, More Is Better nginx 1.23.2 Connections: 500 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 50K 100K 150K 200K 250K SE +/- 696.61, N = 6 SE +/- 3824.65, N = 20 239881 239824
OpenBenchmarking.org ms, Fewer Is Better oneDNN 2.6 Harness: Convolution Batch Shapes Auto - Data Type: u8s8f32 - Engine: CPU 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 0.0638 0.1276 0.1914 0.2552 0.319 SE +/- 0.00232, N = 4 SE +/- 0.00083, N = 9 0.26000 0.28000
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 0.533 1.066 1.599 2.132 2.665 SE +/- 0.06600, N = 5 SE +/- 0.08258, N = 6 1.67000 2.37000
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: IP Shapes 3D - Data Type: u8s8f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 0.2269 0.4538 0.6807 0.9076 1.1345 SE +/- 0.00717, N = 4 SE +/- 0.04705, N = 6 0.53000 1.01000
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.033, N = 5 SE +/- 0.053, N = 6 7.380 13.430
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Deconvolution Batch shapes_1d - Data Type: u8s8f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 0.1246 0.2492 0.3738 0.4984 0.623 SE +/- 0.02171, N = 4 SE +/- 0.00377, N = 6 0.53000 0.55000
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 200 400 600 800 1000 SE +/- 12.99, N = 5 SE +/- 6.29, N = 6 927 1112
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 200 400 600 800 1000 SE +/- 25.28, N = 6 SE +/- 5.08, N = 6 721 890
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Training - Data Type: u8s8f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 12.81, N = 4 SE +/- 26.60, N = 6 926 1167
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Recurrent Neural Network Inference - Data Type: u8s8f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 200 400 600 800 1000 SE +/- 19.01, N = 5 SE +/- 5.89, N = 6 701 833
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 0.0819 0.1638 0.2457 0.3276 0.4095 SE +/- 0.00802, N = 5 SE +/- 0.00069, N = 6 0.34000 0.36000
OpenBenchmarking.org ms, Fewer Is Better oneDNN 3.0 Harness: Matrix Multiply Batch Shapes Transformer - Data Type: u8s8f32 - Engine: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 0.0692 0.1384 0.2076 0.2768 0.346 SE +/- 0.01396, N = 4 SE +/- 0.00161, N = 6 0.25000 0.31000
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.14 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 50 100 150 200 250 SE +/- 5.60, N = 6 SE +/- 0.55, N = 5 216 176
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.14 Model: ResNet50 v1-12-int8 - Device: CPU - Executor: Standard AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 1.2762 2.5524 3.8286 5.1048 6.381 SE +/- 0.11556, N = 6 SE +/- 0.01771, N = 5 4.64000 5.67000
OpenBenchmarking.org Inferences Per Second, More Is Better ONNX Runtime 1.14 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 9 18 27 36 45 SE +/- 0.44, N = 5 SE +/- 0.07, N = 6 39.40 37.20
OpenBenchmarking.org Inference Time Cost (ms), Fewer Is Better ONNX Runtime 1.14 Model: Faster R-CNN R-50-FPN-int8 - Device: CPU - Executor: Standard 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 6 12 18 24 30 SE +/- 0.29, N = 5 SE +/- 0.05, N = 6 25.40 26.90
OpenBenchmarking.org ms, Fewer Is Better OpenCV 4.7 Test: Core AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 70K 140K 210K 280K 350K SE +/- 687.22, N = 6 SE +/- 5828.93, N = 4 66590 338508
OpenBenchmarking.org ms, Fewer Is Better OpenCV 4.7 Test: Video AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 9K 18K 27K 36K 45K SE +/- 932.14, N = 6 SE +/- 1435.00, N = 4 39105 43229
OpenBenchmarking.org ms, Fewer Is Better OpenCV 4.7 Test: Graph API AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 50K 100K 150K 200K 250K SE +/- 5174.94, N = 6 SE +/- 1993.88, N = 4 214176 233036
OpenBenchmarking.org ms, Fewer Is Better OpenCV 4.7 Test: Stitching AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 70K 140K 210K 280K 350K SE +/- 176.72, N = 6 SE +/- 1986.66, N = 4 191103 345805
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Small Mesh Size - Execution Time AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 7 14 21 28 35 SE +/- 0.48, N = 18 SE +/- 0.04, N = 10 27.00 29.20
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Mesh Time AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 3.18, N = 15 SE +/- 4.17, N = 3 121 162
OpenBenchmarking.org Seconds, Fewer Is Better OpenFOAM 10 Input: drivaerFastback, Medium Mesh Size - Execution Time 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 60 120 180 240 300 SE +/- 0.44, N = 12 SE +/- 7.31, N = 18 195 254
OpenBenchmarking.org Seconds, Fewer Is Better OpenRadioss 2022.10.13 Model: INIVOL and Fluid Structure Interaction Drop Container AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 1.57, N = 18 SE +/- 0.06, N = 10 96 112
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.0 Algorithm: SHA256 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30000M 60000M 90000M 120000M 150000M SE +/- 2726819783.44, N = 12 SE +/- 568472693.33, N = 3 138606282295 123450949007
OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.0 Algorithm: RSA4096 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 6K 12K 18K 24K 30K SE +/- 25.06, N = 4 SE +/- 511.70, N = 13 28562 24447
OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.0 Algorithm: RSA4096 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 400K 800K 1200K 1600K 2000K SE +/- 1826.74, N = 4 SE +/- 32045.82, N = 13 1888631 1604033
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: SHA256 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30000M 60000M 90000M 120000M 150000M SE +/- 111583679.44, N = 6 SE +/- 282304299.54, N = 4 129831565167 119887813260
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: SHA512 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 9000M 18000M 27000M 36000M 45000M SE +/- 128403023.18, N = 4 SE +/- 4878025.60, N = 6 42584961580 40016665407
OpenBenchmarking.org sign/s, More Is Better OpenSSL 3.1 Algorithm: RSA4096 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 12K 24K 36K 48K 60K SE +/- 12.30, N = 4 SE +/- 4.21, N = 6 53944 35955
OpenBenchmarking.org verify/s, More Is Better OpenSSL 3.1 Algorithm: RSA4096 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 400K 800K 1200K 1600K 2000K SE +/- 10300.02, N = 4 SE +/- 31.65, N = 6 1915733 1462888
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: ChaCha20 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 130000M 260000M 390000M 520000M 650000M SE +/- 10617442.58, N = 4 SE +/- 890687472.57, N = 6 623647198960 509445500657
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: AES-128-GCM 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 300000M 600000M 900000M 1200000M 1500000M SE +/- 343208757.16, N = 4 SE +/- 366627443.59, N = 6 1533477873325 909661129117
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: AES-256-GCM 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 300000M 600000M 900000M 1200000M 1500000M SE +/- 3720868072.60, N = 4 SE +/- 710186461.91, N = 6 1245381756380 778652816267
OpenBenchmarking.org byte/s, More Is Better OpenSSL 3.1 Algorithm: ChaCha20-Poly1305 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 90000M 180000M 270000M 360000M 450000M SE +/- 383925515.98, N = 4 SE +/- 7207083.74, N = 6 435471863810 356984177093
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP16 - Device: CPU 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 9 18 27 36 45 SE +/- 0.16, N = 4 SE +/- 0.29, N = 13 40.00 29.00
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Person Detection FP32 - Device: CPU 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 9 18 27 36 45 SE +/- 0.25, N = 4 SE +/- 0.29, N = 13 40.00 29.00
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Vehicle Detection FP16-INT8 - Device: CPU AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 1400 2800 4200 5600 7000 SE +/- 88.67, N = 12 SE +/- 59.70, N = 3 6417 6158
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.2.dev Model: Machine Translation EN To DE FP16 - Device: CPU 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 160 320 480 640 800 SE +/- 16.59, N = 4 SE +/- 5.89, N = 13 748 574
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP16 - Device: CPU 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 9 18 27 36 45 SE +/- 0.49, N = 6 SE +/- 0.78, N = 4 40.00 28.00
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Person Detection FP32 - Device: CPU 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 9 18 27 36 45 SE +/- 0.41, N = 6 SE +/- 0.71, N = 4 40.00 27.00
OpenBenchmarking.org FPS, More Is Better OpenVINO 2022.3 Model: Vehicle Detection FP16-INT8 - Device: CPU 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 1300 2600 3900 5200 6500 SE +/- 281.93, N = 8 SE +/- 117.36, N = 4 5834 5783
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/ao/real_time 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 8 16 24 32 40 SE +/- 1.37, N = 10 SE +/- 0.71, N = 9 35.40 28.30
OpenBenchmarking.org Items Per Second, More Is Better OSPRay 2.10 Benchmark: gravity_spheres_volume/dim_512/pathtracer/real_time 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 9 18 27 36 45 SE +/- 2.53, N = 4 SE +/- 0.91, N = 9 40.10 33.50
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 12.26, N = 10 SE +/- 25.30, N = 9 870 996
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 0.67, N = 8 SE +/- 25.47, N = 9 878 1007
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 1 - Renderer: Path Tracer 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 300 600 900 1200 1500 SE +/- 13.86, N = 10 SE +/- 29.51, N = 9 1045 1188
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 3K 6K 9K 12K 15K SE +/- 5.91, N = 11 SE +/- 395.11, N = 9 13592 15971
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 1 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 7K 14K 21K 28K 35K SE +/- 24.32, N = 11 SE +/- 796.37, N = 9 27211 31963
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 3K 6K 9K 12K 15K SE +/- 5.27, N = 10 SE +/- 392.83, N = 9 13852 16168
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 2 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 7K 14K 21K 28K 35K SE +/- 14.33, N = 10 SE +/- 809.54, N = 9 27689 32275
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 16 - Renderer: Path Tracer 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 4K 8K 12K 16K 20K SE +/- 7.14, N = 11 SE +/- 467.14, N = 9 16364 19046
OpenBenchmarking.org ms, Fewer Is Better OSPRay Studio 0.11 Camera: 3 - Resolution: 4K - Samples Per Pixel: 32 - Renderer: Path Tracer 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 8K 16K 24K 32K 40K SE +/- 33.33, N = 11 SE +/- 954.48, N = 9 32842 38077
OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: sedovbig AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.120, N = 8 SE +/- 0.027, N = 3 5.530 11.350
OpenBenchmarking.org Hydro Cycle Time - Seconds, Fewer Is Better Pennant 1.0.1 Test: leblancbig 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 0.8086 1.6172 2.4258 3.2344 4.043 SE +/- 0.04863, N = 4 SE +/- 0.06685, N = 9 2.65000 3.59000
OpenBenchmarking.org Responses Per Second, More Is Better PJSIP 2.11 Method: OPTIONS, Stateless AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20K 40K 60K 80K 100K SE +/- 32.13, N = 8 SE +/- 108.33, N = 3 87813 34499
OpenBenchmarking.org Milliseconds, Fewer Is Better PyBench 2018-02-16 Total For Average Test Times 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 200 400 600 800 1000 SE +/- 14.74, N = 10 SE +/- 1.58, N = 9 765 859
OpenBenchmarking.org MFLOPS, More Is Better QuantLib 1.21 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 700 1400 2100 2800 3500 SE +/- 2.54, N = 4 SE +/- 2.60, N = 9 3163 3035
OpenBenchmarking.org Seconds, Fewer Is Better RELION 3.1.1 Test: Basic - Device: CPU 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 50 100 150 200 250 SE +/- 0.43, N = 4 SE +/- 0.36, N = 9 208 246
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Random Read 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 130M 260M 390M 520M 650M SE +/- 18084084.72, N = 16 SE +/- 9189417.92, N = 4 620109994 458545493
OpenBenchmarking.org Op/s, More Is Better RocksDB 7.9.2 Test: Read While Writing 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 2M 4M 6M 8M 10M SE +/- 456021.00, N = 10 SE +/- 293777.64, N = 4 10733850 8954980
OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Sequential Fill AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 140K 280K 420K 560K 700K SE +/- 342.07, N = 6 SE +/- 7548.07, N = 7 661814 528129
OpenBenchmarking.org Op/s, More Is Better RocksDB 8.0 Test: Random Fill Sync 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 100K 200K 300K 400K 500K SE +/- 19541.88, N = 7 SE +/- 1155.80, N = 6 489057 448134
OpenBenchmarking.org Seconds, Fewer Is Better Rodinia 3.1 Test: OpenMP LavaMD 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 6 12 18 24 30 SE +/- 0.07, N = 4 SE +/- 0.72, N = 9 26.60 26.80
OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: Kostya AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 0.9248 1.8496 2.7744 3.6992 4.624 SE +/- 0.00, N = 8 SE +/- 0.01, N = 3 4.10 3.50
OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: TopTweet 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 2 4 6 8 10 SE +/- 0.02, N = 8 SE +/- 0.00, N = 9 6.80 6.60
OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: LargeRandom 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 0.2858 0.5716 0.8574 1.1432 1.429 SE +/- 0.01, N = 6 SE +/- 0.00, N = 9 1.30 1.30
OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: PartialTweets AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 1.2758 2.5516 3.8274 5.1032 6.379 SE +/- 0.00, N = 9 SE +/- 0.06, N = 8 5.70 5.50
OpenBenchmarking.org GB/s, More Is Better simdjson 2.0 Throughput Test: DistinctUserID AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 2 4 6 8 10 SE +/- 0.00, N = 9 SE +/- 0.11, N = 4 6.80 6.70
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Mount St. Helens 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 2 4 6 8 10 SE +/- 0.118, N = 10 SE +/- 0.052, N = 6 7.440 8.420
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Layered Halfspace 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 5 10 15 20 25 SE +/- 0.44, N = 10 SE +/- 0.07, N = 6 16.40 19.70
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Tomographic Model AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 2 4 6 8 10 SE +/- 0.049, N = 6 SE +/- 0.253, N = 10 8.620 8.810
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Homogeneous Halfspace AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.06, N = 6 SE +/- 0.40, N = 10 10.60 10.90
OpenBenchmarking.org Seconds, Fewer Is Better SPECFEM3D 4.0 Model: Water-layered Halfspace 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 5 10 15 20 25 SE +/- 0.30, N = 10 SE +/- 0.11, N = 6 17.10 20.30
OpenBenchmarking.org Samples / Second, More Is Better srsRAN 22.04.1 Test: OFDM_Test AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30M 60M 90M 120M 150M SE +/- 144313.64, N = 8 SE +/- 1524987.45, N = 6 161618182 155538889
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 64-QAM AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 0.02, N = 8 SE +/- 0.46, N = 6 158 132
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 64-QAM AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 0.00, N = 8 SE +/- 0.44, N = 6 167 142
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB MIMO 256-QAM AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 0.04, N = 8 SE +/- 0.70, N = 6 166 142
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 4G PHY_DL_Test 100 PRB SISO 256-QAM AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 0.13, N = 8 SE +/- 0.23, N = 6 172 153
OpenBenchmarking.org eNb Mb/s, More Is Better srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 0.08, N = 8 SE +/- 0.54, N = 6 140 132
OpenBenchmarking.org UE Mb/s, More Is Better srsRAN 22.04.1 Test: 5G PHY_DL_NR Test 52 PRB SISO 64-QAM AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 0.43, N = 8 SE +/- 0.74, N = 6 93 85
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: MMAP 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 1000 2000 3000 4000 5000 SE +/- 85.08, N = 8 SE +/- 0.42, N = 5 4685 1912
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Crypto AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40K 80K 120K 160K 200K SE +/- 122.16, N = 5 SE +/- 539.28, N = 11 183936 154946
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Malloc AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 90M 180M 270M 360M 450M SE +/- 461679.93, N = 5 SE +/- 7365477.44, N = 10 430478475 340840600
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: SENDFILE 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 400K 800K 1200K 1600K 2000K SE +/- 21826.46, N = 10 SE +/- 47016.30, N = 5 2022105 1667626
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: CPU Stress AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 50K 100K 150K 200K 250K SE +/- 269.96, N = 5 SE +/- 8132.70, N = 6 250518 144998
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Matrix Math 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 120K 240K 360K 480K 600K SE +/- 9639.53, N = 12 SE +/- 820.71, N = 5 542855 479128
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Vector Math AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 140K 280K 420K 560K 700K SE +/- 881.57, N = 5 SE +/- 8339.04, N = 12 661695 566740
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc C String Functions 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 4M 8M 12M 16M 20M SE +/- 534371.03, N = 9 SE +/- 35947.26, N = 5 18539435 15434708
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.14.06 Test: Glibc Qsort Data Sorting 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 400 800 1200 1600 2000 SE +/- 6.18, N = 5 SE +/- 1.97, N = 5 1709 1505
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Futex AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 600K 1200K 1800K 2400K 3000K SE +/- 3751.36, N = 3 SE +/- 2103.15, N = 5 2798335 71513
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Mutex AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 13M 26M 39M 52M 65M SE +/- 169481.02, N = 3 SE +/- 2535346.22, N = 5 59813576 47277591
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Crypto 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 50K 100K 150K 200K 250K SE +/- 4762.25, N = 11 SE +/- 21.92, N = 3 219616 203105
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Malloc AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 70M 140M 210M 280M 350M SE +/- 498178.92, N = 3 SE +/- 7625549.12, N = 11 313632089 266737914
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Pthread AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20K 40K 60K 80K 100K SE +/- 78.19, N = 3 SE +/- 932.92, N = 7 109455 76604
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: SENDFILE AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 400K 800K 1200K 1600K 2000K SE +/- 17233.58, N = 3 SE +/- 27482.87, N = 5 1918372 1192631
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: CPU Stress 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 60K 120K 180K 240K 300K SE +/- 13059.47, N = 7 SE +/- 4018.34, N = 3 264963 213170
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Matrix Math 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 130K 260K 390K 520K 650K SE +/- 1635.53, N = 7 SE +/- 7.89, N = 3 593294 382313
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Vector Math AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 120K 240K 360K 480K 600K SE +/- 22.63, N = 3 SE +/- 22798.41, N = 7 556835 514919
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Function Call 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 150K 300K 450K 600K 750K SE +/- 29426.99, N = 7 SE +/- 11.26, N = 3 685896 621020
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Glibc C String Functions 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 4M 8M 12M 16M 20M SE +/- 609943.67, N = 11 SE +/- 111329.71, N = 3 18929584 16321240
OpenBenchmarking.org Bogo Ops/s, More Is Better Stress-NG 0.15.04 Test: Glibc Qsort Data Sorting 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 300 600 900 1200 1500 SE +/- 33.88, N = 11 SE +/- 2.92, N = 3 1359 1127
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 4 - Input: Bosphorus 4K AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 1.1941 2.3882 3.5823 4.7764 5.9705 SE +/- 0.017, N = 4 SE +/- 0.003, N = 6 5.310 4.540
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 4K AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 4.41, N = 4 SE +/- 1.59, N = 8 88.50 76.10
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 12 - Input: Bosphorus 4K AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 50 100 150 200 250 SE +/- 9.28, N = 4 SE +/- 2.77, N = 11 245 207
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 4 - Input: Bosphorus 1080p AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.01, N = 4 SE +/- 0.04, N = 4 12.60 11.30
OpenBenchmarking.org Frames Per Second, More Is Better SVT-AV1 1.4 Encoder Mode: Preset 8 - Input: Bosphorus 1080p AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 0.14, N = 4 SE +/- 1.26, N = 4 205 173
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: AlexNet 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 80 160 240 320 400 SE +/- 11.00, N = 4 SE +/- 2.17, N = 4 368 363
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: AlexNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 130 260 390 520 650 SE +/- 5.51, N = 4 SE +/- 0.61, N = 4 591 545
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: AlexNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 200 400 600 800 1000 SE +/- 9.29, N = 4 SE +/- 1.10, N = 4 853 716
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: AlexNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 21.31, N = 4 SE +/- 4.80, N = 4 1295 1049
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: AlexNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 26.99, N = 4 SE +/- 4.78, N = 6 1418 1161
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: GoogLeNet 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 40 80 120 160 200 SE +/- 0.36, N = 4 SE +/- 3.53, N = 4 160 141
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 16 - Model: ResNet-50 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 14 28 42 56 70 SE +/- 0.29, N = 4 SE +/- 0.23, N = 4 60.30 52.80
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: GoogLeNet 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 50 100 150 200 250 SE +/- 4.34, N = 4 SE +/- 3.19, N = 4 241 224
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 32 - Model: ResNet-50 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 20 40 60 80 100 SE +/- 0.03, N = 4 SE +/- 0.35, N = 4 81.40 76.40
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: GoogLeNet 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 70 140 210 280 350 SE +/- 2.44, N = 4 SE +/- 4.31, N = 4 315 307
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 64 - Model: ResNet-50 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 20 40 60 80 100 SE +/- 1.14, N = 4 SE +/- 0.22, N = 4 101 101
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: GoogLeNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 100 200 300 400 500 SE +/- 6.57, N = 4 SE +/- 0.90, N = 4 484 439
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: GoogLeNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 120 240 360 480 600 SE +/- 8.20, N = 4 SE +/- 0.63, N = 6 544 467
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 256 - Model: ResNet-50 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 30 60 90 120 150 SE +/- 1.05, N = 4 SE +/- 0.79, N = 4 148 129
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.10 Device: CPU - Batch Size: 512 - Model: ResNet-50 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 40 80 120 160 200 SE +/- 2.30, N = 4 SE +/- 0.27, N = 6 169 134
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: AlexNet 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 80 160 240 320 400 SE +/- 4.17, N = 5 SE +/- 0.44, N = 6 382 355
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: AlexNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 130 260 390 520 650 SE +/- 0.49, N = 6 SE +/- 6.44, N = 5 593 549
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: AlexNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 200 400 600 800 1000 SE +/- 0.93, N = 6 SE +/- 2.12, N = 5 856 744
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 256 - Model: AlexNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 0.91, N = 6 SE +/- 5.35, N = 5 1275 1073
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 512 - Model: AlexNet AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 0.69, N = 6 SE +/- 3.09, N = 5 1377 1226
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: GoogLeNet 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 40 80 120 160 200 SE +/- 2.51, N = 5 SE +/- 3.35, N = 6 181 153
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 16 - Model: ResNet-50 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 14 28 42 56 70 SE +/- 0.20, N = 5 SE +/- 0.10, N = 6 64.30 57.70
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: GoogLeNet 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 60 120 180 240 300 SE +/- 3.71, N = 5 SE +/- 0.41, N = 6 262 240
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 32 - Model: ResNet-50 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 20 40 60 80 100 SE +/- 0.33, N = 5 SE +/- 0.27, N = 6 84.00 81.00
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: GoogLeNet 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 70 140 210 280 350 SE +/- 2.49, N = 5 SE +/- 3.83, N = 6 343 307
OpenBenchmarking.org images/sec, More Is Better TensorFlow 2.12 Device: CPU - Batch Size: 64 - Model: ResNet-50 AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 0.22, N = 6 SE +/- 0.38, N = 5 105 103
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 4K - Video Preset: Slow AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 7 14 21 28 35 SE +/- 0.04, N = 3 SE +/- 0.14, N = 11 29.40 25.20
OpenBenchmarking.org Frames Per Second, More Is Better uvg266 0.4.1 Video Input: Bosphorus 1080p - Video Preset: Slow AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20 40 60 80 100 SE +/- 0.09, N = 3 SE +/- 0.15, N = 9 81.00 62.00
OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 0 - Input: Bosphorus 1080p AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 4 8 12 16 20 SE +/- 0.03, N = 3 SE +/- 0.15, N = 3 14.70 12.80
OpenBenchmarking.org Frames Per Second, More Is Better VP9 libvpx Encoding 1.13 Speed: Speed 5 - Input: Bosphorus 1080p AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 7 14 21 28 35 SE +/- 0.04, N = 3 SE +/- 0.06, N = 3 29.40 27.20
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Fast AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 1.3077 2.6154 3.9231 5.2308 6.5385 SE +/- 0.004, N = 3 SE +/- 0.016, N = 8 5.810 4.840
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 4K - Video Preset: Faster AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.020, N = 3 SE +/- 0.075, N = 8 12.380 9.150
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Fast AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 3 6 9 12 15 SE +/- 0.01, N = 3 SE +/- 0.09, N = 4 12.40 10.50
OpenBenchmarking.org Frames Per Second, More Is Better VVenC 1.7 Video Input: Bosphorus 1080p - Video Preset: Faster AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 7 14 21 28 35 SE +/- 0.07, N = 3 SE +/- 0.03, N = 4 30.00 24.00
OpenBenchmarking.org Seconds, Fewer Is Better WRF 4.2.2 Input: conus 2.5km 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 1600 3200 4800 6400 8000 SE +/- 13.20, N = 4 SE +/- 53.75, N = 9 6601 7540
OpenBenchmarking.org H/s, More Is Better Xmrig 6.12.1 Variant: Monero - Hash Count: 1M AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 13K 26K 39K 52K 65K SE +/- 814.40, N = 8 SE +/- 205.13, N = 3 60891 45640
OpenBenchmarking.org H/s, More Is Better Xmrig 6.12.1 Variant: Wownero - Hash Count: 1M AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20K 40K 60K 80K 100K SE +/- 1187.98, N = 8 SE +/- 196.40, N = 3 78974 60712
OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Monero - Hash Count: 1M AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 14K 28K 42K 56K 70K SE +/- 53.13, N = 5 SE +/- 81.02, N = 8 63122 46044
OpenBenchmarking.org H/s, More Is Better Xmrig 6.18.1 Variant: Wownero - Hash Count: 1M AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 20K 40K 60K 80K 100K SE +/- 112.14, N = 5 SE +/- 40.84, N = 8 81683 61394
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3 - Compression Speed 2 x Intel Xeon Platinum 8490H AMD EPYC 9654 96-Core 800 1600 2400 3200 4000 SE +/- 24.03, N = 3 SE +/- 18.34, N = 3 3729 3059
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3 - Decompression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 0.77, N = 3 SE +/- 4.31, N = 3 1516 1330
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8 - Compression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 3.07, N = 9 SE +/- 2.91, N = 3 1227 1092
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8 - Decompression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 13.08, N = 9 SE +/- 8.31, N = 3 1609 1392
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 12 - Decompression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 400 800 1200 1600 2000 SE +/- 13.06, N = 9 SE +/- 3.00, N = 3 1661 1282
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19 - Decompression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 12.40, N = 9 SE +/- 31.67, N = 7 1421 1007
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Compression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 200 400 600 800 1000 SE +/- 7.15, N = 3 SE +/- 15.35, N = 3 906 707
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 3, Long Mode - Decompression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 1.31, N = 3 SE +/- 2.43, N = 3 1538 1390
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Compression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 200 400 600 800 1000 SE +/- 5.12, N = 9 SE +/- 2.88, N = 3 908 608
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 8, Long Mode - Decompression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 400 800 1200 1600 2000 SE +/- 9.43, N = 9 SE +/- 2.30, N = 3 1638 1385
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Compression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 2 4 6 8 10 SE +/- 0.13, N = 9 SE +/- 0.06, N = 3 8.70 8.20
OpenBenchmarking.org MB/s, More Is Better Zstd Compression 1.5.4 Compression Level: 19, Long Mode - Decompression Speed AMD EPYC 9654 96-Core 2 x Intel Xeon Platinum 8490H 300 600 900 1200 1500 SE +/- 7.97, N = 9 SE +/- 2.02, N = 3 1350 1076