AI Benchmark Alpha Benchmark - OpenBenchmarking.org

AI Benchmark Alpha is a Python library for evaluating artificial intelligence (AI) performance on diverse hardware platforms and relies upon the TensorFlow machine learning library.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark ai-benchmark.

Performance Metrics

AI Benchmark Alpha 0.1.2

Device Inference Score

OpenBenchmarking.org metrics for this test profile configuration based on 1,176 public results since 8 July 2020 with the latest data as of 21 June 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Score (Average)

Intel Xeon Platinum 8490H

100th

4849

2 x Intel Xeon Platinum 8490H

99th

4493

AMD Ryzen 9 7950X 16-Core

97th

3209 ^{+/- 213}

AMD Ryzen 9 7900X 12-Core

96th

2855 ^{+/- 3}

AMD EPYC 75F3 32-Core

95th

2434 ^{+/- 39}

AMD EPYC 7543 32-Core

93rd

2309 ^{+/- 18}

AMD EPYC 7773X 64-Core

92nd

2288

AMD Ryzen 7 7700X 8-Core

92nd

2274 ^{+/- 139}

AMD EPYC 7643 48-Core

91st

2221 ^{+/- 145}

AMD EPYC 7663 56-Core

90th

2139 ^{+/- 247}

AMD EPYC 7763 64-Core

90th

2138 ^{+/- 260}

2 x AMD EPYC 7513 32-Core

89th

2110 ^{+/- 22}

2 x AMD EPYC 75F3 32-Core

86th

2044 ^{+/- 59}

2 x AMD EPYC 7413 24-Core

85th

2038 ^{+/- 90}

2 x AMD EPYC 74F3 24-Core

84th

2014 ^{+/- 63}

AMD EPYC 7642 48-Core

83rd

2002 ^{+/- 102}

AMD EPYC 7662 64-Core

83rd

1989 ^{+/- 102}

2 x Intel Xeon Platinum 8280

83rd

1983 ^{+/- 246}

AMD EPYC 7542 32-Core

82nd

1973 ^{+/- 104}

2 x AMD EPYC 73F3 16-Core

82nd

1971 ^{+/- 53}

AMD EPYC 7552 48-Core

81st

1961 ^{+/- 73}

AMD EPYC 73F3 16-Core

80th

1950 ^{+/- 2}

Intel Core i9-10980XE

80th

1946 ^{+/- 90}

AMD EPYC 7502P 32-Core

80th

1944 ^{+/- 91}

AMD EPYC 7742 64-Core

79th

1935 ^{+/- 95}

2 x AMD EPYC 7313 16-Core

79th

1935 ^{+/- 59}

Intel Core i9-13900K

79th

1933 ^{+/- 155}

AMD Ryzen Threadripper 3960X 24-Core

79th

1930 ^{+/- 266}

AMD EPYC 7F72 24-Core

76th

1908 ^{+/- 70}

Mid-Tier

75th

< 1906

AMD Ryzen 5 7600X 6-Core

75th

1898 ^{+/- 39}

AMD EPYC 7532 32-Core

74th

1889 ^{+/- 128}

AMD Ryzen Threadripper 3990X 64-Core

74th

1887 ^{+/- 147}

2 x Intel Xeon Platinum 8480

73rd

1868 ^{+/- 8}

AMD EPYC 7502 32-Core

73rd

1861

AMD EPYC 7702 64-Core

71st

1846 ^{+/- 98}

Intel Xeon Gold 6226R

71st

1845 ^{+/- 43}

AMD EPYC 7402P 24-Core

70th

1842 ^{+/- 102}

2 x Intel Xeon Gold 6138

70th

1835 ^{+/- 265}

2 x AMD EPYC 7643 48-Core

70th

1834 ^{+/- 34}

2 x Intel Xeon Gold 6250

68th

1818 ^{+/- 245}

AMD EPYC 7452 32-Core

68th

1811

2 x AMD EPYC 7663 56-Core

64th

1730 ^{+/- 44}

2 x AMD EPYC 7F72 24-Core

64th

1715 ^{+/- 60}

AMD EPYC 7F52 16-Core

63rd

1667 ^{+/- 121}

2 x Intel Xeon Gold 5220R

62nd

1659 ^{+/- 164}

2 x AMD EPYC 7763 64-Core

61st

1656 ^{+/- 57}

AMD EPYC 7352 24-Core

61st

1638

2 x AMD EPYC 7452 32-Core

60th

1632 ^{+/- 90}

2 x AMD EPYC 7773X 64-Core

59th

1619

Intel Core i7-12700K

59th

1608 ^{+/- 65}

AMD EPYC 7302P 16-Core

57th

1576 ^{+/- 78}

Intel Core i9-12900K

57th

1575 ^{+/- 3}

2 x AMD EPYC 7742 64-Core

56th

1549 ^{+/- 93}

AMD Ryzen 9 5950X 16-Core

54th

1503 ^{+/- 170}

2 x AMD EPYC 72F3 8-Core

54th

1488 ^{+/- 64}

AMD EPYC 7282 16-Core

53rd

1466 ^{+/- 60}

AMD Ryzen 7 5800X3D 8-Core

53rd

1465 ^{+/- 1}

2 x AMD EPYC 7702 64-Core

52nd

1456 ^{+/- 23}

Median

50th

1436

Intel Core i9-10900K

50th

1420 ^{+/- 55}

AMD Ryzen 9 3950X 16-Core

48th

1376 ^{+/- 125}

Intel Core i9-11900K

47th

1373 ^{+/- 43}

Intel Xeon Gold 5218

47th

1366 ^{+/- 43}

Intel Core i5-13600K

46th

1358 ^{+/- 111}

AMD Ryzen 9 3900X 12-Core

46th

1343 ^{+/- 185}

AMD EPYC 7272 12-Core

45th

1320 ^{+/- 57}

AMD Ryzen 7 5800X 8-Core

44th

1299 ^{+/- 56}

Intel Core i9-9900KS

43rd

1295 ^{+/- 7}

AMD EPYC 72F3 8-Core

42nd

1270 ^{+/- 25}

2 x AMD EPYC 7601 32-Core

40th

1239 ^{+/- 8}

AMD EPYC 7F32 8-Core

40th

1238 ^{+/- 56}

Intel Core i9-9900K

38th

1167 ^{+/- 14}

AMD EPYC 7601 32-Core

37th

1145

Intel Xeon Silver 4216

36th

1128

Intel Xeon E-2288G

35th

1116 ^{+/- 40}

AMD Ryzen 5 5600X 6-Core

34th

1104 ^{+/- 31}

Intel Core i5-12600K

34th

1103 ^{+/- 80}

Intel Core i5-10600K

34th

1099 ^{+/- 5}

AMD Ryzen 7 3700X 8-Core

33rd

1094 ^{+/- 85}

Intel Core i5-13400

33rd

1084 ^{+/- 4}

Intel Xeon E5-2687W v3

33rd

1081 ^{+/- 10}

AMD EPYC 7232P 8-Core

31st

1064 ^{+/- 46}

Intel Xeon Silver 4214R

31st

1063 ^{+/- 5}

AMD Ryzen 7 3800XT 8-Core

31st

1059 ^{+/- 6}

AMD Ryzen 7 5700G

31st

1046 ^{+/- 26}

2 x Intel Xeon E5-2630 v3

30th

1029 ^{+/- 58}

AMD EPYC 7262 8-Core

30th

1029

Intel Xeon E5-1680 v3

29th

1022 ^{+/- 2}

AMD EPYC 7252 8-Core

28th

1016

Intel Core i7-6850K

28th

1008 ^{+/- 32}

Intel Core i7-8700K

28th

1001 ^{+/- 59}

Intel Core i7-5960X

27th

956 ^{+/- 1}

Intel Xeon Gold 5217

26th

951 ^{+/- 11}

Low-Tier

25th

< 942

Intel Core i5-8600K

25th

941 ^{+/- 52}

AMD Ryzen 5 3600XT 6-Core

25th

932 ^{+/- 19}

AMD Ryzen 7 PRO 6850U

24th

889 ^{+/- 4}

AMD Ryzen 9 5900HX

24th

888 ^{+/- 6}

Intel Core i5-9400F

24th

878 ^{+/- 14}

AMD Ryzen 7 PRO 5850U

24th

865 ^{+/- 4}

Intel Core i7-7700K

23rd

834 ^{+/- 4}

Intel Xeon Silver 4215R

22nd

812 ^{+/- 2}

Intel Core i7-6800K

22nd

812 ^{+/- 13}

AMD Ryzen 3 3100 4-Core

20th

760 ^{+/- 4}

Intel Core i7-9750H

20th

760 ^{+/- 21}

Intel Xeon E-2278GEL

19th

743 ^{+/- 2}

Intel Core i7-10700T

19th

740 ^{+/- 11}

Intel Core i9-10885H

18th

733 ^{+/- 5}

Intel Core i7-1280P

18th

730 ^{+/- 42}

AMD Ryzen 5 5500U

18th

730 ^{+/- 24}

Intel Xeon E3-1275 v6

18th

729 ^{+/- 5}

AMD Ryzen 7 4700U

17th

721 ^{+/- 10}

Intel Core i3-10100

16th

702 ^{+/- 2}

AMD Ryzen 5 4500U

14th

670 ^{+/- 29}

Intel Core i7-1185G7

14th

668 ^{+/- 4}

Intel Xeon E3-1280 v5

14th

665 ^{+/- 2}

Intel Xeon E3-1245 v5

13th

662 ^{+/- 2}

2 x Intel Xeon Silver 4208

13th

662 ^{+/- 10}

Intel Core i7-9700TE

12th

644 ^{+/- 8}

AMD Ryzen 7 1800X Eight-Core

11th

630 ^{+/- 2}

Intel Core i3-8100

10th

609 ^{+/- 43}

Intel Core i7-1165G7

10th

595 ^{+/- 56}

AMD Ryzen 7 1700 Eight-Core

10th

584 ^{+/- 3}

AMD Ryzen 7 4800U

10th

581 ^{+/- 3}

Intel Core i5-6500

9th

574 ^{+/- 5}

Intel Xeon E5-2609 v4

8th

558 ^{+/- 4}

Intel Xeon E3-1505M v6

8th

558 ^{+/- 39}

Intel Core i7-6700HQ

7th

534 ^{+/- 3}

Intel Core i3-12100

7th

510 ^{+/- 2}

Intel Core i7-1065G7

5th

459 ^{+/- 27}

AMD Ryzen 3 1300X

4th

413

Intel Core i7-8565U

4th

406 ^{+/- 10}

Intel Core i7-3770

3rd

251 ^{+/- 19}

AMD A10-7870K Radeon R7 12 Compute Cores 4C

2nd

110

Based on OpenBenchmarking.org data, the selected test / test configuration (AI Benchmark Alpha 0.1.2 - Device Inference Score) has an average run-time of 21 minutes. By default this test profile is set to run at least 1 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

ai-benchmark-alpha6 1 System - 3 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASRock APEXX A3_02 X570 Creator - AMD Starship Debian 12 - 6.1.0-21-amd64 - Xfce
c6i.4xlarge 2 Systems - 47 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1020-aws - GCC 11.4.0
c6i.4xlarge 1 System - 5 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1020-aws - GCC 11.4.0
2024-06-21-0556 1 System - 3 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1020-aws - 1.3.255
c6i.4xlarge 1 System - 3 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1017-aws - GCC 11.4.0
c6i.4xlarge 1 System - 3 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1017-aws - GCC 11.4.0
c6i.4xlarge 1 System - 6 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Amazon Linux 2023.4.20240611 - 6.1.92-99.174.amzn2023.x86_64 - GCC 11.4.1 20230605
c6i.4xlarge 1 System - 6 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Amazon Linux 2023.4.20240611 - 6.1.92-99.174.amzn2023.x86_64 - GCC 11.4.1 20230605
perf-test-andronik_mint23.1_default lowlatency 1 System - 56 Benchmark Results	AMD Ryzen 7 5800X 8-Core - ASUS ROG STRIX X370-F GAMING - AMD Starship Linuxmint 21.3 - 6.5.0-41-lowlatency - X Server 1.21.1.4
latertoday 1 System - 3 Benchmark Results	Intel Core i7-10700K - MSI Z490-A PRO - Intel Comet Lake PCH Linuxmint 21.2 - 6.5.0-14-generic - Xfce 4.18
test1 1 System - 3 Benchmark Results	Intel Core i7-3630QM - MSI MS-1762 - Intel 3rd Gen Core DRAM Linuxmint 21.3 - 5.15.0-101-generic - Cinnamon 6.0.4
ai-benchmark-001 1 System - 3 Benchmark Results	AMD Ryzen Threadripper PRO 7965WX 24-Cores - ASUS Pro WS WRX90E-SAGE SE - AMD Device 14a4 Ubuntu 22.04 - 6.5.0-26-generic - GNOME Shell 42.9
24.03.13.Pop.2204.ML.test1 1 System - 341 Benchmark Results	AMD Ryzen 9 7950X 16-Core - ASUS ProArt X670E-CREATOR WIFI - AMD Device 14d8 Pop 22.04 - 6.6.10-76060610-generic - GNOME Shell 42.5
aibenchmark-zeus 1 System - 3 Benchmark Results	AMD Ryzen 7 7800X3D 8-Core - ASUS ROG STRIX B650E-I GAMING WIFI - AMD Device 14d8 Pop 22.04 - 6.6.6-76060606-generic - GNOME Shell 42.5

AI Benchmark Alpha

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Machine Learning

HPC - High Performance Computing

Performance Metrics

AI Benchmark Alpha 0.1.2

Device Inference Score

Does It Scale Well With Increasing Cores?

Tested CPU Architectures

Recent Test Results

Compare

ai-benchmark-alpha6

c6i.4xlarge

c6i.4xlarge

2024-06-21-0556

c6i.4xlarge

c6i.4xlarge

c6i.4xlarge

c6i.4xlarge

perf-test-andronik_mint23.1_default lowlatency

latertoday

test1

ai-benchmark-001

24.03.13.Pop.2204.ML.test1

aibenchmark-zeus