AI Benchmark Alpha

AI Benchmark Alpha is a Python library for evaluating artificial intelligence (AI) performance on diverse hardware platforms and relies upon the TensorFlow machine learning library.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark ai-benchmark.

Project Site

ai-benchmark.com

Test Created

8 July 2020

Last Updated

19 July 2022

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

1 Minute, 1 Second

Average Run Time

21 Minutes, 23 Seconds

Test Dependencies

Python

Accolades

50k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 8 July 2024.

Revision History

pts/ai-benchmark-1.0.2 [View Source] Tue, 19 Jul 2022 13:38:31 GMT
Update tensorflow pip dependency so it works on newer distributuions.

pts/ai-benchmark-1.0.1 [View Source] Wed, 11 Nov 2020 18:43:35 GMT
Fix for macOS support.

pts/ai-benchmark-1.0.0 [View Source] Wed, 08 Jul 2020 14:25:53 GMT
Initial commit of AI Benchmark Alpha.

Suites Using This Test

Machine Learning

HPC - High Performance Computing

Performance Metrics

Analyze Test Configuration:

AI Benchmark Alpha 0.1.2

Device Inference Score

OpenBenchmarking.org metrics for this test profile configuration based on 1,181 public results since 8 July 2020 with the latest data as of 1 July 2024.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Score (Average)

Intel Xeon Platinum 8490H

100th

4849

2 x Intel Xeon Platinum 8490H

99th

4493

AMD Ryzen 9 7950X 16-Core

97th

3209 ^{+/- 213}

AMD Ryzen 9 7900X 12-Core

96th

2855 ^{+/- 3}

AMD EPYC 75F3 32-Core

95th

2434 ^{+/- 39}

AMD EPYC 7543 32-Core

93rd

2309 ^{+/- 18}

AMD EPYC 7773X 64-Core

93rd

2288

AMD Ryzen 7 7700X 8-Core

92nd

2274 ^{+/- 139}

AMD EPYC 7643 48-Core

91st

2221 ^{+/- 145}

AMD EPYC 7663 56-Core

90th

2139 ^{+/- 247}

AMD EPYC 7763 64-Core

90th

2138 ^{+/- 260}

2 x AMD EPYC 7513 32-Core

89th

2110 ^{+/- 22}

2 x AMD EPYC 75F3 32-Core

86th

2044 ^{+/- 59}

2 x AMD EPYC 7413 24-Core

85th

2038 ^{+/- 90}

2 x AMD EPYC 74F3 24-Core

84th

2014 ^{+/- 63}

AMD EPYC 7642 48-Core

83rd

2002 ^{+/- 102}

AMD EPYC 7662 64-Core

83rd

1989 ^{+/- 102}

2 x Intel Xeon Platinum 8280

83rd

1983 ^{+/- 246}

AMD EPYC 7542 32-Core

82nd

1973 ^{+/- 104}

2 x AMD EPYC 73F3 16-Core

82nd

1971 ^{+/- 53}

AMD EPYC 7552 48-Core

81st

1961 ^{+/- 73}

AMD EPYC 73F3 16-Core

81st

1950 ^{+/- 2}

Intel Core i9-10980XE

80th

1946 ^{+/- 90}

AMD EPYC 7502P 32-Core

80th

1944 ^{+/- 91}

AMD EPYC 7742 64-Core

79th

1935 ^{+/- 95}

2 x AMD EPYC 7313 16-Core

79th

1935 ^{+/- 59}

Intel Core i9-13900K

79th

1933 ^{+/- 155}

AMD Ryzen Threadripper 3960X 24-Core

79th

1930 ^{+/- 266}

AMD EPYC 7F72 24-Core

76th

1908 ^{+/- 70}

Mid-Tier

75th

< 1906

AMD Ryzen 5 7600X 6-Core

75th

1898 ^{+/- 39}

AMD EPYC 7532 32-Core

74th

1889 ^{+/- 128}

AMD Ryzen Threadripper 3990X 64-Core

74th

1887 ^{+/- 147}

2 x Intel Xeon Platinum 8480

73rd

1868 ^{+/- 8}

AMD EPYC 7502 32-Core

73rd

1861

AMD EPYC 7702 64-Core

71st

1846 ^{+/- 98}

Intel Xeon Gold 6226R

71st

1845 ^{+/- 43}

AMD EPYC 7402P 24-Core

71st

1842 ^{+/- 102}

2 x Intel Xeon Gold 6138

70th

1835 ^{+/- 265}

2 x AMD EPYC 7643 48-Core

70th

1834 ^{+/- 34}

2 x Intel Xeon Gold 6250

68th

1818 ^{+/- 245}

AMD EPYC 7452 32-Core

68th

1811

2 x AMD EPYC 7663 56-Core

65th

1730 ^{+/- 44}

2 x AMD EPYC 7F72 24-Core

64th

1715 ^{+/- 60}

AMD EPYC 7F52 16-Core

63rd

1667 ^{+/- 121}

2 x Intel Xeon Gold 5220R

62nd

1659 ^{+/- 164}

2 x AMD EPYC 7763 64-Core

62nd

1656 ^{+/- 57}

AMD EPYC 7352 24-Core

61st

1638

2 x AMD EPYC 7452 32-Core

60th

1632 ^{+/- 90}

2 x AMD EPYC 7773X 64-Core

60th

1619

Intel Core i7-12700K

59th

1608 ^{+/- 65}

AMD EPYC 7302P 16-Core

57th

1576 ^{+/- 78}

Intel Core i9-12900K

57th

1575 ^{+/- 3}

2 x AMD EPYC 7742 64-Core

56th

1549 ^{+/- 93}

2 x AMD EPYC 72F3 8-Core

54th

1488 ^{+/- 64}

AMD Ryzen 9 5950X 16-Core

53rd

1472 ^{+/- 208}

AMD EPYC 7282 16-Core

53rd

1466 ^{+/- 60}

AMD Ryzen 7 5800X3D 8-Core

53rd

1465 ^{+/- 1}

2 x AMD EPYC 7702 64-Core

52nd

1456 ^{+/- 23}

Median

50th

1426

Intel Core i9-10900K

50th

1420 ^{+/- 55}

AMD Ryzen 9 3950X 16-Core

48th

1376 ^{+/- 125}

Intel Core i9-11900K

48th

1373 ^{+/- 43}

Intel Xeon Gold 5218

47th

1366 ^{+/- 43}

Intel Core i5-13600K

47th

1358 ^{+/- 111}

AMD Ryzen 9 3900X 12-Core

46th

1343 ^{+/- 185}

AMD EPYC 7272 12-Core

46th

1320 ^{+/- 57}

AMD Ryzen 7 5800X 8-Core

44th

1299 ^{+/- 56}

Intel Core i9-9900KS

44th

1295 ^{+/- 7}

AMD EPYC 72F3 8-Core

42nd

1270 ^{+/- 25}

2 x AMD EPYC 7601 32-Core

40th

1239 ^{+/- 8}

AMD EPYC 7F32 8-Core

40th

1238 ^{+/- 56}

Intel Core i9-9900K

38th

1167 ^{+/- 14}

AMD EPYC 7601 32-Core

37th

1145

Intel Xeon Silver 4216

37th

1128

Intel Xeon E-2288G

35th

1116 ^{+/- 40}

AMD Ryzen 5 5600X 6-Core

35th

1104 ^{+/- 31}

Intel Core i5-12600K

35th

1103 ^{+/- 80}

Intel Core i5-10600K

34th

1099 ^{+/- 5}

AMD Ryzen 7 3700X 8-Core

34th

1094 ^{+/- 85}

Intel Core i5-13400

33rd

1084 ^{+/- 4}

Intel Xeon E5-2687W v3

33rd

1081 ^{+/- 10}

AMD EPYC 7232P 8-Core

32nd

1064 ^{+/- 46}

Intel Xeon Silver 4214R

32nd

1063 ^{+/- 5}

AMD Ryzen 7 3800XT 8-Core

31st

1059 ^{+/- 6}

AMD Ryzen 7 5700G

31st

1046 ^{+/- 26}

2 x Intel Xeon E5-2630 v3

30th

1029 ^{+/- 58}

AMD EPYC 7262 8-Core

30th

1029

Intel Xeon E5-1680 v3

29th

1022 ^{+/- 2}

AMD EPYC 7252 8-Core

28th

1016

Intel Core i7-6850K

28th

1008 ^{+/- 32}

Intel Core i7-8700K

28th

1001 ^{+/- 59}

Intel Core i7-5960X

27th

956 ^{+/- 1}

Intel Xeon Gold 5217

26th

951 ^{+/- 11}

Intel Core i5-8600K

26th

941 ^{+/- 52}

AMD Ryzen 5 3600XT 6-Core

26th

932 ^{+/- 19}

Low-Tier

25th

< 927

AMD Ryzen 7 PRO 6850U

25th

889 ^{+/- 4}

AMD Ryzen 9 5900HX

25th

888 ^{+/- 6}

Intel Core i5-9400F

24th

878 ^{+/- 14}

AMD Ryzen 7 PRO 5850U

24th

865 ^{+/- 4}

Intel Core i7-7700K

23rd

834 ^{+/- 4}

Intel Xeon Silver 4215R

22nd

812 ^{+/- 2}

Intel Core i7-6800K

22nd

812 ^{+/- 13}

AMD Ryzen 3 3100 4-Core

21st

760 ^{+/- 4}

Intel Core i7-9750H

21st

760 ^{+/- 21}

Intel Xeon E-2278GEL

19th

743 ^{+/- 2}

Intel Core i7-10700T

19th

740 ^{+/- 11}

Intel Core i9-10885H

19th

733 ^{+/- 5}

Intel Core i7-1280P

18th

730 ^{+/- 42}

AMD Ryzen 5 5500U

18th

730 ^{+/- 24}

Intel Xeon E3-1275 v6

18th

729 ^{+/- 5}

AMD Ryzen 7 4700U

17th

721 ^{+/- 10}

Intel Core i3-10100

16th

702 ^{+/- 2}

AMD Ryzen 5 4500U

14th

670 ^{+/- 29}

Intel Core i7-1185G7

14th

668 ^{+/- 4}

Intel Xeon E3-1280 v5

14th

665 ^{+/- 2}

Intel Xeon E3-1245 v5

13th

662 ^{+/- 2}

2 x Intel Xeon Silver 4208

13th

662 ^{+/- 10}

Intel Core i7-9700TE

12th

644 ^{+/- 8}

AMD Ryzen 7 1800X Eight-Core

11th

630 ^{+/- 2}

Intel Core i3-8100

10th

609 ^{+/- 43}

Intel Core i7-1165G7

10th

595 ^{+/- 56}

AMD Ryzen 7 1700 Eight-Core

10th

584 ^{+/- 3}

AMD Ryzen 7 4800U

10th

581 ^{+/- 3}

Intel Core i5-6500

9th

574 ^{+/- 5}

Intel Xeon E5-2609 v4

8th

558 ^{+/- 4}

Intel Xeon E3-1505M v6

8th

558 ^{+/- 39}

Intel Core i7-6700HQ

7th

534 ^{+/- 3}

Intel Core i3-12100

6th

510 ^{+/- 2}

Intel Core i7-1065G7

5th

459 ^{+/- 27}

AMD Ryzen 3 1300X

4th

413

Intel Core i7-8565U

4th

406 ^{+/- 10}

Intel Core i7-3770

3rd

251 ^{+/- 19}

AMD A10-7870K Radeon R7 12 Compute Cores 4C

2nd

110

Based on OpenBenchmarking.org data, the selected test / test configuration (AI Benchmark Alpha 0.1.2 - Device Inference Score) has an average run-time of 21 minutes. By default this test profile is set to run at least 1 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture

Kernel Identifier

Verified On

Intel / AMD x86 64-bit

x86_64

(Many Processors)

ARMv8 64-bit

arm64

Apple M1

ARMv8 64-bit

aarch64

ARMv8 9-Core, ARMv8 Neoverse-N1, ARMv8 Neoverse-N1 80-Core, ARMv8 Neoverse-V1

tri 1 System - 14 Benchmark Results	Intel Xeon E5-2667 v3 - Blade Shadow ShadowM v2.0 - Intel 82G33 Ubuntu 22.04 - 5.15.0-113-generic - NVIDIA
tri 1 System - 14 Benchmark Results	Intel Xeon E5-2667 v3 - Blade Shadow ShadowM v2.0 - Intel 82G33 Ubuntu 22.04 - 5.15.0-113-generic - NVIDIA
tri 1 System - 14 Benchmark Results	AMD EPYC 7543P 32-Core - Blade Shadow ShadowM v2.0 - Intel 82G33 Ubuntu 22.04 - 5.15.0-113-generic - X Server
tri 1 System - 14 Benchmark Results	AMD EPYC 7543P 32-Core - Blade Shadow ShadowM v2.0 - Intel 82G33 Ubuntu 22.04 - 5.15.0-113-generic - NVIDIA
ai-benchmark-alpha6 1 System - 3 Benchmark Results	AMD Ryzen 9 5950X 16-Core - ASRock APEXX A3_02 X570 Creator - AMD Starship Debian 12 - 6.1.0-21-amd64 - Xfce
c7g.4xlarge 4 Systems - 46 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.4xlarge - Amazon Device 0200 Ubuntu 22.04 - 6.5.0-1020-aws - GCC 11.4.0
c7g.4xlarge 4 Systems - 46 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.4xlarge - Amazon Device 0200 Ubuntu 22.04 - 6.5.0-1020-aws - GCC 11.4.0
c7g.4xlarge 3 Systems - 46 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.4xlarge - Amazon Device 0200 Ubuntu 22.04 - 6.5.0-1020-aws - 1.3.255
c7g.4xlarge 1 System - 45 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.4xlarge - Amazon Device 0200 Ubuntu 22.04 - 6.5.0-1020-aws - GCC 11.4.0
c7g.4xlarge 1 System - 5 Benchmark Results	ARMv8 Neoverse-V1 - Amazon EC2 c7g.4xlarge - Amazon Device 0200 Ubuntu 22.04 - 6.5.0-1020-aws - GCC 11.4.0
c6i.4xlarge 2 Systems - 47 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1020-aws - GCC 11.4.0
c6i.4xlarge 1 System - 5 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1020-aws - GCC 11.4.0
2024-06-21-0556 1 System - 3 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1020-aws - 1.3.255
c6i.4xlarge 1 System - 3 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1017-aws - GCC 11.4.0
c6i.4xlarge 1 System - 3 Benchmark Results	Intel Xeon Platinum 8375C - Amazon EC2 c6i.4xlarge - Intel 440FX 82441FX PMC Ubuntu 22.04 - 6.5.0-1017-aws - GCC 11.4.0

Renoir vs. Icelake Benchmarks 2 Systems - 535 Benchmark Results	Intel Core i7-1065G7 - Dell 06CDVY - Intel Device 34ef Ubuntu 20.04 - 5.9.0-050900rc7daily20201003-generic - GNOME Shell 3.36.4
Fedora 32 vs. Fedora 33 Beta Benchmarks 3 Systems - 174 Benchmark Results	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Fedora 33 - 5.8.11-300.fc33.x86_64 - GNOME Shell 3.38.0
Clear Linux vs. Ubuntu 21.04 Benchmarks 3 Systems - 101 Benchmark Results	Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers Ubuntu 21.04 - 5.11.0-16-generic - GNOME Shell 3.38.4
OnLogic Helix 500 Linux benchmarks 2 Systems - 151 Benchmark Results	Intel Xeon E-2278GEL - Logic Supply RXM-181 - Intel Cannon Lake PCH Ubuntu 20.10 - 5.8.0-41-generic - GNOME Shell 3.38.2
AMD EPYC 7F72 2P Linux 5.11 3 Systems - 376 Benchmark Results	2 x AMD EPYC 7F72 24-Core - Supermicro H11DSi-NT v2.00 - AMD Starship Ubuntu 20.10 - 5.10.9-051009-generic - GNOME Shell 3.38.1
Clear Linux vs Other Distros - Tiger Lake 4 Systems - 110 Benchmark Results	Intel Core i7-1165G7 - Dell 0GG9PT - Intel Tiger Lake-LP ManjaroLinux 20.2 - 5.9.11-3-MANJARO - Xfce 4.14
Xeon E 8 Systems - 84 Benchmark Results	Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1
AMD Ryzen 9 5950X Linux 5.11 Featured Kernel Comparison	AMD Ryzen 9 5950X 16-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.10 - 5.11.0-051100rc4daily20210121-generic - GNOME Shell 3.38.1
AMD Ryzen 7900 Series Linux CPU Benchmarks 13 Systems - 333 Benchmark Results	Intel Core i5-12600K - ASUS ROG STRIX Z690-E GAMING WIFI - Intel Device 7aa7 Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2
System76 Thelio Major 3990X Pop OS 2 Systems - 297 Benchmark Results	AMD Ryzen Threadripper 3990X 64-Core - System76 Thelio Major - AMD Starship Pop 20.04 - 5.4.0-7642-generic - GNOME Shell 3.36.4
Coder Radio XPS 13 ML Ubuntu Benchmark 2 Systems - 85 Benchmark Results	Intel Core i7-10510U - LENOVO 20U9CTO1WW - Intel Comet Lake PCH-LP Fedora 33 - 5.9.16-200.fc33.x86_64 - KDE Plasma 5.20.4
Core i9 Clear Linux Benchmarks 6 Systems - 136 Benchmark Results	Intel Core i9-10980XE - ASRock X299 Steel Legend - Intel Sky Lake-E DMI3 Registers Ubuntu 20.10 - 5.4.0-42-generic - GNOME Shell 3.36.4
GM-1000, Karbon 700, CompuLab Airtop PCs 4 Systems - 513 Benchmark Results	Intel Xeon E-2288G - Compulab SBC-ATCFL v1.2 - Intel Cannon Lake PCH Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1
AMD EPYC 7702 Linux 5.11 Featured Kernel Comparison	AMD EPYC 7702 64-Core - ASRockRack EPYCD8 - AMD Starship Ubuntu 20.10 - 5.10.0-051000daily20201222-generic - GNOME Shell 3.38.1
Intel Core i9 13900K Linux CPU Benchmarks 16 Systems - 333 Benchmark Results	AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 22.04 - 6.0.0-060000rc1daily20220820-generic - GNOME Shell 42.2

AI Benchmark Alpha

Project Site

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

AI Benchmark Alpha 0.1.2

Device Inference Score

Does It Scale Well With Increasing Cores?

Tested CPU Architectures

Recent Test Results

Most Popular Test Results