Numenta Anomaly Benchmark

Numenta Anomaly Benchmark (NAB) is a benchmark for evaluating algorithms for anomaly detection in streaming, real-time applications. It is comprised of over 50 labeled real-world and artificial time-series data files plus a novel scoring mechanism designed for real-time applications. This test profile currently measures the time to run various detectors.

To run this test with the Phoronix Test Suite, the basic command is: phoronix-test-suite benchmark numenta-nab.

Project Site

github.com

Source Repository

github.com

Test Created

9 November 2018

Last Updated

14 December 2022

Test Maintainer

Michael Larabel

Test Type

System

Average Install Time

59 Seconds

Average Run Time

18 Minutes, 10 Seconds

Test Dependencies

Python

Accolades

40k+ Downloads

Supported Platforms

* Uploading of benchmark result data to OpenBenchmarking.org is always optional (opt-in) via the Phoronix Test Suite for users wishing to share their results publicly.
** Data based on those opting to upload their test results to OpenBenchmarking.org and users enabling the opt-in anonymous statistics reporting while running benchmarks from an Internet-connected platform.
*** Test profile page view reporting began March 2021.
Data updated weekly as of 22 November 2023.

Revision History

pts/numenta-nab-1.1.1 [View Source] Wed, 14 Dec 2022 14:04:05 GMT
Fixes for running on modern Linux distributions.

pts/numenta-nab-1.1.0 [View Source] Fri, 28 Feb 2020 12:04:17 GMT
Update against NAB 1.1 upstream for Python 3 compatibility.

pts/numenta-nab-1.0.0 [View Source] Fri, 09 Nov 2018 11:55:56 GMT
Initial commit of Numenta Anomaly Benchmark

Suites Using This Test

Machine Learning

HPC - High Performance Computing

CPU Massive

Server CPU Tests

Python

Performance Metrics

Analyze Test Configuration:

Numenta Anomaly Benchmark 1.1

Detector: Bayesian Changepoint

OpenBenchmarking.org metrics for this test profile configuration based on 840 public results since 28 February 2020 with the latest data as of 6 November 2023.

Below is an overview of the generalized performance for components where there is sufficient statistically significant data based upon user-uploaded results. It is important to keep in mind particularly in the Linux/open-source space there can be vastly different OS configurations, with this overview intended to offer just general guidance as to the performance expectations.

Component

Percentile Rank

# Compatible Public Results

Seconds (Average)

AMD Ryzen 9 7950X3D 16-Core

100th

AMD Ryzen 9 7950X 16-Core

99th

13 ^{+/- 2}

AMD EPYC 9654 96-Core

97th

Intel Core i9-13900K

96th

17 ^{+/- 1}

2 x AMD EPYC 9554 64-Core

96th

2 x AMD EPYC 9654 96-Core

94th

18 ^{+/- 2}

Intel Xeon Platinum 8490H

92nd

19 ^{+/- 1}

2 x Intel Xeon Platinum 8490H

90th

20 ^{+/- 2}

AMD Ryzen Threadripper 3960X 24-Core

89th

22 ^{+/- 3}

AMD Ryzen 9 5950X 16-Core

88th

22 ^{+/- 1}

AMD Ryzen Threadripper 3970X 32-Core

85th

23 ^{+/- 2}

AMD Ryzen 9 5900X 12-Core

85th

AMD Ryzen Threadripper 3990X 64-Core

83rd

24 ^{+/- 2}

AMD Ryzen 7 5800X3D 8-Core

82nd

25 ^{+/- 1}

AMD Ryzen 9 3950X 16-Core

80th

AMD EPYC 75F3 32-Core

79th

2 x Intel Xeon Platinum 8380

79th

26 ^{+/- 3}

2 x AMD EPYC 75F3 32-Core

78th

Intel Core i7-12700K

76th

27 ^{+/- 2}

AMD Ryzen 9 3900XT 12-Core

76th

Mid-Tier

75th

> 28

AMD Ryzen 9 3900X 12-Core

72nd

29 ^{+/- 4}

AMD Ryzen 7 5800X 8-Core

71st

30 ^{+/- 2}

AMD EPYC 7F52 16-Core

71st

30 ^{+/- 4}

2 x AMD EPYC 7713 64-Core

71st

2 x AMD EPYC 7763 64-Core

68th

AMD EPYC 7713 64-Core

68th

AMD EPYC 7763 64-Core

66th

Intel Core i9-10980XE

64th

32 ^{+/- 2}

AMD Ryzen 7 3800XT 8-Core

63rd

32 ^{+/- 1}

AMD EPYC 7742 64-Core

63rd

32 ^{+/- 1}

AMD EPYC 7542 32-Core

63rd

32 ^{+/- 1}

AMD Ryzen 5 5600X 6-Core

60th

33 ^{+/- 4}

AMD EPYC 7532 32-Core

59th

33 ^{+/- 1}

Intel Core i9-7980XE

59th

AMD EPYC 7552 48-Core

56th

34 ^{+/- 1}

2 x Intel Xeon Gold 5220R

54th

34 ^{+/- 1}

AMD EPYC 7502P 32-Core

54th

34 ^{+/- 5}

Intel Core i9-10900K

54th

34 ^{+/- 2}

AMD Ryzen 9 5900HX

53rd

AMD EPYC 7642 48-Core

53rd

35 ^{+/- 5}

Median

50th

AMD Ryzen 7 3700X 8-Core

50th

35 ^{+/- 2}

AMD EPYC 7402P 24-Core

48th

36 ^{+/- 5}

AMD EPYC 7282 16-Core

47th

36 ^{+/- 1}

AMD EPYC 7F32 8-Core

45th

37 ^{+/- 4}

Intel Core i7-1280P

45th

37 ^{+/- 1}

AMD Ryzen 5 3600X 6-Core

45th

37 ^{+/- 1}

AMD EPYC 7272 12-Core

44th

38 ^{+/- 2}

Apple M1

43rd

2 x AMD EPYC 7601 32-Core

43rd

39 ^{+/- 1}

Intel Xeon Gold 6226R

43rd

39 ^{+/- 5}

AMD Ryzen 7 PRO 6850U

40th

41 ^{+/- 1}

Intel Core i9-9900KS

38th

42 ^{+/- 2}

AMD EPYC 7551 32-Core

36th

44 ^{+/- 1}

Intel Xeon Gold 5220R

36th

44 ^{+/- 6}

Intel Xeon E-2288G

36th

44 ^{+/- 1}

2 x AMD EPYC 7502 32-Core

36th

44 ^{+/- 3}

Intel Core i5-10600K

34th

45 ^{+/- 2}

2 x AMD EPYC 7252 8-Core

27th

Intel Core i7-8700K

26th

49 ^{+/- 1}

Ampere Altra ARMv8 Neoverse-N1 160-Core

26th

Low-Tier

25th

> 49

Intel Xeon Gold 5218

25th

50 ^{+/- 6}

AMD Ryzen 7 4700U

25th

Intel Core i7-1185G7

23rd

Intel Core i7-1165G7

21st

57 ^{+/- 1}

Intel Core i5-9400F

21st

57 ^{+/- 7}

Intel Core i7-10700T

20th

60 ^{+/- 2}

Intel Core i7-9750H

19th

61 ^{+/- 6}

AMD Ryzen 5 5500U

18th

62 ^{+/- 1}

Intel Xeon E5-1680 v3

18th

62 ^{+/- 3}

Intel Core i7-5960X

17th

64 ^{+/- 1}

AMD Ryzen 5 4500U

15th

Intel Xeon E3-1270 v5

14th

POWER9 44-Core

14th

71 ^{+/- 1}

Intel Xeon E3-1280 v5

13th

74 ^{+/- 1}

Intel Core i7-4960X

12th

Intel Core i5-1135G7

12th

76 ^{+/- 4}

Intel Core i3-10100

11th

78 ^{+/- 10}

Intel Xeon E3-1260L v5

10th

Intel Core i7-8565U

10th

85 ^{+/- 2}

Intel Core i5-7600K

10th

AMD Ryzen 7 4800U

8th

92 ^{+/- 1}

Intel Core i7-9700TE

8th

Intel Core i3-7100

5th

144

Intel Pentium Gold G6400

5th

145 ^{+/- 13}

Intel Celeron G5900

3rd

209 ^{+/- 1}

Based on OpenBenchmarking.org data, the selected test / test configuration (Numenta Anomaly Benchmark 1.1 - Detector: Bayesian Changepoint) has an average run-time of 4 minutes. By default this test profile is set to run at least 3 times but may increase if the standard deviation exceeds pre-defined defaults or other calculations deem additional runs necessary for greater statistical accuracy of the result.

Based on public OpenBenchmarking.org results, the selected test / test configuration has an average standard deviation of 0.7%.

Does It Scale Well With Increasing Cores?

Yes, based on the automated analysis of the collected public benchmark data, this test / test settings does generally scale well with increasing CPU core counts. Data based on publicly available results for this test / test settings, separated by vendor, result divided by the reference CPU clock speed, grouped by matching physical CPU core count, and normalized against the smallest core count tested from each vendor for each CPU having a sufficient number of test samples and statistically significant data.

Tested CPU Architectures

This benchmark has been successfully tested on the below mentioned architectures. The CPU architectures listed is where successful OpenBenchmarking.org result uploads occurred, namely for helping to determine if a given test is compatible with various alternative CPU architectures.

CPU Architecture

Kernel Identifier

Verified On

Intel / AMD x86 64-bit

x86_64

(Many Processors)

IBM POWER (PowerPC) 64-bit

ppc64le

POWER9 44-Core

ARMv7 32-bit

armv7l

ARMv7 Cortex-A53 4-Core, ARMv7 Cortex-A72 4-Core

ARMv8 64-bit

arm64

Apple M1

ARMv8 64-bit

aarch64

ARMv8 Cortex-A78E 6-Core, ARMv8 Neoverse-N1, ARMv8 rev 0 8-Core, Ampere Altra ARMv8 Neoverse-N1 160-Core, Rockchip ARMv8 Cortex-A76 6-Core

h510-g6405-1 1 System - 264 Benchmark Results	Intel Pentium Gold G6405 - ASRock H510M-HDV/M.2 SE - Intel Comet Lake PCH Ubuntu 20.04 - 5.15.0-88-generic - GNOME Shell 3.36.9
TestRunNewCMake 1 System - 264 Benchmark Results	Intel Pentium Gold G6400 - ASRock H510M-HDV/M.2 SE - Intel Comet Lake PCH Ubuntu 20.04 - 5.15.0-86-generic - GNOME Shell 3.36.9
wxl2pay-h510-ml 1 System - 279 Benchmark Results	Intel Core i3-10105 - ASRock H510M-HDV/M.2 SE - Intel Comet Lake PCH Ubuntu 20.04 - 5.15.0-83-generic - GNOME Shell 3.36.9
Ryzen 9 7950X LONG 7 Systems - 263 Benchmark Results	Intel Core i5-13600K - ASUS ROG STRIX B760-F GAMING WIFI - Intel Device 7a27 ManjaroLinux 22.0.4 - 6.1.12-1-MANJARO - KDE Plasma 5.26.5
wxl2pay-h510-ml 1 System - 279 Benchmark Results	Intel Core i3-10105 - ASRock H510M-HDV/M.2 SE - Intel Comet Lake PCH Ubuntu 20.04 - 5.15.0-83-generic - GNOME Shell 3.36.9
wxl2pay-h510-ml 1 System - 279 Benchmark Results	Intel Core i3-10105 - ASRock H510M-HDV/M.2 SE - Intel Comet Lake PCH Ubuntu 20.04 - 5.15.0-83-generic - GNOME Shell 3.36.9
atomicrulez_ubuntu_2204_numenta-nab 1 System - 6 Benchmark Results	Intel Core i9-10850K - ASUS ROG MAXIMUS XII APEX - Intel Comet Lake PCH Ubuntu 22.04 - 6.2.0-34-generic - GNOME Shell 42.9
Ryzen 9 7950X LONG 5 Systems - 329 Benchmark Results	Intel Core i9-14900K - ASUS TUF GAMING Z790-PRO WIFI - Intel Device 7a27 Nobara Linux 38 - 6.5.5-202.fsync.fc38.x86_64 - GNOME Shell 44.2
Ryzen 9 7950X LONG 5 Systems - 359 Benchmark Results	Intel Core i5-13600K - ASUS ROG STRIX B760-F GAMING WIFI - Intel Device 7a27 ManjaroLinux 22.0.4 - 6.1.12-1-MANJARO - KDE Plasma 5.26.5
Ryzen 9 7950X LONG 4 Systems - 354 Benchmark Results	Intel Core i9-14900K - ASUS ROG STRIX Z790-E GAMING WIFI - Intel Device 7a27 Nobara Linux 38 - 6.5.5-201.fsync.fc38.x86_64 - GNOME Shell 44.2
python1-result 1 System - 126 Benchmark Results	Intel Core i7-1260P - Intel NUC12WSBi7 - Intel Alder Lake PCH Ubuntu 22.04 - 6.5.5-pve-v4-realtime-rt8 - GNOME Shell 42.9
svc05_hpc_run_1_23-09-22 1 System - 543 Benchmark Results	AMD Ryzen Threadripper PRO 5995WX 64-Cores - ASRock WRX80 Creator - AMD Starship Ubuntu 22.04 - 6.2.0-33-generic - GNOME Shell 42.9
native vs stock Featured Kernel Comparison	6.5.2-native - 6.5.2-normal
native vs stock 1 System - 149 Benchmark Results	AMD Ryzen 9 7900X 12-Core - ASRock X670E Steel Legend - AMD Device 14d8 Ubuntu 23.04 - 6.5.2-native - KDE Plasma 5.27.8
m600_7940hs-96gb-5600mhz-16gb-igpu-performance-tpd-2tb-sn850x-2023-09-01-2 1 System - 195 Benchmark Results

Ryzen 9 5900X / Ryzen 9 5950X Linux Performance 11 Systems - 217 Benchmark Results	AMD Ryzen 5 2600 Six-Core - ASUS ROG CROSSHAIR VIII HERO - AMD 17h Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
AMD Ryzen vs. Intel Core Benchmarking On Ubuntu Linux 12 Systems - 593 Benchmark Results	Intel Core i5-10600K - ASUS PRIME Z490M-PLUS - Intel Comet Lake PCH Ubuntu 20.04 - 5.8.0-050800daily20200622-generic - GNOME Shell 3.36.2
Core i9 10900K vs. Ryzen 9 3900X/3950X Linux Benchmarks Featured Processor Comparison	AMD Ryzen 9 3900X 12-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.7.0-999-generic - GNOME Shell 3.36.1
Ryzen 5 5600X Linux Performance 12 Systems - 229 Benchmark Results	AMD Ryzen 5 2600 Six-Core - ASUS ROG CROSSHAIR VIII HERO - AMD 17h Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
AMD EPYC 7003 Linux Benchmarks 26 Systems - 438 Benchmark Results	AMD EPYC 7713 64-Core - AMD DAYTONA_X - AMD Starship Ubuntu 20.04 - 5.11.0-051100rc6daily20210201-generic - GNOME Shell 3.36.4
GM-1000, Karbon 700, CompuLab Airtop PCs 4 Systems - 513 Benchmark Results	Intel Core i7-5775C - CompuLab v1.0 - Intel Broadwell-U DMI Ubuntu 20.10 - 5.8.0-26-generic - GNOME Shell 3.38.1
Coder Radio XPS 13 ML Ubuntu Benchmark 2 Systems - 85 Benchmark Results	Intel Core i5-1135G7 - Dell 0THX8P - Intel Device a0ef Ubuntu 20.04 - 5.6.0-1036-oem - GNOME Shell 3.36.4
Ryzen 7 5800X Linux Performance 11 Systems - 229 Benchmark Results	AMD Ryzen 5 3600X 6-Core - ASUS ROG CROSSHAIR VIII HERO - AMD Starship Ubuntu 20.04 - 5.9.0-050900-generic - GNOME Shell 3.36.4
Core i5 10600K vs. Core i5 7600K vs. Core i5 4670 3 Systems - 301 Benchmark Results	Intel Core i5-7600K - Gigabyte Z270M-D3H-CF - Intel Xeon E3-1200 v6 Ubuntu 20.04 - 5.4.0-40-generic - GNOME Shell 3.36.3
Ryzen 9 3900XT Memory Scaling 6 Systems - 100 Benchmark Results	AMD Ryzen 9 3900XT 12-Core - MSI MEG X570 GODLIKE - AMD Starship Ubuntu 20.04 - 5.8.0-050800daily20200622-generic - GNOME Shell 3.36.2
Intel Core i3 10100 vs. AMD Ryzen 3 3300X Benchmarks 2 Systems - 1708 Benchmark Results	AMD Ryzen 3 3300X 4-Core - ASRock X570 Pro4 - AMD Starship Ubuntu 20.04 - 5.7.0-rc6-amd-energy - GNOME Shell 3.36.2
Big Threadripper 2 Systems - 475 Benchmark Results	AMD Ryzen Threadripper 3970X 32-Core - ASUS ROG ZENITH II EXTREME - AMD Starship Ubuntu 19.10 - 5.3.0-18-generic - GNOME Shell 3.34.1
Linux 5.8 Kernel Benchmarking Featured Kernel Comparison	Intel Core i9-10900K - Gigabyte Z490 AORUS MASTER - Intel Comet Lake PCH Ubuntu 20.04 - 5.7.1-050701-generic - GNOME Shell 3.36.2
Initial Intel Xeon Platinum 8380 2P Benchmarks 5 Systems - 259 Benchmark Results	2 x AMD EPYC 7763 64-Core - AMD DAYTONA_X - AMD Starship Ubuntu 20.04 - 5.11.0-051100rc6daily20210201-generic - GNOME Shell 3.36.4
Intel Core i3 10100 vs. Core i5 10600K vs. AMD Ryzen 3 3300X Benchmarks 3 Systems - 777 Benchmark Results	AMD Ryzen 3 3300X 4-Core - ASRock X570 Pro4 - AMD Starship Ubuntu 20.04 - 5.7.0-rc6-amd-energy - GNOME Shell 3.36.2

Numenta Anomaly Benchmark

Project Site

Source Repository

Test Created

Last Updated

Test Maintainer

Test Type

Average Install Time

Average Run Time

Test Dependencies

Accolades

Supported Platforms

Revision History

Suites Using This Test

Performance Metrics

Numenta Anomaly Benchmark 1.1

Detector: Bayesian Changepoint

Does It Scale Well With Increasing Cores?

Tested CPU Architectures

Recent Test Results

Most Popular Test Results