machine learning

AMD Ryzen 9 3900X 12-Core testing with a MSI X570-A PRO (MS-7C37) v3.0 (H.70 BIOS) and NVIDIA GeForce RTX 3060 12GB on Ubuntu 23.10 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2404285-VPA1-DESKTOP14
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results
Show Result Confidence Charts
Allow Limiting Results To Certain Suite(s)

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Toggle/Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
mantic
February 23
  15 Hours, 54 Minutes
mantic-no-omit-framepointer
February 24
  19 Hours, 11 Minutes
Invert Behavior (Only Show Selected Data)
  17 Hours, 32 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


machine learningOpenBenchmarking.orgPhoronix Test SuiteAMD Ryzen 9 3900X 12-Core @ 3.80GHz (12 Cores / 24 Threads)MSI X570-A PRO (MS-7C37) v3.0 (H.70 BIOS)AMD Starship/Matisse2 x 16GB DDR4-3200MT/s F4-3200C16-16GVK2000GB Seagate ST2000DM006-2DM1 + 2000GB Western Digital WD20EZAZ-00G + 500GB Samsung SSD 860 + 8002GB Seagate ST8000DM004-2CX1 + 1000GB CT1000BX500SSD1 + 512GB TS512GESD310CNVIDIA GeForce RTX 3060 12GBNVIDIA GeForce RTX 3060NVIDIA GA104 HD AudioDELL P2314HRealtek RTL8111/8168/8411Ubuntu 23.106.5.0-9-generic (x86_64)X Server 1.21.1.7NVIDIAOpenCL 3.0 CUDA 12.2.146GCC 13.2.0 + CUDA 12.2ext41920x1080ProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDisplay ServerDisplay DriverOpenCLCompilerFile-SystemScreen ResolutionMachine Learning BenchmarksSystem Logs- Transparent Huge Pages: madvise- mantic: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-XYspKM/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - mantic-no-omit-framepointer: --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-cet --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-serialization=2 --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-defaulted --enable-offload-targets=nvptx-none=/build/gcc-13-b9QCDx/gcc-13-13.2.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-13-b9QCDx/gcc-13-13.2.0/debian/tmp-gcn/usr --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v - Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8701013- Python 3.11.6- gather_data_sampling: Not affected + itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + mmio_stale_data: Not affected + retbleed: Mitigation of untrained return thunk; SMT enabled with STIBP protection + spec_rstack_overflow: Mitigation of safe RET + spec_store_bypass: Mitigation of SSB disabled via prctl + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Retpolines IBPB: conditional STIBP: always-on RSB filling PBRSB-eIBRS: Not affected + srbds: Not affected + tsx_async_abort: Not affected - mantic-no-omit-framepointer: CXXFLAGS=-fno-omit-frame-pointer QMAKE_CFLAGS=-fno-omit-frame-pointer CFLAGS=-fno-omit-frame-pointer CFLAGS_OVERRIDE=-fno-omit-frame-pointer QMAKE_CXXFLAGS=-fno-omit-frame-pointer FFLAGS=-fno-omit-frame-pointer

mantic vs. mantic-no-omit-framepointer ComparisonPhoronix Test SuiteBaseline+12.5%+12.5%+25%+25%+37.5%+37.5%50%12.5%12.5%6.9%5.2%3.7%2.6%2.3%2.3%2%GPU - Numpy - 16384 - Equation of StateIsolation Forest16.2%CPU - Numpy - 16384 - Isoneutral MixingGPU - Numpy - 16384 - Isoneutral MixingTree9.6%NVIDIA CUDA GPU - 16 - Efficientnet_v2_l7.9%GPU - Numpy - 262144 - Equation of Statejson_loads6.7%LocalOutlierFactor6.2%NVIDIA CUDA GPU - 1 - Efficientnet_v2_l5.5%CPU - Numpy - 262144 - Equation of StateText Vectorizers5%raytrace4.6%Plot Neighborsdjango_template3.5%regex_compile3.4%S.R.P.1.I2.9%NVIDIA CUDA GPU - 64 - ResNet-152pathlib2.5%GPU - Numpy - 262144 - Isoneutral Mixingcrypto_pyaes2.3%NVIDIA CUDA GPU - 1 - ResNet-1522.3%NVIDIA CUDA GPU - 64 - ResNet-50I.P.L2.2%H.G.B.A2.1%NVIDIA CUDA GPU - 256 - Efficientnet_v2_l2.1%T.F.A.T.T2.1%S.W.R2%NVIDIA CUDA GPU - 512 - ResNet-152PyHPC BenchmarksScikit-LearnPyHPC BenchmarksPyHPC BenchmarksScikit-LearnPyTorchPyHPC BenchmarksPyPerformanceScikit-LearnPyTorchPyHPC BenchmarksScikit-LearnPyPerformanceScikit-LearnPyPerformancePyPerformanceScikit-LearnPyTorchPyPerformancePyHPC BenchmarksPyPerformancePyTorchPyTorchScikit-LearnScikit-LearnPyTorchPyBenchScikit-LearnPyTorchmanticmantic-no-omit-framepointer

machine learningnumpy: pytorch: CPU - 1 - ResNet-50pytorch: CPU - 1 - ResNet-152pytorch: CPU - 16 - ResNet-50pytorch: CPU - 32 - ResNet-50pytorch: CPU - 64 - ResNet-50pytorch: CPU - 16 - ResNet-152pytorch: CPU - 256 - ResNet-50pytorch: CPU - 32 - ResNet-152pytorch: CPU - 512 - ResNet-50pytorch: CPU - 64 - ResNet-152pytorch: CPU - 256 - ResNet-152pytorch: CPU - 512 - ResNet-152pytorch: CPU - 1 - Efficientnet_v2_lpytorch: CPU - 16 - Efficientnet_v2_lpytorch: CPU - 32 - Efficientnet_v2_lpytorch: CPU - 64 - Efficientnet_v2_lpytorch: CPU - 256 - Efficientnet_v2_lpytorch: CPU - 512 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 1 - ResNet-50pytorch: NVIDIA CUDA GPU - 1 - ResNet-152pytorch: NVIDIA CUDA GPU - 16 - ResNet-50pytorch: NVIDIA CUDA GPU - 32 - ResNet-50pytorch: NVIDIA CUDA GPU - 64 - ResNet-50pytorch: NVIDIA CUDA GPU - 16 - ResNet-152pytorch: NVIDIA CUDA GPU - 256 - ResNet-50pytorch: NVIDIA CUDA GPU - 32 - ResNet-152pytorch: NVIDIA CUDA GPU - 512 - ResNet-50pytorch: NVIDIA CUDA GPU - 64 - ResNet-152pytorch: NVIDIA CUDA GPU - 256 - ResNet-152pytorch: NVIDIA CUDA GPU - 512 - ResNet-152pytorch: NVIDIA CUDA GPU - 1 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 16 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 32 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 64 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 256 - Efficientnet_v2_lpytorch: NVIDIA CUDA GPU - 512 - Efficientnet_v2_lpybench: Total For Average Test Timespyperformance: gopyperformance: 2to3pyperformance: chaospyperformance: floatpyperformance: nbodypyperformance: pathlibpyperformance: raytracepyperformance: json_loadspyperformance: crypto_pyaespyperformance: regex_compilepyperformance: python_startuppyperformance: django_templatepyperformance: pickle_pure_pythonpyhpc: CPU - Numpy - 16384 - Equation of Statepyhpc: CPU - Numpy - 16384 - Isoneutral Mixingpyhpc: CPU - Numpy - 65536 - Equation of Statepyhpc: CPU - Numpy - 65536 - Isoneutral Mixingpyhpc: GPU - Numpy - 16384 - Equation of Statepyhpc: GPU - Numpy - 16384 - Isoneutral Mixingpyhpc: GPU - Numpy - 65536 - Equation of Statepyhpc: GPU - Numpy - 65536 - Isoneutral Mixingpyhpc: CPU - Numpy - 262144 - Equation of Statepyhpc: CPU - Numpy - 262144 - Isoneutral Mixingpyhpc: GPU - Numpy - 262144 - Equation of Statepyhpc: GPU - Numpy - 262144 - Isoneutral Mixingpyhpc: CPU - Numpy - 1048576 - Equation of Statepyhpc: CPU - Numpy - 1048576 - Isoneutral Mixingpyhpc: CPU - Numpy - 4194304 - Equation of Statepyhpc: CPU - Numpy - 4194304 - Isoneutral Mixingpyhpc: GPU - Numpy - 1048576 - Equation of Statepyhpc: GPU - Numpy - 1048576 - Isoneutral Mixingpyhpc: GPU - Numpy - 4194304 - Equation of Statepyhpc: GPU - Numpy - 4194304 - Isoneutral Mixingscikit-learn: GLMscikit-learn: SAGAscikit-learn: Treescikit-learn: Lassoscikit-learn: Sparsifyscikit-learn: Plot Wardscikit-learn: MNIST Datasetscikit-learn: Plot Neighborsscikit-learn: SGD Regressionscikit-learn: SGDOneClassSVMscikit-learn: Isolation Forestscikit-learn: Text Vectorizersscikit-learn: Plot Hierarchicalscikit-learn: Plot OMP vs. LARSscikit-learn: Feature Expansionsscikit-learn: LocalOutlierFactorscikit-learn: TSNE MNIST Datasetscikit-learn: Isotonic / Logisticscikit-learn: Plot Incremental PCAscikit-learn: Hist Gradient Boostingscikit-learn: Sample Without Replacementscikit-learn: Covertype Dataset Benchmarkscikit-learn: Hist Gradient Boosting Adultscikit-learn: Isotonic / Perturbed Logarithmscikit-learn: Hist Gradient Boosting Threadingscikit-learn: 20 Newsgroups / Logistic Regressionscikit-learn: Plot Polynomial Kernel Approximationscikit-learn: Hist Gradient Boosting Categorical Onlyscikit-learn: Kernel PCA Solvers / Time vs. N Samplesscikit-learn: Kernel PCA Solvers / Time vs. N Componentsscikit-learn: Sparse Rand Projections / 100 Iterationsscikit-learn: Plot Singular Value Decompositionmanticmantic-no-omit-framepointer426.2832.3612.7224.2824.2924.249.8824.429.8424.139.889.779.877.315.635.635.625.615.61210.8873.91200.30199.46201.4173.01202.7274.15203.1871.8171.7472.3139.3538.9537.7137.8837.3637.4377412922162.867.476.219.726219.565.11167.6128.52590.0030.0090.0150.0320.0030.0090.0150.0330.0610.1310.0620.1310.2630.6191.4022.6700.2630.6311.4222.662293.598868.01848.338511.848127.28257.82465.763147.752106.315379.739289.37160.814211.28691.499131.27753.464236.8651470.80631.006109.984158.262376.145103.4971788.259110.21541.519150.73218.57972.54137.242613.547428.6132.5412.7824.3824.3524.409.9324.3710.0024.289.919.919.807.325.645.645.655.645.65211.4672.27200.17202.68205.9572.24203.2273.36201.1473.6572.9173.7537.2936.1037.1637.2436.6037.2279013122463.666.977.120.227420.866.61207.6429.52630.0030.0080.0150.0320.0020.0080.0150.0330.0580.1320.0580.1280.2620.6181.4052.6260.2600.6221.4112.620295.096873.82252.969509.537125.44257.54565.877142.451107.527382.611336.37263.875208.39192.582133.09256.754236.7861471.83431.057111.255161.460370.694105.6471828.300110.37441.728150.37618.86572.90937.889631.071OpenBenchmarking.org

Numpy Benchmark

This is a test to obtain the general Numpy performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterNumpy Benchmarkmanticmantic-no-omit-framepointer90180270360450SE +/- 1.20, N = 3SE +/- 0.90, N = 3426.28428.61

PyTorch

This is a benchmark of PyTorch making use of pytorch-benchmark [https://github.com/LukasHedegaard/pytorch-benchmark]. Currently this test profile is catered to CPU-based testing. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-50manticmantic-no-omit-framepointer816243240SE +/- 0.11, N = 3SE +/- 0.16, N = 332.3632.54MIN: 31.89 / MAX: 32.7MIN: 31.64 / MAX: 32.94

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: ResNet-152manticmantic-no-omit-framepointer3691215SE +/- 0.03, N = 3SE +/- 0.04, N = 312.7212.78MIN: 11.99 / MAX: 12.8MIN: 11.9 / MAX: 12.9

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-50manticmantic-no-omit-framepointer612182430SE +/- 0.05, N = 3SE +/- 0.16, N = 324.2824.38MIN: 20.22 / MAX: 24.56MIN: 22.2 / MAX: 24.87

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-50manticmantic-no-omit-framepointer612182430SE +/- 0.10, N = 3SE +/- 0.16, N = 324.2924.35MIN: 22.24 / MAX: 24.66MIN: 23.67 / MAX: 24.87

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-50manticmantic-no-omit-framepointer612182430SE +/- 0.04, N = 3SE +/- 0.15, N = 324.2424.40MIN: 23.59 / MAX: 24.49MIN: 21.6 / MAX: 24.8

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: ResNet-152manticmantic-no-omit-framepointer3691215SE +/- 0.04, N = 3SE +/- 0.01, N = 39.889.93MIN: 9.31 / MAX: 10.01MIN: 9.39 / MAX: 10.01

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-50manticmantic-no-omit-framepointer612182430SE +/- 0.03, N = 3SE +/- 0.11, N = 324.4224.37MIN: 20.15 / MAX: 24.74MIN: 23.76 / MAX: 24.81

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: ResNet-152manticmantic-no-omit-framepointer3691215SE +/- 0.05, N = 3SE +/- 0.09, N = 39.8410.00MIN: 9.6 / MAX: 9.98MIN: 8.09 / MAX: 10.27

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: ResNet-50manticmantic-no-omit-framepointer612182430SE +/- 0.02, N = 3SE +/- 0.08, N = 324.1324.28MIN: 23.58 / MAX: 24.41MIN: 22.31 / MAX: 24.53

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: ResNet-152manticmantic-no-omit-framepointer3691215SE +/- 0.03, N = 3SE +/- 0.02, N = 39.889.91MIN: 8.8 / MAX: 9.98MIN: 8.69 / MAX: 10.08

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: ResNet-152manticmantic-no-omit-framepointer3691215SE +/- 0.07, N = 3SE +/- 0.04, N = 39.779.91MIN: 9.17 / MAX: 10MIN: 9.19 / MAX: 10.05

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: ResNet-152manticmantic-no-omit-framepointer3691215SE +/- 0.02, N = 3SE +/- 0.07, N = 39.879.80MIN: 9.09 / MAX: 9.96MIN: 9.12 / MAX: 9.98

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 1 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer246810SE +/- 0.00, N = 3SE +/- 0.02, N = 37.317.32MIN: 7.16 / MAX: 7.34MIN: 7.23 / MAX: 7.38

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 16 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer1.2692.5383.8075.0766.345SE +/- 0.02, N = 3SE +/- 0.01, N = 35.635.64MIN: 5.39 / MAX: 5.71MIN: 5.45 / MAX: 5.68

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 32 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer1.2692.5383.8075.0766.345SE +/- 0.01, N = 3SE +/- 0.01, N = 35.635.64MIN: 5.31 / MAX: 5.68MIN: 5.52 / MAX: 5.69

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 64 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer1.27132.54263.81395.08526.3565SE +/- 0.01, N = 3SE +/- 0.01, N = 35.625.65MIN: 5.35 / MAX: 5.66MIN: 5.45 / MAX: 5.7

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 256 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer1.2692.5383.8075.0766.345SE +/- 0.02, N = 3SE +/- 0.01, N = 35.615.64MIN: 5.44 / MAX: 5.65MIN: 5.29 / MAX: 5.68

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: CPU - Batch Size: 512 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer1.27132.54263.81395.08526.3565SE +/- 0.01, N = 3SE +/- 0.02, N = 35.615.65MIN: 5.45 / MAX: 5.66MIN: 5.36 / MAX: 5.93

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-50manticmantic-no-omit-framepointer50100150200250SE +/- 2.67, N = 3SE +/- 1.46, N = 15210.88211.46MIN: 195.21 / MAX: 218.16MIN: 192.13 / MAX: 223.01

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: ResNet-152manticmantic-no-omit-framepointer1632486480SE +/- 0.56, N = 3SE +/- 0.96, N = 373.9172.27MIN: 68.9 / MAX: 75.9MIN: 68.86 / MAX: 76.62

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-50manticmantic-no-omit-framepointer4080120160200SE +/- 0.25, N = 3SE +/- 0.96, N = 3200.30200.17MIN: 182.88 / MAX: 202.36MIN: 183.43 / MAX: 203.55

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-50manticmantic-no-omit-framepointer4080120160200SE +/- 1.06, N = 3SE +/- 2.52, N = 4199.46202.68MIN: 182.77 / MAX: 206.03MIN: 182.69 / MAX: 211.53

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-50manticmantic-no-omit-framepointer50100150200250SE +/- 0.58, N = 3SE +/- 1.98, N = 3201.41205.95MIN: 184.02 / MAX: 203.68MIN: 186.96 / MAX: 210.21

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: ResNet-152manticmantic-no-omit-framepointer1632486480SE +/- 0.96, N = 3SE +/- 0.20, N = 373.0172.24MIN: 68.06 / MAX: 75.3MIN: 68.36 / MAX: 73.14

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-50manticmantic-no-omit-framepointer4080120160200SE +/- 1.76, N = 3SE +/- 1.21, N = 3202.72203.22MIN: 183.1 / MAX: 207.93MIN: 185.88 / MAX: 206.71

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: ResNet-152manticmantic-no-omit-framepointer1632486480SE +/- 0.96, N = 3SE +/- 0.74, N = 374.1573.36MIN: 68.27 / MAX: 75.61MIN: 68.19 / MAX: 74.63

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-50manticmantic-no-omit-framepointer4080120160200SE +/- 1.69, N = 3SE +/- 0.33, N = 3203.18201.14MIN: 183.76 / MAX: 207.98MIN: 183.61 / MAX: 202.73

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: ResNet-152manticmantic-no-omit-framepointer1632486480SE +/- 0.44, N = 3SE +/- 0.66, N = 371.8173.65MIN: 67.31 / MAX: 72.89MIN: 68.88 / MAX: 75.03

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: ResNet-152manticmantic-no-omit-framepointer1632486480SE +/- 0.24, N = 3SE +/- 0.83, N = 371.7472.91MIN: 67.87 / MAX: 72.6MIN: 68 / MAX: 75.45

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: ResNet-152manticmantic-no-omit-framepointer1632486480SE +/- 0.94, N = 3SE +/- 0.50, N = 372.3173.75MIN: 67.38 / MAX: 74.62MIN: 68.91 / MAX: 75.15

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 1 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer918273645SE +/- 0.47, N = 3SE +/- 0.26, N = 339.3537.29MIN: 36.65 / MAX: 40.42MIN: 35.83 / MAX: 39.17

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 16 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer918273645SE +/- 0.08, N = 3SE +/- 0.02, N = 338.9536.10MIN: 37.12 / MAX: 39.27MIN: 34.25 / MAX: 38.01

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 32 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer918273645SE +/- 0.24, N = 3SE +/- 0.30, N = 1537.7137.16MIN: 35.52 / MAX: 38.25MIN: 34.12 / MAX: 39.48

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 64 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer918273645SE +/- 0.30, N = 9SE +/- 0.31, N = 1537.8837.24MIN: 35.67 / MAX: 39.63MIN: 33.97 / MAX: 39.43

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 256 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer918273645SE +/- 0.15, N = 3SE +/- 0.30, N = 1537.3636.60MIN: 35.47 / MAX: 37.85MIN: 33.07 / MAX: 39.53

OpenBenchmarking.orgbatches/sec, More Is BetterPyTorch 2.1Device: NVIDIA CUDA GPU - Batch Size: 512 - Model: Efficientnet_v2_lmanticmantic-no-omit-framepointer918273645SE +/- 0.03, N = 3SE +/- 0.33, N = 837.4337.22MIN: 35.81 / MAX: 38.02MIN: 34.99 / MAX: 39.08

PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test Timesmanticmantic-no-omit-framepointer2004006008001000SE +/- 1.00, N = 3SE +/- 1.20, N = 3774790

PyPerformance

PyPerformance is the reference Python performance benchmark suite. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: gomanticmantic-no-omit-framepointer306090120150SE +/- 0.00, N = 3SE +/- 0.33, N = 3129131

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: 2to3manticmantic-no-omit-framepointer50100150200250SE +/- 0.00, N = 3SE +/- 0.33, N = 3221224

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: chaosmanticmantic-no-omit-framepointer1428425670SE +/- 0.03, N = 3SE +/- 0.20, N = 362.863.6

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: floatmanticmantic-no-omit-framepointer1530456075SE +/- 0.03, N = 3SE +/- 0.10, N = 367.466.9

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: nbodymanticmantic-no-omit-framepointer20406080100SE +/- 0.06, N = 3SE +/- 0.07, N = 376.277.1

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: pathlibmanticmantic-no-omit-framepointer510152025SE +/- 0.00, N = 3SE +/- 0.00, N = 319.720.2

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: raytracemanticmantic-no-omit-framepointer60120180240300SE +/- 0.33, N = 3SE +/- 0.33, N = 3262274

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: json_loadsmanticmantic-no-omit-framepointer510152025SE +/- 0.06, N = 3SE +/- 0.03, N = 319.520.8

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: crypto_pyaesmanticmantic-no-omit-framepointer1530456075SE +/- 0.06, N = 3SE +/- 0.00, N = 365.166.6

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: regex_compilemanticmantic-no-omit-framepointer306090120150SE +/- 0.00, N = 3SE +/- 0.33, N = 3116120

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: python_startupmanticmantic-no-omit-framepointer246810SE +/- 0.01, N = 3SE +/- 0.01, N = 37.617.64

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: django_templatemanticmantic-no-omit-framepointer714212835SE +/- 0.03, N = 3SE +/- 0.06, N = 328.529.5

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyPerformance 1.0.0Benchmark: pickle_pure_pythonmanticmantic-no-omit-framepointer60120180240300SE +/- 0.33, N = 3SE +/- 0.58, N = 3259263

PyHPC Benchmarks

PyHPC-Benchmarks is a suite of Python high performance computing benchmarks for execution on CPUs and GPUs using various popular Python HPC libraries. The PyHPC CPU-based benchmarks focus on sequential CPU performance. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 16384 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.00070.00140.00210.00280.0035SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0030.003

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 16384 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.0020.0040.0060.0080.01SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0090.008

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 65536 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.00340.00680.01020.01360.017SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0150.015

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 65536 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.00720.01440.02160.02880.036SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0320.032

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 16384 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.00070.00140.00210.00280.0035SE +/- 0.000, N = 3SE +/- 0.000, N = 150.0030.002

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 16384 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.0020.0040.0060.0080.01SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0090.008

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 65536 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.00340.00680.01020.01360.017SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0150.015

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 65536 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.00740.01480.02220.02960.037SE +/- 0.000, N = 3SE +/- 0.000, N = 30.0330.033

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 262144 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.01370.02740.04110.05480.0685SE +/- 0.001, N = 3SE +/- 0.000, N = 30.0610.058

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 262144 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.02970.05940.08910.11880.1485SE +/- 0.001, N = 3SE +/- 0.000, N = 30.1310.132

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 262144 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.0140.0280.0420.0560.07SE +/- 0.001, N = 3SE +/- 0.000, N = 30.0620.058

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 262144 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.02950.0590.08850.1180.1475SE +/- 0.000, N = 3SE +/- 0.001, N = 30.1310.128

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.05920.11840.17760.23680.296SE +/- 0.002, N = 3SE +/- 0.000, N = 30.2630.262

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.13930.27860.41790.55720.6965SE +/- 0.001, N = 3SE +/- 0.000, N = 30.6190.618

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.31610.63220.94831.26441.5805SE +/- 0.003, N = 3SE +/- 0.004, N = 31.4021.405

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.60081.20161.80242.40323.004SE +/- 0.010, N = 3SE +/- 0.002, N = 32.6702.626

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.05920.11840.17760.23680.296SE +/- 0.002, N = 3SE +/- 0.001, N = 30.2630.260

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.1420.2840.4260.5680.71SE +/- 0.002, N = 3SE +/- 0.007, N = 30.6310.622

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of Statemanticmantic-no-omit-framepointer0.320.640.961.281.6SE +/- 0.004, N = 3SE +/- 0.001, N = 31.4221.411

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: GPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Isoneutral Mixingmanticmantic-no-omit-framepointer0.5991.1981.7972.3962.995SE +/- 0.006, N = 3SE +/- 0.006, N = 32.6622.620

Scikit-Learn

Scikit-learn is a Python module for machine learning built on NumPy, SciPy, and is BSD-licensed. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: GLMmanticmantic-no-omit-framepointer60120180240300SE +/- 1.06, N = 3SE +/- 1.07, N = 3293.60295.101. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: SAGAmanticmantic-no-omit-framepointer2004006008001000SE +/- 8.69, N = 6SE +/- 5.60, N = 3868.02873.821. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Treemanticmantic-no-omit-framepointer1224364860SE +/- 0.59, N = 4SE +/- 0.48, N = 1548.3452.971. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Lassomanticmantic-no-omit-framepointer110220330440550SE +/- 3.22, N = 3SE +/- 3.50, N = 3511.85509.541. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Sparsifymanticmantic-no-omit-framepointer306090120150SE +/- 1.36, N = 5SE +/- 1.28, N = 5127.28125.441. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Wardmanticmantic-no-omit-framepointer1326395265SE +/- 0.21, N = 3SE +/- 0.22, N = 357.8257.551. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: MNIST Datasetmanticmantic-no-omit-framepointer1530456075SE +/- 0.82, N = 4SE +/- 0.47, N = 365.7665.881. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Neighborsmanticmantic-no-omit-framepointer306090120150SE +/- 1.34, N = 7SE +/- 0.59, N = 3147.75142.451. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: SGD Regressionmanticmantic-no-omit-framepointer20406080100SE +/- 1.06, N = 6SE +/- 0.49, N = 3106.32107.531. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: SGDOneClassSVMmanticmantic-no-omit-framepointer80160240320400SE +/- 4.18, N = 3SE +/- 3.48, N = 7379.74382.611. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Isolation Forestmanticmantic-no-omit-framepointer70140210280350SE +/- 1.30, N = 3SE +/- 51.04, N = 9289.37336.371. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Text Vectorizersmanticmantic-no-omit-framepointer1428425670SE +/- 0.19, N = 3SE +/- 0.08, N = 360.8163.881. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Hierarchicalmanticmantic-no-omit-framepointer50100150200250SE +/- 0.75, N = 3SE +/- 0.42, N = 3211.29208.391. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot OMP vs. LARSmanticmantic-no-omit-framepointer20406080100SE +/- 0.08, N = 3SE +/- 0.44, N = 391.5092.581. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Feature Expansionsmanticmantic-no-omit-framepointer306090120150SE +/- 0.86, N = 3SE +/- 1.22, N = 3131.28133.091. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: LocalOutlierFactormanticmantic-no-omit-framepointer1326395265SE +/- 0.18, N = 3SE +/- 0.74, N = 1553.4656.751. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: TSNE MNIST Datasetmanticmantic-no-omit-framepointer50100150200250SE +/- 0.44, N = 3SE +/- 0.54, N = 3236.87236.791. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Isotonic / Logisticmanticmantic-no-omit-framepointer30060090012001500SE +/- 12.29, N = 3SE +/- 14.46, N = 31470.811471.831. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Incremental PCAmanticmantic-no-omit-framepointer714212835SE +/- 0.03, N = 3SE +/- 0.07, N = 331.0131.061. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Hist Gradient Boostingmanticmantic-no-omit-framepointer20406080100SE +/- 0.22, N = 3SE +/- 0.25, N = 3109.98111.261. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Sample Without Replacementmanticmantic-no-omit-framepointer4080120160200SE +/- 0.60, N = 3SE +/- 0.62, N = 3158.26161.461. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Covertype Dataset Benchmarkmanticmantic-no-omit-framepointer80160240320400SE +/- 4.88, N = 3SE +/- 3.40, N = 3376.15370.691. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Hist Gradient Boosting Adultmanticmantic-no-omit-framepointer20406080100SE +/- 0.70, N = 3SE +/- 0.59, N = 3103.50105.651. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Isotonic / Perturbed Logarithmmanticmantic-no-omit-framepointer400800120016002000SE +/- 24.41, N = 3SE +/- 16.46, N = 31788.261828.301. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Hist Gradient Boosting Threadingmanticmantic-no-omit-framepointer20406080100SE +/- 0.13, N = 3SE +/- 0.15, N = 3110.22110.371. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: 20 Newsgroups / Logistic Regressionmanticmantic-no-omit-framepointer1020304050SE +/- 0.19, N = 3SE +/- 0.24, N = 341.5241.731. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Plot Polynomial Kernel Approximationmanticmantic-no-omit-framepointer306090120150SE +/- 1.22, N = 3SE +/- 1.20, N = 3150.73150.381. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Hist Gradient Boosting Categorical Onlymanticmantic-no-omit-framepointer510152025SE +/- 0.06, N = 3SE +/- 0.12, N = 318.5818.871. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Kernel PCA Solvers / Time vs. N Samplesmanticmantic-no-omit-framepointer1632486480SE +/- 0.05, N = 3SE +/- 0.16, N = 372.5472.911. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Kernel PCA Solvers / Time vs. N Componentsmanticmantic-no-omit-framepointer918273645SE +/- 0.21, N = 3SE +/- 0.36, N = 337.2437.891. (F9X) gfortran options: -O0

OpenBenchmarking.orgSeconds, Fewer Is BetterScikit-Learn 1.2.2Benchmark: Sparse Random Projections / 100 Iterationsmanticmantic-no-omit-framepointer140280420560700SE +/- 3.80, N = 3SE +/- 7.06, N = 4613.55631.071. (F9X) gfortran options: -O0

PyHPC Benchmarks

PyHPC-Benchmarks is a suite of Python high performance computing benchmarks for execution on CPUs and GPUs using various popular Python HPC libraries. The PyHPC CPU-based benchmarks focus on sequential CPU performance. Learn more via the OpenBenchmarking.org test page.

Device: CPU - Backend: JAX - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: JAX - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Numba - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: CPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Equation of State

mantic-no-omit-framepointer: The test run did not produce a result.

Device: GPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Isoneutral Mixing

mantic-no-omit-framepointer: The test run did not produce a result.

Scikit-Learn

Scikit-learn is a Python module for machine learning built on NumPy, SciPy, and is BSD-licensed. Learn more via the OpenBenchmarking.org test page.

Benchmark: Glmnet

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: ModuleNotFoundError: No module named 'glmnet'

Benchmark: Plot Lasso Path

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: AttributeError: type object 'Axis' has no attribute '_set_ticklabels'. Did you mean: 'set_ticklabels'?

Benchmark: Plot Fast KMeans

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: AttributeError: type object 'Axis' has no attribute '_set_ticklabels'. Did you mean: 'set_ticklabels'?

Benchmark: Plot Parallel Pairwise

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: numpy.core._exceptions._ArrayMemoryError: Unable to allocate 74.5 GiB for an array with shape (100000, 100000) and data type float64

Benchmark: Isotonic / Pathological

mantic-no-omit-framepointer: The test quit with a non-zero exit status.

Benchmark: RCV1 Logreg Convergencet

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: IndexError: list index out of range

Benchmark: Plot Singular Value Decomposition

mantic-no-omit-framepointer: The test quit with a non-zero exit status. E: AttributeError: type object 'Axis' has no attribute '_set_ticklabels'. Did you mean: 'set_ticklabels'?

102 Results Shown

Numpy Benchmark
PyTorch:
  CPU - 1 - ResNet-50
  CPU - 1 - ResNet-152
  CPU - 16 - ResNet-50
  CPU - 32 - ResNet-50
  CPU - 64 - ResNet-50
  CPU - 16 - ResNet-152
  CPU - 256 - ResNet-50
  CPU - 32 - ResNet-152
  CPU - 512 - ResNet-50
  CPU - 64 - ResNet-152
  CPU - 256 - ResNet-152
  CPU - 512 - ResNet-152
  CPU - 1 - Efficientnet_v2_l
  CPU - 16 - Efficientnet_v2_l
  CPU - 32 - Efficientnet_v2_l
  CPU - 64 - Efficientnet_v2_l
  CPU - 256 - Efficientnet_v2_l
  CPU - 512 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 1 - ResNet-50
  NVIDIA CUDA GPU - 1 - ResNet-152
  NVIDIA CUDA GPU - 16 - ResNet-50
  NVIDIA CUDA GPU - 32 - ResNet-50
  NVIDIA CUDA GPU - 64 - ResNet-50
  NVIDIA CUDA GPU - 16 - ResNet-152
  NVIDIA CUDA GPU - 256 - ResNet-50
  NVIDIA CUDA GPU - 32 - ResNet-152
  NVIDIA CUDA GPU - 512 - ResNet-50
  NVIDIA CUDA GPU - 64 - ResNet-152
  NVIDIA CUDA GPU - 256 - ResNet-152
  NVIDIA CUDA GPU - 512 - ResNet-152
  NVIDIA CUDA GPU - 1 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 16 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 32 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 64 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 256 - Efficientnet_v2_l
  NVIDIA CUDA GPU - 512 - Efficientnet_v2_l
PyBench
PyPerformance:
  go
  2to3
  chaos
  float
  nbody
  pathlib
  raytrace
  json_loads
  crypto_pyaes
  regex_compile
  python_startup
  django_template
  pickle_pure_python
PyHPC Benchmarks:
  CPU - Numpy - 16384 - Equation of State
  CPU - Numpy - 16384 - Isoneutral Mixing
  CPU - Numpy - 65536 - Equation of State
  CPU - Numpy - 65536 - Isoneutral Mixing
  GPU - Numpy - 16384 - Equation of State
  GPU - Numpy - 16384 - Isoneutral Mixing
  GPU - Numpy - 65536 - Equation of State
  GPU - Numpy - 65536 - Isoneutral Mixing
  CPU - Numpy - 262144 - Equation of State
  CPU - Numpy - 262144 - Isoneutral Mixing
  GPU - Numpy - 262144 - Equation of State
  GPU - Numpy - 262144 - Isoneutral Mixing
  CPU - Numpy - 1048576 - Equation of State
  CPU - Numpy - 1048576 - Isoneutral Mixing
  CPU - Numpy - 4194304 - Equation of State
  CPU - Numpy - 4194304 - Isoneutral Mixing
  GPU - Numpy - 1048576 - Equation of State
  GPU - Numpy - 1048576 - Isoneutral Mixing
  GPU - Numpy - 4194304 - Equation of State
  GPU - Numpy - 4194304 - Isoneutral Mixing
Scikit-Learn:
  GLM
  SAGA
  Tree
  Lasso
  Sparsify
  Plot Ward
  MNIST Dataset
  Plot Neighbors
  SGD Regression
  SGDOneClassSVM
  Isolation Forest
  Text Vectorizers
  Plot Hierarchical
  Plot OMP vs. LARS
  Feature Expansions
  LocalOutlierFactor
  TSNE MNIST Dataset
  Isotonic / Logistic
  Plot Incremental PCA
  Hist Gradient Boosting
  Sample Without Replacement
  Covertype Dataset Benchmark
  Hist Gradient Boosting Adult
  Isotonic / Perturbed Logarithm
  Hist Gradient Boosting Threading
  20 Newsgroups / Logistic Regression
  Plot Polynomial Kernel Approximation
  Hist Gradient Boosting Categorical Only
  Kernel PCA Solvers / Time vs. N Samples
  Kernel PCA Solvers / Time vs. N Components
  Sparse Rand Projections / 100 Iterations