pyhpc onnx

AMD Ryzen Threadripper 3990X 64-Core testing with a Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS) and AMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB on Pop 21.04 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 2110307-TJ-PYHPCONNX10
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

HPC - High Performance Computing 2 Tests
Python Tests 2 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
1
October 30 2021
  30 Minutes
2
October 30 2021
  30 Minutes
3
October 30 2021
  30 Minutes
Invert Hiding All Results Option
  30 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


pyhpc onnxProcessorMotherboardChipsetMemoryDiskGraphicsAudioMonitorNetworkOSKernelDesktopDisplay ServerOpenGLVulkanCompilerFile-SystemScreen Resolution123AMD Ryzen Threadripper 3990X 64-Core @ 2.90GHz (64 Cores / 128 Threads)Gigabyte TRX40 AORUS PRO WIFI (F4p BIOS)AMD Starship/Matisse126GBSamsung SSD 970 EVO Plus 500GBAMD Radeon RX 5600 OEM/5600 XT / 5700/5700 8GB (1750/875MHz)AMD Navi 10 HDMI AudioDELL P2415QIntel I211 + Intel Wi-Fi 6 AX200Pop 21.045.11.0-7620-generic (x86_64)GNOME Shell 3.38.4X Server 1.20.94.6 Mesa 21.0.1 (LLVM 11.0.1)1.2.145GCC 10.3.0ext43840x2160OpenBenchmarking.orgKernel Details- Transparent Huge Pages: madviseCompiler Details- --build=x86_64-linux-gnu --disable-vtable-verify --disable-werror --enable-bootstrap --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-gnu-unique-object --enable-languages=c,ada,c++,go,brig,d,fortran,objc,obj-c++,m2 --enable-libphobos-checking=release --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-link-mutex --enable-multiarch --enable-multilib --enable-nls --enable-objc-gc=auto --enable-offload-targets=nvptx-none=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-nvptx/usr,amdgcn-amdhsa=/build/gcc-10-gDeRY6/gcc-10-10.3.0/debian/tmp-gcn/usr,hsa --enable-plugin --enable-shared --enable-threads=posix --host=x86_64-linux-gnu --program-prefix=x86_64-linux-gnu- --target=x86_64-linux-gnu --with-abi=m64 --with-arch-32=i686 --with-build-config=bootstrap-lto-lean --with-default-libstdcxx-abi=new --with-gcc-major-version-only --with-multilib-list=m32,m64,mx32 --with-target-system-zlib=auto --with-tune=generic --without-cuda-driver -v Processor Details- Scaling Governor: acpi-cpufreq schedutil (Boost: Enabled) - CPU Microcode: 0x8301039Python Details- Python 3.9.5Security Details- itlb_multihit: Not affected + l1tf: Not affected + mds: Not affected + meltdown: Not affected + spec_store_bypass: Mitigation of SSB disabled via prctl and seccomp + spectre_v1: Mitigation of usercopy/swapgs barriers and __user pointer sanitization + spectre_v2: Mitigation of Full AMD retpoline IBPB: conditional STIBP: conditional RSB filling + srbds: Not affected + tsx_async_abort: Not affected

ONNX Runtime

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.9.1Model: yolov4 - Device: CPU321701402102803502952993031. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt -pthread -lpthread

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.9.1Model: fcn-resnet101-11 - Device: CPU1233060901201501561561561. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt -pthread -lpthread

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.9.1Model: shufflenet-v2-10 - Device: CPU2132K4K6K8K10K1148411492115791. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt -pthread -lpthread

OpenBenchmarking.orgInferences Per Minute, More Is BetterONNX Runtime 1.9.1Model: super-resolution-10 - Device: CPU321160032004800640080007498752176751. (CXX) g++ options: -ffunction-sections -fdata-sections -march=native -mtune=native -O3 -flto -fno-fat-lto-objects -ldl -lrt -pthread -lpthread

PyHPC Benchmarks

PyHPC-Benchmarks is a suite of Python high performance computing benchmarks for execution on CPUs and GPUs using various popular Python HPC libraries. The PyHPC CPU-based benchmarks focus on sequential CPU performance. Learn more via the OpenBenchmarking.org test page.

Device: CPU - Backend: JAX - Project Size: 16384 - Benchmark: Equation of State

1: Test failed to run.

2: Test failed to run.

3: Test failed to run.

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 16384 - Benchmark: Isoneutral Mixing3210.00070.00140.00210.00280.00350.0030.0030.003

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 65536 - Benchmark: Equation of State3210.00020.00040.00060.00080.0010.0010.0010.001

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 65536 - Benchmark: Isoneutral Mixing3210.00430.00860.01290.01720.02150.0190.0180.018

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 262144 - Benchmark: Equation of State3210.00020.00040.00060.00080.0010.0010.0010.001

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 262144 - Benchmark: Isoneutral Mixing1320.01870.03740.05610.07480.09350.0830.0820.082

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 1048576 - Benchmark: Equation of State3210.00540.01080.01620.02160.0270.0240.0240.024

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 1048576 - Benchmark: Isoneutral Mixing3210.04010.08020.12030.16040.20050.1780.1700.165

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Equation of State3210.01420.02840.04260.05680.0710.0630.0630.063

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: JAX - Project Size: 4194304 - Benchmark: Isoneutral Mixing3210.15570.31140.46710.62280.77850.6920.6850.679

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 16384 - Benchmark: Equation of State3210.00020.00040.00060.00080.0010.0010.0010.001

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 16384 - Benchmark: Isoneutral Mixing3210.00090.00180.00270.00360.00450.0040.0040.004

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 65536 - Benchmark: Equation of State3210.00090.00180.00270.00360.00450.0040.0040.004

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 65536 - Benchmark: Isoneutral Mixing3210.00380.00760.01140.01520.0190.0170.0170.017

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 16384 - Benchmark: Equation of State3210.00070.00140.00210.00280.00350.0030.0030.003

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 16384 - Benchmark: Isoneutral Mixing3210.00160.00320.00480.00640.0080.0070.0070.007

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 65536 - Benchmark: Equation of State3210.00360.00720.01080.01440.0180.0160.0160.015

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 65536 - Benchmark: Isoneutral Mixing3210.00720.01440.02160.02880.0360.0320.0320.032

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 16384 - Benchmark: Equation of State3210.00020.00040.00060.00080.0010.0010.0010.001

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 16384 - Benchmark: Isoneutral Mixing3210.00110.00220.00330.00440.00550.0050.0050.005

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 65536 - Benchmark: Equation of State3210.00110.00220.00330.00440.00550.0050.0050.005

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 65536 - Benchmark: Isoneutral Mixing3210.00450.0090.01350.0180.02250.020.020.02

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 262144 - Benchmark: Equation of State3210.00360.00720.01080.01440.0180.0160.0150.015

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 262144 - Benchmark: Isoneutral Mixing3210.01440.02880.04320.05760.0720.0640.0640.063

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 262144 - Benchmark: Equation of State3210.01490.02980.04470.05960.07450.0660.0640.060

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 262144 - Benchmark: Isoneutral Mixing3210.03080.06160.09240.12320.1540.1370.1340.130

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 262144 - Benchmark: Equation of State3210.00450.0090.01350.0180.02250.020.020.02

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 262144 - Benchmark: Isoneutral Mixing3210.01780.03560.05340.07120.0890.0790.0780.076

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 1048576 - Benchmark: Equation of State2310.01440.02880.04320.05760.0720.0640.0630.063

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 1048576 - Benchmark: Isoneutral Mixing3210.06590.13180.19770.26360.32950.2930.2930.290

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Equation of State3210.05690.11380.17070.22760.28450.2530.2520.252

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numba - Project Size: 4194304 - Benchmark: Isoneutral Mixing3210.27430.54860.82291.09721.37151.2191.2161.213

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Equation of State2310.06350.1270.19050.2540.31750.2820.2800.273

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 1048576 - Benchmark: Isoneutral Mixing3210.14220.28440.42660.56880.7110.6320.6180.610

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Equation of State2310.30740.61480.92221.22961.5371.3661.3641.348

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Numpy - Project Size: 4194304 - Benchmark: Isoneutral Mixing3210.56571.13141.69712.26282.82852.5142.5092.496

Device: CPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Equation of State

1: Test failed to run.

2: Test failed to run.

3: Test failed to run.

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 16384 - Benchmark: Isoneutral Mixing3210.00110.00220.00330.00440.00550.0050.0050.005

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Equation of State3210.00050.0010.00150.0020.00250.0020.0020.002

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 65536 - Benchmark: Isoneutral Mixing2310.00410.00820.01230.01640.02050.0180.0170.017

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Equation of State3210.01850.0370.05550.0740.09250.0820.0820.080

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 1048576 - Benchmark: Isoneutral Mixing3210.08420.16840.25260.33680.4210.3740.3730.370

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Equation of State2310.07340.14680.22020.29360.3670.3260.3220.322

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: Aesara - Project Size: 4194304 - Benchmark: Isoneutral Mixing3210.34490.68981.03471.37961.72451.5331.5321.531

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Equation of State3210.00110.00220.00330.00440.00550.0050.0050.005

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 262144 - Benchmark: Isoneutral Mixing3210.01780.03560.05340.07120.0890.0790.0770.073

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Equation of State3210.00560.01120.01680.02240.0280.0250.0250.024

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 1048576 - Benchmark: Isoneutral Mixing3210.08570.17140.25710.34280.42850.3810.3800.373

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Equation of State3210.02070.04140.06210.08280.10350.0920.0920.091

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: PyTorch - Project Size: 4194304 - Benchmark: Isoneutral Mixing3210.38140.76281.14421.52561.9071.6951.6641.615

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Equation of State3210.00020.00040.00060.00080.0010.0010.0010.001

Device: CPU - Backend: TensorFlow - Project Size: 16384 - Benchmark: Isoneutral Mixing

1: Test failed to run.

2: Test failed to run.

3: Test failed to run.

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Equation of State1230.00090.00180.00270.00360.00450.0040.0030.002

Device: CPU - Backend: TensorFlow - Project Size: 65536 - Benchmark: Isoneutral Mixing

1: Test failed to run.

2: Test failed to run.

3: Test failed to run.

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Equation of State2310.00270.00540.00810.01080.01350.0120.0080.008

Device: CPU - Backend: TensorFlow - Project Size: 262144 - Benchmark: Isoneutral Mixing

1: Test failed to run.

2: Test failed to run.

3: Test failed to run.

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Equation of State3210.00680.01360.02040.02720.0340.030.030.03

Device: CPU - Backend: TensorFlow - Project Size: 1048576 - Benchmark: Isoneutral Mixing

1: Test failed to run.

2: Test failed to run.

3: Test failed to run.

OpenBenchmarking.orgSeconds, Fewer Is BetterPyHPC Benchmarks 3.0Device: CPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Equation of State3210.03170.06340.09510.12680.15850.1410.1410.139

Device: CPU - Backend: TensorFlow - Project Size: 4194304 - Benchmark: Isoneutral Mixing

1: Test failed to run.

2: Test failed to run.

3: Test failed to run.

57 Results Shown

ONNX Runtime:
  yolov4 - CPU
  fcn-resnet101-11 - CPU
  shufflenet-v2-10 - CPU
  super-resolution-10 - CPU
PyHPC Benchmarks:
  CPU - JAX - 16384 - Isoneutral Mixing
  CPU - JAX - 65536 - Equation of State
  CPU - JAX - 65536 - Isoneutral Mixing
  CPU - JAX - 262144 - Equation of State
  CPU - JAX - 262144 - Isoneutral Mixing
  CPU - JAX - 1048576 - Equation of State
  CPU - JAX - 1048576 - Isoneutral Mixing
  CPU - JAX - 4194304 - Equation of State
  CPU - JAX - 4194304 - Isoneutral Mixing
  CPU - Numba - 16384 - Equation of State
  CPU - Numba - 16384 - Isoneutral Mixing
  CPU - Numba - 65536 - Equation of State
  CPU - Numba - 65536 - Isoneutral Mixing
  CPU - Numpy - 16384 - Equation of State
  CPU - Numpy - 16384 - Isoneutral Mixing
  CPU - Numpy - 65536 - Equation of State
  CPU - Numpy - 65536 - Isoneutral Mixing
  CPU - Aesara - 16384 - Equation of State
  CPU - Aesara - 16384 - Isoneutral Mixing
  CPU - Aesara - 65536 - Equation of State
  CPU - Aesara - 65536 - Isoneutral Mixing
  CPU - Numba - 262144 - Equation of State
  CPU - Numba - 262144 - Isoneutral Mixing
  CPU - Numpy - 262144 - Equation of State
  CPU - Numpy - 262144 - Isoneutral Mixing
  CPU - Aesara - 262144 - Equation of State
  CPU - Aesara - 262144 - Isoneutral Mixing
  CPU - Numba - 1048576 - Equation of State
  CPU - Numba - 1048576 - Isoneutral Mixing
  CPU - Numba - 4194304 - Equation of State
  CPU - Numba - 4194304 - Isoneutral Mixing
  CPU - Numpy - 1048576 - Equation of State
  CPU - Numpy - 1048576 - Isoneutral Mixing
  CPU - Numpy - 4194304 - Equation of State
  CPU - Numpy - 4194304 - Isoneutral Mixing
  CPU - PyTorch - 16384 - Isoneutral Mixing
  CPU - PyTorch - 65536 - Equation of State
  CPU - PyTorch - 65536 - Isoneutral Mixing
  CPU - Aesara - 1048576 - Equation of State
  CPU - Aesara - 1048576 - Isoneutral Mixing
  CPU - Aesara - 4194304 - Equation of State
  CPU - Aesara - 4194304 - Isoneutral Mixing
  CPU - PyTorch - 262144 - Equation of State
  CPU - PyTorch - 262144 - Isoneutral Mixing
  CPU - PyTorch - 1048576 - Equation of State
  CPU - PyTorch - 1048576 - Isoneutral Mixing
  CPU - PyTorch - 4194304 - Equation of State
  CPU - PyTorch - 4194304 - Isoneutral Mixing
  CPU - TensorFlow - 16384 - Equation of State
  CPU - TensorFlow - 65536 - Equation of State
  CPU - TensorFlow - 262144 - Equation of State
  CPU - TensorFlow - 1048576 - Equation of State
  CPU - TensorFlow - 4194304 - Equation of State