Jetson Prep

ARMv7 rev 4 testing with a BCM2835 Raspberry Pi 3 Model B Plus Rev 1.3 and BCM2708 on Raspbian 9.6 via the Phoronix Test Suite.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1903168-SP-1903165SP28
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Limit displaying results to tests within:

C/C++ Compiler Tests 4 Tests
Compression Tests 2 Tests
CPU Massive 8 Tests
Creator Workloads 4 Tests
Multi-Core 5 Tests
Programmer / Developer System Benchmarks 2 Tests
Python Tests 2 Tests
Renderers 2 Tests
Server CPU Tests 6 Tests
Single-Threaded 4 Tests

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Geometric Means Per-Suite/Category
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
View Logs
Performance Per
Dollar
Date
Run
  Test
  Duration
Jetson AGX Xavier
March 15 2019
  4 Hours, 1 Minute
Jetson TX2 Max-P
March 15 2019
  6 Hours, 25 Minutes
Jetson TX2 Max-Q
March 16 2019
  7 Hours, 23 Minutes
Raspberry Pi 3 Model B+
March 16 2019
  4 Hours, 32 Minutes
Invert Hiding All Results Option
  5 Hours, 35 Minutes

Only show results where is faster than
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):


Jetson PrepProcessorMotherboardMemoryDiskGraphicsMonitorOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+ARMv8 rev 0 @ 2.27GHz (8 Cores)jetson-xavier16384MB31GB HBG4a2NVIDIA Tegra XavierVE228Ubuntu 18.044.9.108-tegra (aarch64)Unity 7.5.0X Server 1.19.6NVIDIA 31.0.24.6.01.1.76GCC 7.3.0 + CUDA 10.0ext41920x1080ARMv8 rev 3 @ 2.04GHz (4 Cores / 6 Threads)quill8192MB31GB 032G34NVIDIA TEGRAUbuntu 16.044.4.38-tegra (aarch64)Unity 7.4.0X Server 1.18.4NVIDIA 28.2.14.5.0GCC 5.4.0 20160609 + CUDA 9.0ARMv8 rev 3 @ 1.27GHz (4 Cores / 6 Threads)ARMv7 rev 4 @ 1.40GHz (4 Cores)BCM2835 Raspberry Pi 3 Model B Plus Rev 1.3926MB32GB GB2MWBCM2708Raspbian 9.64.19.23-v7+ (armv7l)LXDEX Server 1.19.2GCC 6.3.0 20170516656x416OpenBenchmarking.orgCompiler Details- Jetson AGX Xavier: --build=aarch64-linux-gnu --disable-libquadmath --disable-libquadmath-support --disable-werror --enable-checking=release --enable-clocale=gnu --enable-default-pie --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-languages=c,ada,c++,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --program-prefix=aarch64-linux-gnu- --target=aarch64-linux-gnu --with-default-libstdcxx-abi=new --with-gcc-major-version-only -v - Jetson TX2 Max-P: --build=aarch64-linux-gnu --disable-browser-plugin --disable-libquadmath --disable-werror --enable-checking=release --enable-clocale=gnu --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --target=aarch64-linux-gnu --with-arch-directory=aarch64 --with-default-libstdcxx-abi=new -v - Jetson TX2 Max-Q: --build=aarch64-linux-gnu --disable-browser-plugin --disable-libquadmath --disable-werror --enable-checking=release --enable-clocale=gnu --enable-fix-cortex-a53-843419 --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-plugin --enable-shared --enable-threads=posix --host=aarch64-linux-gnu --target=aarch64-linux-gnu --with-arch-directory=aarch64 --with-default-libstdcxx-abi=new -v - Raspberry Pi 3 Model B+: --build=arm-linux-gnueabihf --disable-browser-plugin --disable-libitm --disable-libquadmath --disable-sjlj-exceptions --enable-checking=release --enable-clocale=gnu --enable-gnu-unique-object --enable-gtk-cairo --enable-java-awt=gtk --enable-java-home --enable-languages=c,ada,c++,java,go,d,fortran,objc,obj-c++ --enable-libstdcxx-debug --enable-libstdcxx-time=yes --enable-multiarch --enable-nls --enable-objc-gc=auto --enable-plugin --enable-shared --enable-threads=posix --host=arm-linux-gnueabihf --program-prefix=arm-linux-gnueabihf- --target=arm-linux-gnueabihf --with-arch-directory=arm --with-arch=armv6 --with-default-libstdcxx-abi=new --with-float=hard --with-fpu=vfp --with-target-system-zlib -v Processor Details- Jetson AGX Xavier: Scaling Governor: tegra_cpufreq schedutil- Jetson TX2 Max-P: Scaling Governor: tegra_cpufreq schedutil- Jetson TX2 Max-Q: Scaling Governor: tegra_cpufreq schedutil- Raspberry Pi 3 Model B+: Scaling Governor: BCM2835 Freq ondemandPython Details- Jetson AGX Xavier: Python 2.7.15rc1 + Python 3.6.7- Jetson TX2 Max-P: Python 2.7.12 + Python 3.5.2- Jetson TX2 Max-Q: Python 2.7.12 + Python 3.5.2- Raspberry Pi 3 Model B+: Python 2.7.13 + Python 3.5.3

Jetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+Logarithmic Result OverviewPhoronix Test Suite7-Zip CompressionTTSIOD 3D RendererPyBenchFLAC Audio EncodingC-RayZstd CompressionRust Prime BenchmarkOpenCV Benchmark

Jetson Prepcuda-mini-nbody: Originalglmark2: 1920 x 1080tensorrt-inference: VGG16 - FP16 - 4 - Disabledtensorrt-inference: VGG16 - INT8 - 4 - Disabledtensorrt-inference: VGG19 - FP16 - 4 - Disabledtensorrt-inference: VGG19 - INT8 - 4 - Disabledtensorrt-inference: VGG16 - FP16 - 32 - Disabledtensorrt-inference: VGG16 - INT8 - 32 - Disabledtensorrt-inference: VGG19 - FP16 - 32 - Disabledtensorrt-inference: VGG19 - INT8 - 32 - Disabledtensorrt-inference: AlexNet - FP16 - 4 - Disabledtensorrt-inference: AlexNet - INT8 - 4 - Disabledtensorrt-inference: AlexNet - FP16 - 32 - Disabledtensorrt-inference: AlexNet - INT8 - 32 - Disabledtensorrt-inference: ResNet50 - FP16 - 4 - Disabledtensorrt-inference: ResNet50 - INT8 - 4 - Disabledtensorrt-inference: GoogleNet - FP16 - 4 - Disabledtensorrt-inference: GoogleNet - INT8 - 4 - Disabledtensorrt-inference: ResNet152 - FP16 - 4 - Disabledtensorrt-inference: ResNet152 - INT8 - 4 - Disabledtensorrt-inference: ResNet50 - FP16 - 32 - Disabledtensorrt-inference: ResNet50 - INT8 - 32 - Disabledtensorrt-inference: GoogleNet - FP16 - 32 - Disabledtensorrt-inference: GoogleNet - INT8 - 32 - Disabledtensorrt-inference: ResNet152 - FP16 - 32 - Disabledtensorrt-inference: ResNet152 - INT8 - 32 - Disabledlczero: BLASlczero: CUDA + cuDNNlczero: CUDA + cuDNN FP16ttsiod-renderer: Phong Rendering With Soft-Shadow Mappingcompress-7zip: Compress Speed Testc-ray: Total Time - 4K, 16 Rays Per Pixelrust-prime: Prime Number Test To 200,000,000compress-zstd: Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19encode-flac: WAV To FLACopencv-bench: pybench: Total For Average Test Timestesseract-ocr: Time To OCR 7 ImagesJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+47.132876208.76303.78172.50265.81247.95475.08203.96394.661200114320383143547.50902.787961146224.19372.736361215.0810061693259.82493.2247.62952.892515.011331921235532.3780.0654.47128300771.948.2432.6417.5626.5614.3236.8719.9129.8315.9226418446230192.2849.9719711335.1118.2911159.6923313041.9122.0749.265593585104.96144.9765.0729654086.7725.9914.2421.0411.4529.8315.7923.9412.5921614837423772.0139.1515688.8827.3414.5086.0847.1517910432.6717.3628.853294869170.25253.80104.28493873517.66201320301097.69342.23339.532.7420913OpenBenchmarking.org

CUDA Mini-Nbody

OpenBenchmarking.org(NBody^2)/s, More Is BetterCUDA Mini-Nbody 2015-11-10Test: OriginalJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q1122334455SE +/- 0.00, N = 3SE +/- 0.01, N = 3SE +/- 0.03, N = 347.138.246.77
OpenBenchmarking.org(NBody^2)/s, More Is BetterCUDA Mini-Nbody 2015-11-10Test: OriginalJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q1020304050Min: 47.12 / Avg: 47.13 / Max: 47.14Min: 8.23 / Avg: 8.24 / Max: 8.25Min: 6.71 / Avg: 6.77 / Max: 6.8

GLmark2

This is a test of any system-installed GLMark2 OpenGL benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterGLmark2Resolution: 1920 x 1080Jetson AGX Xavier60012001800240030002876

NVIDIA TensorRT Inference

This test profile uses any existing system installation of NVIDIA TensorRT for carrying out inference benchmarks with various neural networks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q50100150200250SE +/- 0.10, N = 3SE +/- 0.50, N = 4SE +/- 0.13, N = 3208.7632.6425.99
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q4080120160200Min: 208.63 / Avg: 208.76 / Max: 208.96Min: 31.7 / Avg: 32.64 / Max: 33.98Min: 25.73 / Avg: 25.99 / Max: 26.17

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q70140210280350SE +/- 0.46, N = 3SE +/- 0.25, N = 6SE +/- 0.20, N = 5303.7817.5614.24
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q50100150200250Min: 303.01 / Avg: 303.78 / Max: 304.61Min: 16.36 / Avg: 17.56 / Max: 18.11Min: 13.46 / Avg: 14.24 / Max: 14.6

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q4080120160200SE +/- 0.50, N = 3SE +/- 0.38, N = 3SE +/- 0.34, N = 3172.5026.5621.04
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q306090120150Min: 171.71 / Avg: 172.5 / Max: 173.43Min: 25.87 / Avg: 26.56 / Max: 27.2Min: 20.54 / Avg: 21.04 / Max: 21.7

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q60120180240300SE +/- 0.20, N = 3SE +/- 0.25, N = 4SE +/- 0.23, N = 3265.8114.3211.45
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q50100150200250Min: 265.44 / Avg: 265.81 / Max: 266.11Min: 13.63 / Avg: 14.32 / Max: 14.8Min: 10.99 / Avg: 11.45 / Max: 11.69

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q50100150200250SE +/- 0.12, N = 3SE +/- 0.31, N = 3SE +/- 0.18, N = 3247.9536.8729.83
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q4080120160200Min: 247.73 / Avg: 247.95 / Max: 248.14Min: 36.25 / Avg: 36.87 / Max: 37.19Min: 29.48 / Avg: 29.83 / Max: 30.12

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q100200300400500SE +/- 0.10, N = 3SE +/- 0.05, N = 3SE +/- 0.01, N = 3475.0819.9115.79
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q80160240320400Min: 474.88 / Avg: 475.08 / Max: 475.2Min: 19.83 / Avg: 19.91 / Max: 19.99Min: 15.76 / Avg: 15.79 / Max: 15.81

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q4080120160200SE +/- 0.04, N = 3SE +/- 0.05, N = 3SE +/- 0.07, N = 3203.9629.8323.94
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q4080120160200Min: 203.92 / Avg: 203.96 / Max: 204.03Min: 29.76 / Avg: 29.83 / Max: 29.94Min: 23.79 / Avg: 23.94 / Max: 24.04

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q90180270360450SE +/- 0.23, N = 3SE +/- 0.06, N = 3SE +/- 0.03, N = 3394.6615.9212.59
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q70140210280350Min: 394.4 / Avg: 394.66 / Max: 395.11Min: 15.81 / Avg: 15.92 / Max: 16Min: 12.53 / Avg: 12.59 / Max: 12.63

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q30060090012001500SE +/- 1.82, N = 3SE +/- 7.77, N = 12SE +/- 3.03, N = 61200264216
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000Min: 1196.24 / Avg: 1199.87 / Max: 1201.91Min: 222.34 / Avg: 263.9 / Max: 304.01Min: 202.59 / Avg: 216.45 / Max: 224.23

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000SE +/- 2.59, N = 3SE +/- 2.79, N = 5SE +/- 0.91, N = 31143184148
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000Min: 1138.12 / Avg: 1142.71 / Max: 1147.08Min: 175.71 / Avg: 184.09 / Max: 192.25Min: 146.67 / Avg: 148.2 / Max: 149.83

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q400800120016002000SE +/- 2.07, N = 3SE +/- 7.68, N = 12SE +/- 2.82, N = 32038462374
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q400800120016002000Min: 2035.4 / Avg: 2038.31 / Max: 2042.31Min: 418.29 / Avg: 461.97 / Max: 493.49Min: 368.3 / Avg: 373.57 / Max: 377.97

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q7001400210028003500SE +/- 1.06, N = 3SE +/- 0.52, N = 3SE +/- 1.39, N = 33143301237
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q5001000150020002500Min: 3140.95 / Avg: 3142.61 / Max: 3144.59Min: 300.06 / Avg: 300.95 / Max: 301.86Min: 235.62 / Avg: 237.06 / Max: 239.84

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q120240360480600SE +/- 0.03, N = 3SE +/- 1.32, N = 12SE +/- 1.10, N = 12547.5092.2872.01
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q100200300400500Min: 547.46 / Avg: 547.5 / Max: 547.56Min: 85.37 / Avg: 92.28 / Max: 100.02Min: 65.28 / Avg: 72.01 / Max: 77.6

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000SE +/- 1.86, N = 3SE +/- 0.79, N = 4SE +/- 0.64, N = 3902.7849.9739.15
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q160320480640800Min: 899.76 / Avg: 902.78 / Max: 906.18Min: 47.92 / Avg: 49.97 / Max: 51.79Min: 37.88 / Avg: 39.15 / Max: 39.9

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000SE +/- 2.48, N = 3SE +/- 2.27, N = 3SE +/- 1.90, N = 12796197156
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q140280420560700Min: 790.77 / Avg: 795.65 / Max: 798.88Min: 193.49 / Avg: 197.4 / Max: 201.35Min: 146.96 / Avg: 156.25 / Max: 165.88

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000SE +/- 4.31, N = 3SE +/- 1.65, N = 3SE +/- 1.32, N = 31146.00113.0088.88
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000Min: 1137.32 / Avg: 1145.68 / Max: 1151.7Min: 110.9 / Avg: 113.14 / Max: 116.36Min: 86.29 / Avg: 88.88 / Max: 90.62

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q50100150200250SE +/- 0.22, N = 3SE +/- 0.36, N = 3SE +/- 0.34, N = 3224.1935.1127.34
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q4080120160200Min: 223.75 / Avg: 224.19 / Max: 224.48Min: 34.41 / Avg: 35.11 / Max: 35.61Min: 26.85 / Avg: 27.34 / Max: 27.98

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q80160240320400SE +/- 1.59, N = 3SE +/- 0.14, N = 3SE +/- 0.15, N = 3372.7318.2914.50
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 4 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q70140210280350Min: 370.1 / Avg: 372.73 / Max: 375.59Min: 18.02 / Avg: 18.29 / Max: 18.46Min: 14.29 / Avg: 14.5 / Max: 14.8

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q140280420560700SE +/- 1.23, N = 3SE +/- 1.22, N = 3SE +/- 0.86, N = 3636.00111.0086.08
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q110220330440550Min: 633.64 / Avg: 635.99 / Max: 637.77Min: 108.57 / Avg: 110.71 / Max: 112.8Min: 84.39 / Avg: 86.08 / Max: 87.21

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q30060090012001500SE +/- 0.25, N = 3SE +/- 0.04, N = 3SE +/- 0.08, N = 31215.0859.6947.15
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000Min: 1214.64 / Avg: 1215.08 / Max: 1215.5Min: 59.62 / Avg: 59.69 / Max: 59.74Min: 47.01 / Avg: 47.15 / Max: 47.28

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000SE +/- 0.21, N = 3SE +/- 4.50, N = 3SE +/- 2.17, N = 81006233179
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q2004006008001000Min: 1005.65 / Avg: 1005.91 / Max: 1006.32Min: 223.96 / Avg: 232.95 / Max: 237.67Min: 171.57 / Avg: 179.28 / Max: 186.27

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q400800120016002000SE +/- 8.72, N = 3SE +/- 0.74, N = 3SE +/- 0.07, N = 31693130104
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q30060090012001500Min: 1675.82 / Avg: 1693.17 / Max: 1703.42Min: 128.85 / Avg: 130.12 / Max: 131.41Min: 103.51 / Avg: 103.65 / Max: 103.76

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q60120180240300SE +/- 0.26, N = 3SE +/- 0.07, N = 3SE +/- 0.10, N = 3259.8241.9132.67
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q50100150200250Min: 259.31 / Avg: 259.82 / Max: 260.15Min: 41.81 / Avg: 41.91 / Max: 42.04Min: 32.48 / Avg: 32.67 / Max: 32.81

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q110220330440550SE +/- 0.81, N = 3SE +/- 0.03, N = 3SE +/- 0.00, N = 3493.2222.0717.36
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 32 - DLA Cores: DisabledJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-Q90180270360450Min: 491.63 / Avg: 493.22 / Max: 494.31Min: 22.03 / Avg: 22.07 / Max: 22.12Min: 17.35 / Avg: 17.36 / Max: 17.37

LeelaChessZero

LeelaChessZero (lc0 / lczero) is a chess engine automated vian neural networks. This test profile can be used for OpenCL, CUDA + cuDNN, and BLAS (CPU-based) benchmarking. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.20.1Backend: BLASJetson AGX Xavier1122334455SE +/- 0.62, N = 747.621. (CXX) g++ options: -lpthread -lz

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.20.1Backend: CUDA + cuDNNJetson AGX Xavier2004006008001000SE +/- 6.14, N = 3952.891. (CXX) g++ options: -lpthread -lz

OpenBenchmarking.orgNodes Per Second, More Is BetterLeelaChessZero 0.20.1Backend: CUDA + cuDNN FP16Jetson AGX Xavier5001000150020002500SE +/- 7.60, N = 32515.011. (CXX) g++ options: -lpthread -lz

TTSIOD 3D Renderer

A portable GPL 3D software renderer that supports OpenMP and Intel Threading Building Blocks with many different rendering modes. This version does not use OpenGL but is entirely CPU/software based. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgFPS, More Is BetterTTSIOD 3D Renderer 2.3bPhong Rendering With Soft-Shadow MappingJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+306090120150SE +/- 1.63, N = 12SE +/- 0.15, N = 3SE +/- 0.46, N = 4SE +/- 0.16, N = 3133.0049.2628.8517.661. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -lSDL -fopenmp -fwhole-program -lstdc++
OpenBenchmarking.orgFPS, More Is BetterTTSIOD 3D Renderer 2.3bPhong Rendering With Soft-Shadow MappingJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+20406080100Min: 130.64 / Avg: 133.37 / Max: 150.98Min: 48.96 / Avg: 49.26 / Max: 49.42Min: 27.49 / Avg: 28.85 / Max: 29.39Min: 17.5 / Avg: 17.66 / Max: 17.981. (CXX) g++ options: -O3 -fomit-frame-pointer -ffast-math -mtune=native -flto -lSDL -fopenmp -fwhole-program -lstdc++

7-Zip Compression

This is a test of 7-Zip using p7zip with its integrated benchmark feature or upstream 7-Zip for the Windows x64 build. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 16.02Compress Speed TestJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+4K8K12K16K20KSE +/- 274.18, N = 12SE +/- 20.85, N = 3SE +/- 13.05, N = 3SE +/- 23.74, N = 11192125593329420131. (CXX) g++ options: -pipe -lpthread
OpenBenchmarking.orgMIPS, More Is Better7-Zip Compression 16.02Compress Speed TestJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+3K6K9K12K15KMin: 16806 / Avg: 19211.83 / Max: 19780Min: 5571 / Avg: 5593.33 / Max: 5635Min: 3269 / Avg: 3294 / Max: 3313Min: 1778 / Avg: 2012.64 / Max: 20561. (CXX) g++ options: -pipe -lpthread

C-Ray

This is a test of C-Ray, a simple raytracer designed to test the floating-point CPU performance. This test is multi-threaded (16 threads per core), will shoot 8 rays per pixel for anti-aliasing, and will generate a 1600 x 1200 image. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Time - 4K, 16 Rays Per PixelJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+400800120016002000SE +/- 7.17, N = 9SE +/- 49.09, N = 9SE +/- 1.44, N = 3SE +/- 2.46, N = 335558586920301. (CC) gcc options: -lm -lpthread -O3
OpenBenchmarking.orgSeconds, Fewer Is BetterC-Ray 1.1Total Time - 4K, 16 Rays Per PixelJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+400800120016002000Min: 300.33 / Avg: 354.78 / Max: 364.69Min: 531.98 / Avg: 585.26 / Max: 977.76Min: 865.79 / Avg: 868.66 / Max: 870.17Min: 2025.91 / Avg: 2029.72 / Max: 2034.331. (CC) gcc options: -lm -lpthread -O3

Rust Prime Benchmark

Based on petehunt/rust-benchmark, this is a prime number benchmark that is multi-threaded and written in Rustlang. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterRust Prime BenchmarkPrime Number Test To 200,000,000Jetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+2004006008001000SE +/- 0.00, N = 3SE +/- 0.04, N = 3SE +/- 0.09, N = 3SE +/- 1.55, N = 332.37104.96170.251097.69-ldl -lrt -lpthread -lgcc_s -lc -lm -lutil1. (CC) gcc options: -pie -nodefaultlibs
OpenBenchmarking.orgSeconds, Fewer Is BetterRust Prime BenchmarkPrime Number Test To 200,000,000Jetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+2004006008001000Min: 32.36 / Avg: 32.37 / Max: 32.37Min: 104.9 / Avg: 104.96 / Max: 105.04Min: 170.09 / Avg: 170.25 / Max: 170.41Min: 1095.85 / Avg: 1097.69 / Max: 1100.761. (CC) gcc options: -pie -nodefaultlibs

Zstd Compression

This test measures the time needed to compress a sample file (an Ubuntu file-system image) using Zstd compression. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterZstd Compression 1.3.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19Jetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+70140210280350SE +/- 0.91, N = 3SE +/- 0.29, N = 3SE +/- 1.02, N = 3SE +/- 1.03, N = 380.06144.97253.80342.231. (CC) gcc options: -O3 -pthread -lz -llzma
OpenBenchmarking.orgSeconds, Fewer Is BetterZstd Compression 1.3.4Compressing ubuntu-16.04.3-server-i386.img, Compression Level 19Jetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+60120180240300Min: 78.26 / Avg: 80.06 / Max: 81.18Min: 144.4 / Avg: 144.97 / Max: 145.39Min: 252.57 / Avg: 253.8 / Max: 255.83Min: 340.32 / Avg: 342.23 / Max: 343.871. (CC) gcc options: -O3 -pthread -lz -llzma

FLAC Audio Encoding

This test times how long it takes to encode a sample WAV file to FLAC format five times. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.2WAV To FLACJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+70140210280350SE +/- 0.61, N = 5SE +/- 0.15, N = 5SE +/- 0.18, N = 5SE +/- 0.98, N = 554.4765.07104.28339.531. (CXX) g++ options: -O2 -fvisibility=hidden -logg -lm
OpenBenchmarking.orgSeconds, Fewer Is BetterFLAC Audio Encoding 1.3.2WAV To FLACJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+60120180240300Min: 53.06 / Avg: 54.47 / Max: 56.73Min: 64.8 / Avg: 65.07 / Max: 65.64Min: 103.77 / Avg: 104.28 / Max: 104.76Min: 337.11 / Avg: 339.53 / Max: 342.571. (CXX) g++ options: -O2 -fvisibility=hidden -logg -lm

OpenCV Benchmark

Stress benchmark tests to measure time consumed by the OpenCV libraries installed Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterOpenCV Benchmark 3.3.0Jetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+110220330440550SE +/- 1.57, N = 3SE +/- 0.27, N = 3SE +/- 5.74, N = 3128.00296.00493.002.741. (CXX) g++ options: -std=c++11 -rdynamic
OpenBenchmarking.orgSeconds, Fewer Is BetterOpenCV Benchmark 3.3.0Jetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+90180270360450Min: 125.26 / Avg: 127.83 / Max: 130.69Min: 295.74 / Avg: 296.1 / Max: 296.62Min: 486.66 / Avg: 492.74 / Max: 504.221. (CXX) g++ options: -std=c++11 -rdynamic

PyBench

This test profile reports the total time of the different average timed test results from PyBench. PyBench reports average test times for different functions such as BuiltinFunctionCalls and NestedForLoops, with this total result providing a rough estimate as to Python's average performance on a given system. This test profile runs PyBench each time for 20 rounds. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+4K8K12K16K20KSE +/- 4.67, N = 3SE +/- 33.86, N = 3SE +/- 42.52, N = 3SE +/- 43.80, N = 330075408873520913
OpenBenchmarking.orgMilliseconds, Fewer Is BetterPyBench 2018-02-16Total For Average Test TimesJetson AGX XavierJetson TX2 Max-PJetson TX2 Max-QRaspberry Pi 3 Model B+4K8K12K16K20KMin: 2998 / Avg: 3006.67 / Max: 3014Min: 5366 / Avg: 5408 / Max: 5475Min: 8690 / Avg: 8735 / Max: 8820Min: 20826 / Avg: 20912.67 / Max: 20967

Tesseract OCR

Tesseract-OCR is the open-source optical character recognition (OCR) engine for the conversion of text within images to raw text output. This test profile relies upon a system-supplied Tesseract installation. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgSeconds, Fewer Is BetterTesseract OCR 4.0.0-beta.1Time To OCR 7 ImagesJetson AGX Xavier1632486480SE +/- 0.89, N = 371.94