Jetson AGX Xavier vs. Jetson TX2 TensorRT

NVIDIA Jetson TensorRT inference benchmarks by Michael Larabel for a future article on Phoronix.

Compare your own system(s) to this result file with the Phoronix Test Suite by running the command: phoronix-test-suite benchmark 1812240-SP-XAVIER80657
Jump To Table - Results

View

Do Not Show Noisy Results
Do Not Show Results With Incomplete Data
Do Not Show Results With Little Change/Spread
List Notable Results

Statistics

Show Overall Harmonic Mean(s)
Show Overall Geometric Mean
Show Wins / Losses Counts (Pie Chart)
Normalize Results
Remove Outliers Before Calculating Averages

Graph Settings

Force Line Graphs Where Applicable
Convert To Scalar Where Applicable
Prefer Vertical Bar Graphs

Additional Graphs

Show Perf Per Core/Thread Calculation Graphs Where Applicable
Show Perf Per Clock Calculation Graphs Where Applicable

Multi-Way Comparison

Condense Multi-Option Tests Into Single Result Graphs

Table

Show Detailed System Result Table

Run Management

Highlight
Result
Hide
Result
Result
Identifier
Performance Per
Dollar
Date
Run
  Test
  Duration
Jetson AGX Xavier
December 23 2018
  6 Hours, 30 Minutes
Jetson TX2
December 24 2018
  6 Hours, 26 Minutes
Invert Hiding All Results Option
  6 Hours, 28 Minutes
Only show results matching title/arguments (delimit multiple options with a comma):
Do not show results matching title/arguments (delimit multiple options with a comma):

Jetson AGX Xavier

Processor: ARMv8 rev 0 @ 2.27GHz (8 Cores), Motherboard: jetson-xavier, Memory: 16384MB, Disk: 31GB HBG4a2, Graphics: NVIDIA Tegra Xavier, Monitor: ASUS VP28U

OS: Ubuntu 18.04, Kernel: 4.9.108-tegra (aarch64), Desktop: Unity 7.5.0, Display Server: X Server 1.19.6, Display Driver: NVIDIA 31.0.2, OpenGL: 4.6.0, Vulkan: 1.1.76, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 1920x1080

Processor Notes: Scaling Governor: tegra_cpufreq schedutil

Jetson TX2

Processor: ARMv8 rev 3 @ 2.04GHz (4 Cores / 6 Threads), Motherboard: quill, Memory: 8192MB, Disk: 31GB 032G34, Graphics: NVIDIA Tegra X2, Monitor: VE228

OS: Ubuntu 16.04, Kernel: 4.4.38-tegra (aarch64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: NVIDIA 28.2.1, OpenGL: 4.5.0, Compiler: GCC 5.4.0 20160609 + CUDA 9.0, File-System: ext4, Screen Resolution: 1920x1080

Jetson AGX Xavier vs. Jetson TX2 TensorRTProcessorMotherboardMemoryDiskGraphicsMonitorOSKernelDesktopDisplay ServerDisplay DriverOpenGLVulkanCompilerFile-SystemScreen ResolutionJetson AGX XavierJetson TX2ARMv8 rev 0 @ 2.27GHz (8 Cores)jetson-xavier16384MB31GB HBG4a2NVIDIA Tegra XavierASUS VP28UUbuntu 18.044.9.108-tegra (aarch64)Unity 7.5.0X Server 1.19.6NVIDIA 31.0.24.6.01.1.76GCC 7.3.0 + CUDA 10.0ext41920x1080ARMv8 rev 3 @ 2.04GHz (4 Cores / 6 Threads)quill8192MB31GB 032G34NVIDIA Tegra X2VE228Ubuntu 16.044.4.38-tegra (aarch64)Unity 7.4.0X Server 1.18.4NVIDIA 28.2.14.5.0GCC 5.4.0 20160609 + CUDA 9.0OpenBenchmarking.orgProcessor Details- Scaling Governor: tegra_cpufreq schedutil

Jetson AGX Xavier vs. Jetson TX2 ComparisonPhoronix Test SuiteBaseline+585.7%+585.7%+1171.4%+1171.4%+1757.1%+1757.1%GoogleNet - INT8 - 8796.6%AlexNet - INT8 - 32768.4%AlexNet - INT8 - 16628.3%VGG19 - FP16 - 8582.6%VGG19 - FP16 - 32581.5%VGG16 - FP16 - 32562.6%VGG19 - FP16 - 4549.9%VGG16 - FP16 - 8540.4%ResNet152 - FP16 - 8539.7%VGG16 - FP16 - 16527.7%VGG19 - FP16 - 16521.4%ResNet152 - FP16 - 4515.4%VGG16 - FP16 - 4505.1%ResNet152 - FP16 - 32505.1%ResNet50 - FP16 - 8487.9%ResNet50 - FP16 - 4479.9%GoogleNet - INT8 - 4471.9%ResNet50 - FP16 - 16459.4%ResNet152 - FP16 - 16458.8%ResNet50 - FP16 - 32457.3%AlexNet - INT8 - 8457.2%AlexNet - INT8 - 4444.7%GoogleNet - FP16 - 8335.9%AlexNet - FP16 - 8315.7%GoogleNet - FP16 - 32315.7%AlexNet - FP16 - 32302.5%GoogleNet - FP16 - 16293.6%AlexNet - FP16 - 16287.8%AlexNet - FP16 - 4206.1%VGG19 - INT8 - 322342.6%VGG16 - INT8 - 322164.5%VGG19 - INT8 - 162110.5%ResNet152 - INT8 - 322100.5%ResNet152 - INT8 - 162043.6%ResNet152 - INT8 - 81989.4%GoogleNet - FP16 - 4170.3%ResNet50 - INT8 - 321892.4%ResNet152 - INT8 - 41849.2%ResNet50 - INT8 - 161834.5%VGG16 - INT8 - 161760.1%VGG19 - INT8 - 81753.6%ResNet50 - INT8 - 81749.3%VGG19 - INT8 - 41693.2%ResNet50 - INT8 - 41617.5%VGG16 - INT8 - 81615.4%VGG16 - INT8 - 41494.2%GoogleNet - INT8 - 321147.7%GoogleNet - INT8 - 16972%NVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceNVIDIA TensorRT InferenceJetson AGX XavierJetson TX2

Jetson AGX Xavier vs. Jetson TX2 TensorRTglmark2: 1920 x 1080tensorrt-inference: VGG16 - FP16 - 4tensorrt-inference: VGG16 - FP16 - 8tensorrt-inference: VGG16 - INT8 - 4tensorrt-inference: VGG16 - INT8 - 8tensorrt-inference: VGG19 - FP16 - 4tensorrt-inference: VGG19 - FP16 - 8tensorrt-inference: VGG19 - INT8 - 4tensorrt-inference: VGG19 - INT8 - 8tensorrt-inference: VGG16 - FP16 - 16tensorrt-inference: VGG16 - FP16 - 32tensorrt-inference: VGG16 - INT8 - 16tensorrt-inference: VGG16 - INT8 - 32tensorrt-inference: VGG19 - FP16 - 16tensorrt-inference: VGG19 - FP16 - 32tensorrt-inference: VGG19 - INT8 - 16tensorrt-inference: VGG19 - INT8 - 32tensorrt-inference: AlexNet - FP16 - 4tensorrt-inference: AlexNet - FP16 - 8tensorrt-inference: AlexNet - INT8 - 4tensorrt-inference: AlexNet - INT8 - 8tensorrt-inference: AlexNet - FP16 - 16tensorrt-inference: AlexNet - FP16 - 32tensorrt-inference: AlexNet - INT8 - 16tensorrt-inference: AlexNet - INT8 - 32tensorrt-inference: ResNet50 - FP16 - 4tensorrt-inference: ResNet50 - FP16 - 8tensorrt-inference: ResNet50 - INT8 - 4tensorrt-inference: ResNet50 - INT8 - 8tensorrt-inference: GoogleNet - FP16 - 4tensorrt-inference: GoogleNet - FP16 - 8tensorrt-inference: GoogleNet - INT8 - 4tensorrt-inference: GoogleNet - INT8 - 8tensorrt-inference: ResNet152 - FP16 - 4tensorrt-inference: ResNet152 - FP16 - 8tensorrt-inference: ResNet152 - INT8 - 4tensorrt-inference: ResNet152 - INT8 - 8tensorrt-inference: ResNet50 - FP16 - 16tensorrt-inference: ResNet50 - FP16 - 32tensorrt-inference: ResNet50 - INT8 - 16tensorrt-inference: ResNet50 - INT8 - 32tensorrt-inference: GoogleNet - FP16 - 16tensorrt-inference: GoogleNet - FP16 - 32tensorrt-inference: GoogleNet - INT8 - 16tensorrt-inference: GoogleNet - INT8 - 32tensorrt-inference: ResNet152 - FP16 - 16tensorrt-inference: ResNet152 - FP16 - 32tensorrt-inference: ResNet152 - INT8 - 16tensorrt-inference: ResNet152 - INT8 - 32Jetson AGX XavierJetson TX22861195.45215.68286.64341.20172.15184.43262.17296.94228.75246.76381.33449.96180.03201.53362.08390.57799124797512371435190018792666542.80582.36865.46944.465468636521049219.08234.84350.28407.015936131106.131184.5085895613401622224.60253.34445.22485.2232.3033.6817.9819.8926.4927.0214.6216.0236.4437.2420.5019.8728.9729.5716.3815.9926130017922237047225830793.6199.0550.3951.0720219811411735.6036.7117.9719.4810611057.1859.4521823012513040.1941.8720.7722.05OpenBenchmarking.org

GLmark2

This is a test of any system-installed GLMark2 OpenGL benchmark. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgScore, More Is BetterGLmark2Resolution: 1920 x 1080Jetson AGX Xavier60012001800240030002861

NVIDIA TensorRT Inference

This test profile uses any existing system installation of NVIDIA TensorRT for carrying out inference benchmarks with various neural networks. Learn more via the OpenBenchmarking.org test page.

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier4080120160200SE +/- 0.30, N = 3SE +/- 3.17, N = 1232.30195.45
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier4080120160200Min: 31.91 / Avg: 32.3 / Max: 32.88Min: 173.05 / Avg: 195.45 / Max: 206.28

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier50100150200250SE +/- 0.24, N = 3SE +/- 3.36, N = 533.68215.68
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier4080120160200Min: 33.34 / Avg: 33.68 / Max: 34.15Min: 206.9 / Avg: 215.68 / Max: 221.59

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier60120180240300SE +/- 0.06, N = 3SE +/- 3.98, N = 317.98286.64
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier50100150200250Min: 17.87 / Avg: 17.98 / Max: 18.04Min: 279.44 / Avg: 286.64 / Max: 293.2

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier70140210280350SE +/- 0.05, N = 3SE +/- 1.08, N = 319.89341.20
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier60120180240300Min: 19.81 / Avg: 19.89 / Max: 19.98Min: 339.16 / Avg: 341.2 / Max: 342.86

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier4080120160200SE +/- 0.15, N = 3SE +/- 1.25, N = 326.49172.15
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier306090120150Min: 26.3 / Avg: 26.49 / Max: 26.78Min: 169.81 / Avg: 172.15 / Max: 174.08

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier4080120160200SE +/- 0.14, N = 3SE +/- 2.36, N = 327.02184.43
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier306090120150Min: 26.81 / Avg: 27.02 / Max: 27.27Min: 179.89 / Avg: 184.43 / Max: 187.82

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier60120180240300SE +/- 0.10, N = 3SE +/- 0.96, N = 314.62262.17
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier50100150200250Min: 14.43 / Avg: 14.62 / Max: 14.74Min: 260.34 / Avg: 262.17 / Max: 263.59

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier60120180240300SE +/- 0.06, N = 3SE +/- 1.42, N = 316.02296.94
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier50100150200250Min: 15.92 / Avg: 16.02 / Max: 16.12Min: 294.43 / Avg: 296.94 / Max: 299.32

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier50100150200250SE +/- 0.11, N = 3SE +/- 1.63, N = 336.44228.75
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier4080120160200Min: 36.28 / Avg: 36.44 / Max: 36.64Min: 226.25 / Avg: 228.75 / Max: 231.82

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier50100150200250SE +/- 0.14, N = 3SE +/- 0.17, N = 337.24246.76
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier4080120160200Min: 36.97 / Avg: 37.24 / Max: 37.44Min: 246.55 / Avg: 246.76 / Max: 247.1

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier80160240320400SE +/- 0.03, N = 3SE +/- 10.09, N = 1220.50381.33
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier70140210280350Min: 20.47 / Avg: 20.5 / Max: 20.55Min: 332.54 / Avg: 381.33 / Max: 432.87

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier100200300400500SE +/- 0.03, N = 3SE +/- 4.97, N = 1019.87449.96
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG16 - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier80160240320400Min: 19.81 / Avg: 19.87 / Max: 19.9Min: 434.03 / Avg: 449.96 / Max: 475

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier4080120160200SE +/- 0.11, N = 3SE +/- 11.67, N = 1028.97180.03
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier306090120150Min: 28.77 / Avg: 28.97 / Max: 29.15Min: 75.48 / Avg: 180.03 / Max: 194.77

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier4080120160200SE +/- 0.09, N = 3SE +/- 1.68, N = 329.57201.53
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier4080120160200Min: 29.41 / Avg: 29.57 / Max: 29.72Min: 198.31 / Avg: 201.53 / Max: 204

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier80160240320400SE +/- 0.02, N = 3SE +/- 0.66, N = 316.38362.08
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier60120180240300Min: 16.35 / Avg: 16.38 / Max: 16.41Min: 361.25 / Avg: 362.08 / Max: 363.39

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier80160240320400SE +/- 0.03, N = 3SE +/- 1.67, N = 315.99390.57
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: VGG19 - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier70140210280350Min: 15.92 / Avg: 15.99 / Max: 16.03Min: 387.49 / Avg: 390.57 / Max: 393.24

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier2004006008001000SE +/- 5.89, N = 12SE +/- 97.79, N = 9261799
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier140280420560700Min: 219.22 / Avg: 260.61 / Max: 290.22Min: 101.61 / Avg: 799.42 / Max: 1096.96

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier30060090012001500SE +/- 7.60, N = 12SE +/- 45.66, N = 123001247
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier2004006008001000Min: 240.39 / Avg: 299.97 / Max: 339.85Min: 1029.36 / Avg: 1246.7 / Max: 1506.02

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier2004006008001000SE +/- 2.69, N = 4SE +/- 55.83, N = 12179975
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier2004006008001000Min: 175.03 / Avg: 179.23 / Max: 187.04Min: 549.61 / Avg: 975.18 / Max: 1119.83

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier30060090012001500SE +/- 3.23, N = 3SE +/- 99.61, N = 122221237
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier2004006008001000Min: 216.23 / Avg: 222.19 / Max: 227.35Min: 369.21 / Avg: 1236.73 / Max: 1638.77

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier30060090012001500SE +/- 6.40, N = 12SE +/- 89.56, N = 93701435
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier30060090012001500Min: 343.41 / Avg: 369.6 / Max: 408.09Min: 756.73 / Avg: 1434.82 / Max: 1618.24

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier400800120016002000SE +/- 6.74, N = 3SE +/- 23.33, N = 34721900
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier30060090012001500Min: 458.81 / Avg: 471.89 / Max: 481.26Min: 1859.02 / Avg: 1900.36 / Max: 1939.78

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier400800120016002000SE +/- 3.45, N = 3SE +/- 91.41, N = 122581879
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier30060090012001500Min: 254.12 / Avg: 258.35 / Max: 265.18Min: 1391.55 / Avg: 1879.49 / Max: 2256.73

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier6001200180024003000SE +/- 0.88, N = 3SE +/- 248.85, N = 93072666
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: AlexNet - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier5001000150020002500Min: 305.06 / Avg: 306.54 / Max: 308.11Min: 734.1 / Avg: 2665.62 / Max: 3136.33

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier120240360480600SE +/- 1.46, N = 3SE +/- 0.39, N = 393.61542.80
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier100200300400500Min: 91.46 / Avg: 93.61 / Max: 96.39Min: 542.02 / Avg: 542.8 / Max: 543.2

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier130260390520650SE +/- 1.23, N = 3SE +/- 0.24, N = 399.05582.36
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier100200300400500Min: 97.75 / Avg: 99.05 / Max: 101.5Min: 582.04 / Avg: 582.36 / Max: 582.82

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier2004006008001000SE +/- 0.64, N = 3SE +/- 14.20, N = 350.39865.46
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier150300450600750Min: 49.13 / Avg: 50.39 / Max: 51.21Min: 837.1 / Avg: 865.46 / Max: 881.04

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier2004006008001000SE +/- 0.54, N = 3SE +/- 40.28, N = 1251.07944.46
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier170340510680850Min: 50.27 / Avg: 51.07 / Max: 52.1Min: 529.43 / Avg: 944.46 / Max: 1047.41

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier120240360480600SE +/- 0.88, N = 3SE +/- 96.56, N = 9202546
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier100200300400500Min: 200.64 / Avg: 201.65 / Max: 203.41Min: 66.78 / Avg: 546.1 / Max: 789.2

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier2004006008001000SE +/- 3.70, N = 3SE +/- 14.25, N = 12198863
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier150300450600750Min: 191.3 / Avg: 197.75 / Max: 204.1Min: 779.18 / Avg: 863.23 / Max: 909.77

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier140280420560700SE +/- 2.00, N = 3SE +/- 140.60, N = 12114652
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier110220330440550Min: 109.96 / Avg: 113.93 / Max: 116.36Min: 103.13 / Avg: 651.85 / Max: 1131.48

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier2004006008001000SE +/- 2.12, N = 3SE +/- 121.56, N = 101171049
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier2004006008001000Min: 114.11 / Avg: 117.06 / Max: 121.17Min: 126.9 / Avg: 1049.23 / Max: 1368.3

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier50100150200250SE +/- 0.44, N = 3SE +/- 3.18, N = 335.60219.08
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 4Jetson TX2Jetson AGX Xavier4080120160200Min: 34.73 / Avg: 35.6 / Max: 36.15Min: 213.19 / Avg: 219.08 / Max: 224.09

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier50100150200250SE +/- 0.67, N = 9SE +/- 0.36, N = 336.71234.84
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 8Jetson TX2Jetson AGX Xavier4080120160200Min: 33 / Avg: 36.71 / Max: 39.12Min: 234.16 / Avg: 234.84 / Max: 235.39

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier80160240320400SE +/- 0.19, N = 3SE +/- 5.48, N = 317.97350.28
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 4Jetson TX2Jetson AGX Xavier60120180240300Min: 17.62 / Avg: 17.97 / Max: 18.27Min: 340.79 / Avg: 350.28 / Max: 359.79

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier90180270360450SE +/- 0.27, N = 3SE +/- 6.98, N = 319.48407.01
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 8Jetson TX2Jetson AGX Xavier70140210280350Min: 19.1 / Avg: 19.48 / Max: 20.01Min: 393.46 / Avg: 407.01 / Max: 416.7

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier130260390520650SE +/- 0.59, N = 3SE +/- 7.03, N = 3106593
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier100200300400500Min: 105.09 / Avg: 106.27 / Max: 106.97Min: 579.4 / Avg: 593.33 / Max: 601.97

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier130260390520650SE +/- 1.29, N = 3SE +/- 9.12, N = 3110613
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier110220330440550Min: 107.91 / Avg: 110.48 / Max: 112.02Min: 603.57 / Avg: 613.05 / Max: 631.29

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier2004006008001000SE +/- 0.10, N = 3SE +/- 11.53, N = 1257.181106.13
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier2004006008001000Min: 57.06 / Avg: 57.18 / Max: 57.38Min: 998.56 / Avg: 1106.13 / Max: 1134.57

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier30060090012001500SE +/- 0.19, N = 3SE +/- 6.54, N = 359.451184.50
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet50 - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier2004006008001000Min: 59.1 / Avg: 59.45 / Max: 59.73Min: 1174.68 / Avg: 1184.5 / Max: 1196.9

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier2004006008001000SE +/- 3.60, N = 3SE +/- 55.00, N = 9218858
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier150300450600750Min: 212.49 / Avg: 217.69 / Max: 224.61Min: 433.13 / Avg: 857.89 / Max: 974.38

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier2004006008001000SE +/- 3.59, N = 3SE +/- 14.46, N = 12230956
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier2004006008001000Min: 223.99 / Avg: 230.17 / Max: 236.41Min: 887.88 / Avg: 955.66 / Max: 1006.48

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier30060090012001500SE +/- 1.16, N = 3SE +/- 152.29, N = 91251340
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier2004006008001000Min: 123.03 / Avg: 125.21 / Max: 127.01Min: 131.59 / Avg: 1339.83 / Max: 1571.88

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier30060090012001500SE +/- 0.91, N = 3SE +/- 5.04, N = 31301622
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: GoogleNet - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier30060090012001500Min: 128.46 / Avg: 130.27 / Max: 131.25Min: 1614.41 / Avg: 1622.46 / Max: 1631.75

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier50100150200250SE +/- 0.17, N = 3SE +/- 15.50, N = 940.19224.60
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 16Jetson TX2Jetson AGX Xavier4080120160200Min: 40.02 / Avg: 40.19 / Max: 40.53Min: 100.72 / Avg: 224.6 / Max: 242.03

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier60120180240300SE +/- 0.14, N = 3SE +/- 2.84, N = 341.87253.34
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: FP16 - Batch Size: 32Jetson TX2Jetson AGX Xavier50100150200250Min: 41.61 / Avg: 41.87 / Max: 42.1Min: 248.76 / Avg: 253.34 / Max: 258.53

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier100200300400500SE +/- 0.09, N = 3SE +/- 4.04, N = 320.77445.22
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 16Jetson TX2Jetson AGX Xavier80160240320400Min: 20.62 / Avg: 20.77 / Max: 20.93Min: 437.14 / Avg: 445.22 / Max: 449.46

OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier110220330440550SE +/- 0.03, N = 3SE +/- 1.47, N = 322.05485.22
OpenBenchmarking.orgImages Per Second, More Is BetterNVIDIA TensorRT InferenceNeural Network: ResNet152 - Precision: INT8 - Batch Size: 32Jetson TX2Jetson AGX Xavier90180270360450Min: 22.02 / Avg: 22.05 / Max: 22.12Min: 483.5 / Avg: 485.22 / Max: 488.15

Jetson AGX Xavier

Processor: ARMv8 rev 0 @ 2.27GHz (8 Cores), Motherboard: jetson-xavier, Memory: 16384MB, Disk: 31GB HBG4a2, Graphics: NVIDIA Tegra Xavier, Monitor: ASUS VP28U

OS: Ubuntu 18.04, Kernel: 4.9.108-tegra (aarch64), Desktop: Unity 7.5.0, Display Server: X Server 1.19.6, Display Driver: NVIDIA 31.0.2, OpenGL: 4.6.0, Vulkan: 1.1.76, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 1920x1080

Processor Notes: Scaling Governor: tegra_cpufreq schedutil

Testing initiated at 23 December 2018 16:20 by user system.

Jetson TX2

Processor: ARMv8 rev 3 @ 2.04GHz (4 Cores / 6 Threads), Motherboard: quill, Memory: 8192MB, Disk: 31GB 032G34, Graphics: NVIDIA Tegra X2, Monitor: VE228

OS: Ubuntu 16.04, Kernel: 4.4.38-tegra (aarch64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: NVIDIA 28.2.1, OpenGL: 4.5.0, Compiler: GCC 5.4.0 20160609 + CUDA 9.0, File-System: ext4, Screen Resolution: 1920x1080

Processor Notes: Scaling Governor: tegra_cpufreq schedutil

Testing initiated at 24 December 2018 11:20 by user NVIDIA.