NVIDIA Jetson AGX Xavier vs. TX2 Thermal + Power Jetson AGX Xavier thermal and power consumption benchmarking for a future article on Phoronix by Michael Larabel. Jetson AGX Xavier: Processor: ARMv8 rev 0 @ 2.27GHz (8 Cores), Motherboard: jetson-xavier, Memory: 16384MB, Disk: 31GB HBG4a2, Graphics: NVIDIA Tegra Xavier, Monitor: ASUS VP28U OS: Ubuntu 18.04, Kernel: 4.9.108-tegra (aarch64), Desktop: Unity 7.5.0, Display Server: X Server 1.19.6, Display Driver: NVIDIA 31.0.2, OpenGL: 4.6.0, Vulkan: 1.1.76, Compiler: GCC 7.3.0 + CUDA 10.0, File-System: ext4, Screen Resolution: 3840x2160 Jetson TX2: Processor: ARMv8 rev 3 @ 2.04GHz (4 Cores / 6 Threads), Motherboard: quill, Memory: 8192MB, Disk: 31GB 032G34, Graphics: NVIDIA Tegra X2, Monitor: ASUS VP28U OS: Ubuntu 16.04, Kernel: 4.4.38-tegra (aarch64), Desktop: Unity 7.4.0, Display Server: X Server 1.18.4, Display Driver: NVIDIA 28.2.1, OpenGL: 4.5.0, Compiler: GCC 5.4.0 20160609 + CUDA 9.0, File-System: ext4, Screen Resolution: 3840x2160 NVIDIA TensorRT Inference Neural Network: AlexNet - Precision: INT8 - Batch Size: 32 - DLA Cores: Disabled Images Per Second > Higher Is Better Jetson AGX Xavier . 2981 |===================================================== Jetson TX2 ........ 306 |===== NVIDIA TensorRT Inference Neural Network: AlexNet - Precision: INT8 - Batch Size: 32 - DLA Cores: Disabled Images Per Second Per Watt > Higher Is Better Jetson AGX Xavier . 193.71 |=================================================== Jetson TX2 ........ 33.98 |========= NVIDIA TensorRT Inference System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 11.6 AVG: 15.4 MAX: 19.8 Jetson TX2 ........ MIN: 5.7 AVG: 9.0 MAX: 16.4 NVIDIA TensorRT Inference System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 36.0 AVG: 37.7 MAX: 39.0 Jetson TX2 ........ MIN: 43.0 AVG: 45.7 MAX: 49.0 NVIDIA TensorRT Inference Neural Network: AlexNet - Precision: FP16 - Batch Size: 32 - DLA Cores: Disabled Images Per Second > Higher Is Better Jetson AGX Xavier . 1981 |===================================================== Jetson TX2 ........ 468 |============= NVIDIA TensorRT Inference Neural Network: AlexNet - Precision: FP16 - Batch Size: 32 - DLA Cores: Disabled Images Per Second Per Watt > Higher Is Better Jetson AGX Xavier . 113.88 |=================================================== Jetson TX2 ........ 53.46 |======================== NVIDIA TensorRT Inference System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.2 AVG: 17.4 MAX: 26.5 Jetson TX2 ........ MIN: 5.9 AVG: 8.8 MAX: 15.1 NVIDIA TensorRT Inference System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 38.0 AVG: 39.8 MAX: 41.0 Jetson TX2 ........ MIN: 47.0 AVG: 47.6 MAX: 49.0 NVIDIA TensorRT Inference Neural Network: GoogleNet - Precision: INT8 - Batch Size: 32 - DLA Cores: Disabled Images Per Second > Higher Is Better Jetson AGX Xavier . 1627 |===================================================== Jetson TX2 ........ 132 |==== NVIDIA TensorRT Inference Neural Network: GoogleNet - Precision: INT8 - Batch Size: 32 - DLA Cores: Disabled Images Per Second Per Watt > Higher Is Better Jetson AGX Xavier . 105.85 |=================================================== Jetson TX2 ........ 13.66 |======= NVIDIA TensorRT Inference System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 11.8 AVG: 15.4 MAX: 38.9 Jetson TX2 ........ MIN: 5.3 AVG: 9.7 MAX: 16.0 NVIDIA TensorRT Inference System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 39.0 AVG: 41.5 MAX: 43.5 Jetson TX2 ........ MIN: 46.5 AVG: 48.7 MAX: 52.0 NVIDIA TensorRT Inference Neural Network: GoogleNet - Precision: FP16 - Batch Size: 32 - DLA Cores: Disabled Images Per Second > Higher Is Better Jetson AGX Xavier . 890 |====================================================== Jetson TX2 ........ 229 |============== NVIDIA TensorRT Inference Neural Network: GoogleNet - Precision: FP16 - Batch Size: 32 - DLA Cores: Disabled Images Per Second Per Watt > Higher Is Better Jetson AGX Xavier . 53.02 |==================================================== Jetson TX2 ........ 23.97 |======================== NVIDIA TensorRT Inference System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.0 AVG: 16.8 MAX: 42.7 Jetson TX2 ........ MIN: 6.0 AVG: 9.6 MAX: 15.4 NVIDIA TensorRT Inference System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 42.5 AVG: 44.5 MAX: 46.5 Jetson TX2 ........ MIN: 48.5 AVG: 50.2 MAX: 52.5 NVIDIA TensorRT Inference Neural Network: VGG16 - Precision: INT8 - Batch Size: 32 - DLA Cores: Disabled Images Per Second > Higher Is Better Jetson AGX Xavier . 446.00 |=================================================== Jetson TX2 ........ 19.59 |== NVIDIA TensorRT Inference Neural Network: VGG16 - Precision: INT8 - Batch Size: 32 - DLA Cores: Disabled Images Per Second Per Watt > Higher Is Better Jetson AGX Xavier . 18.55 |==================================================== Jetson TX2 ........ 1.42 |==== NVIDIA TensorRT Inference System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.6 AVG: 24.1 MAX: 43.9 Jetson TX2 ........ MIN: 5.6 AVG: 13.8 MAX: 17.5 NVIDIA TensorRT Inference System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 44.5 AVG: 47.3 MAX: 50.5 Jetson TX2 ........ MIN: 49.5 AVG: 56.2 MAX: 61.0 NVIDIA TensorRT Inference Neural Network: VGG16 - Precision: FP16 - Batch Size: 32 - DLA Cores: Disabled Images Per Second > Higher Is Better Jetson AGX Xavier . 247.00 |=================================================== Jetson TX2 ........ 36.72 |======== NVIDIA TensorRT Inference Neural Network: VGG16 - Precision: FP16 - Batch Size: 32 - DLA Cores: Disabled Images Per Second Per Watt > Higher Is Better Jetson AGX Xavier . 9.60 |===================================================== Jetson TX2 ........ 2.99 |================= NVIDIA TensorRT Inference System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 11.9 AVG: 25.7 MAX: 47.1 Jetson TX2 ........ MIN: 5.8 AVG: 12.3 MAX: 16.4 NVIDIA TensorRT Inference System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 42.5 AVG: 45.4 MAX: 48.0 Jetson TX2 ........ MIN: 52.5 AVG: 56.5 MAX: 60.0 C-Ray 1.1 Total Time - 4K, 16 Rays Per Pixel Seconds < Lower Is Better Jetson AGX Xavier . 168 |============== Jetson TX2 ........ 656 |====================================================== C-Ray 1.1 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 11.8 AVG: 25.9 MAX: 26.4 Jetson TX2 ........ MIN: 6.5 AVG: 9.1 MAX: 9.4 C-Ray 1.1 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 46.5 AVG: 48.6 MAX: 49.0 Jetson TX2 ........ MIN: 52.0 AVG: 53.9 MAX: 59.0 LAME MP3 Encoding 3.100 WAV To MP3 Seconds < Lower Is Better Jetson AGX Xavier . 35.47 |=================== Jetson TX2 ........ 95.98 |==================================================== LAME MP3 Encoding 3.100 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.8 AVG: 15.3 MAX: 15.7 Jetson TX2 ........ MIN: 5.7 AVG: 7.0 MAX: 7.1 LAME MP3 Encoding 3.100 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 40.5 AVG: 41.2 MAX: 42.0 Jetson TX2 ........ MIN: 48.0 AVG: 49.4 MAX: 51.0 FLAC Audio Encoding 1.3.2 WAV To FLAC Seconds < Lower Is Better Jetson AGX Xavier . 55.16 |============================================ Jetson TX2 ........ 65.33 |==================================================== FLAC Audio Encoding 1.3.2 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.2 AVG: 15.4 MAX: 15.7 Jetson TX2 ........ MIN: 5.4 AVG: 7.1 MAX: 7.2 FLAC Audio Encoding 1.3.2 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 36.5 AVG: 38.7 MAX: 40.5 Jetson TX2 ........ MIN: 46.0 AVG: 47.3 MAX: 48.0 PHPBench 0.8.1 PHP Benchmark Suite Score > Higher Is Better Jetson AGX Xavier . 189005 |=================================================== Jetson TX2 ........ 133638 |==================================== PHPBench 0.8.1 PHP Benchmark Suite Score Per Watt > Higher Is Better Jetson AGX Xavier . 12317.18 |================================ Jetson TX2 ........ 19097.64 |================================================= PHPBench 0.8.1 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 11.7 AVG: 15.3 MAX: 15.7 Jetson TX2 ........ MIN: 5.3 AVG: 7.0 MAX: 7.2 PHPBench 0.8.1 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 36.5 AVG: 37.2 MAX: 38.0 Jetson TX2 ........ MIN: 45.5 AVG: 46.5 MAX: 47.0 PyBench 2018-02-16 Total For Average Test Times Milliseconds < Lower Is Better Jetson AGX Xavier . 3237 |================================ Jetson TX2 ........ 5365 |===================================================== PyBench 2018-02-16 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.8 AVG: 15.5 MAX: 15.7 Jetson TX2 ........ MIN: 5.5 AVG: 7.0 MAX: 7.2 PyBench 2018-02-16 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 35.5 AVG: 36.5 MAX: 37.5 Jetson TX2 ........ MIN: 44.5 AVG: 45.7 MAX: 46.5 Timed Linux Kernel Compilation 4.18 Time To Compile Seconds < Lower Is Better Jetson AGX Xavier . 789 |=========================== Jetson TX2 ........ 1552 |===================================================== Timed Linux Kernel Compilation 4.18 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.0 AVG: 23.9 MAX: 25.0 Jetson TX2 ........ MIN: 5.5 AVG: 8.9 MAX: 9.3 Timed Linux Kernel Compilation 4.18 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 35.5 AVG: 45.1 MAX: 47.0 Jetson TX2 ........ MIN: 43.5 AVG: 50.7 MAX: 52.0 SQLite 3.22 Timed SQLite Insertions Seconds < Lower Is Better Jetson AGX Xavier . 78.65 |================================= Jetson TX2 ........ 122.14 |=================================================== SQLite 3.22 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.0 AVG: 13.0 MAX: 13.4 Jetson TX2 ........ MIN: 5.2 AVG: 5.3 MAX: 5.4 SQLite 3.22 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 35.5 AVG: 36.9 MAX: 38.5 Jetson TX2 ........ MIN: 42.0 AVG: 44.3 MAX: 47.0 asmFish 2018-07-23 1024 Hash Memory, 26 Depth Nodes/second > Higher Is Better Jetson AGX Xavier . 8193464 |================================================== Jetson TX2 ........ 2928565 |================== asmFish 2018-07-23 1024 Hash Memory, 26 Depth Nodes/second Per Watt > Higher Is Better Jetson AGX Xavier . 322296.99 |================================================ Jetson TX2 ........ 322497.70 |================================================ asmFish 2018-07-23 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 11.6 AVG: 25.4 MAX: 25.8 Jetson TX2 ........ MIN: 8.1 AVG: 9.1 MAX: 9.3 asmFish 2018-07-23 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 34.5 AVG: 45.9 MAX: 47.5 Jetson TX2 ........ MIN: 45.0 AVG: 50.3 MAX: 52.0 XZ Compression 5.2.4 Compressing ubuntu-16.04.3-server-i386.img, Compression Level 9 Seconds < Lower Is Better Jetson AGX Xavier . 147 |========================= Jetson TX2 ........ 318 |====================================================== XZ Compression 5.2.4 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.4 AVG: 19.0 MAX: 21.7 Jetson TX2 ........ MIN: 5.7 AVG: 8.7 MAX: 8.9 XZ Compression 5.2.4 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 39.5 AVG: 41.6 MAX: 44.0 Jetson TX2 ........ MIN: 48.0 AVG: 50.1 MAX: 50.5 Git Time To Complete Common Git Commands Seconds < Lower Is Better Jetson AGX Xavier . 12.53 |==================================== Jetson TX2 ........ 17.87 |==================================================== Git System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 11.5 AVG: 14.6 MAX: 15.6 Jetson TX2 ........ MIN: 5.6 AVG: 6.7 MAX: 7.2 Git System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 37.0 AVG: 38.1 MAX: 39.0 Jetson TX2 ........ MIN: 48.0 AVG: 48.2 MAX: 49.0 Himeno Benchmark 3.0 Poisson Pressure Solver MFLOPS > Higher Is Better Jetson AGX Xavier . 277 |====================================================== Jetson TX2 ........ 245 |================================================ Himeno Benchmark 3.0 Poisson Pressure Solver MFLOPS Per Watt > Higher Is Better Jetson AGX Xavier . 19.05 |============================ Jetson TX2 ........ 34.98 |==================================================== Himeno Benchmark 3.0 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.4 AVG: 14.6 MAX: 14.9 Jetson TX2 ........ MIN: 5.5 AVG: 7.0 MAX: 7.2 Himeno Benchmark 3.0 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 35.5 AVG: 36.4 MAX: 37.0 Jetson TX2 ........ MIN: 46.5 AVG: 47.4 MAX: 48.0 OpenSSL 1.1.1 RSA 4096-bit Performance Signs Per Second > Higher Is Better Jetson AGX Xavier . 573 |====================================================== Jetson TX2 ........ 127 |============ OpenSSL 1.1.1 RSA 4096-bit Performance Signs Per Second Per Watt > Higher Is Better Jetson AGX Xavier . 26.17 |==================================================== Jetson TX2 ........ 16.38 |================================= OpenSSL 1.1.1 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.4 AVG: 21.9 MAX: 24.0 Jetson TX2 ........ MIN: 5.4 AVG: 7.8 MAX: 8.3 OpenSSL 1.1.1 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 34.5 AVG: 40.0 MAX: 41.5 Jetson TX2 ........ MIN: 47.0 AVG: 48.0 MAX: 48.5 Scikit-Learn 0.17.1 Seconds < Lower Is Better Jetson AGX Xavier . 225 |====================================================== Jetson TX2 ........ 174 |========================================== Scikit-Learn 0.17.1 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 11.8 AVG: 16.0 MAX: 16.3 Jetson TX2 ........ MIN: 5.6 AVG: 7.1 MAX: 7.2 Scikit-Learn 0.17.1 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 35.0 AVG: 36.6 MAX: 37.5 Jetson TX2 ........ MIN: 45.5 AVG: 46.3 MAX: 47.0 Darktable 2.4.2 Test: Boat - Acceleration: CPU-only Seconds < Lower Is Better Jetson AGX Xavier . 28.17 |==================================================== Darktable System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 11.8 AVG: 24.6 MAX: 30.7 Darktable System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 35.5 AVG: 41.9 MAX: 44.5 TSCP 1.81 AI Chess Performance Nodes Per Second > Higher Is Better Jetson AGX Xavier . 660267 |=================================================== Jetson TX2 ........ 367088 |============================ TSCP 1.81 AI Chess Performance Nodes Per Second Per Watt > Higher Is Better Jetson AGX Xavier . 48371.21 |======================================= Jetson TX2 ........ 60776.16 |================================================= TSCP 1.81 System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.4 AVG: 13.7 MAX: 14.3 Jetson TX2 ........ MIN: 5.2 AVG: 6.0 MAX: 6.4 TSCP 1.81 System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 37.0 AVG: 37.3 MAX: 37.5 Jetson TX2 ........ MIN: 44.0 AVG: 44.3 MAX: 44.5 Rust Prime Benchmark Prime Number Test To 200,000,000 Seconds < Lower Is Better Jetson AGX Xavier . 32.50 |=============== Jetson TX2 ........ 107.39 |=================================================== Rust Prime Benchmark System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 12.8 AVG: 18.6 MAX: 19.4 Jetson TX2 ........ MIN: 5.3 AVG: 7.5 MAX: 7.7 Rust Prime Benchmark System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 37.5 AVG: 38.5 MAX: 39.0 Jetson TX2 ........ MIN: 43.5 AVG: 45.7 MAX: 46.0 Rust Mandelbrot Time To Complete Serial/Parallel Mandelbrot Seconds < Lower Is Better Jetson AGX Xavier . 110 |======================== Jetson TX2 ........ 251 |====================================================== Rust Mandelbrot System Power Consumption Monitor Watts < Lower Is Better Jetson AGX Xavier . MIN: 13.3 AVG: 17.3 MAX: 21.8 Jetson TX2 ........ MIN: 5.6 AVG: 7.5 MAX: 8.3 Rust Mandelbrot System Temperature Monitor Celsius < Lower Is Better Jetson AGX Xavier . MIN: 35.5 AVG: 37.5 MAX: 40.0 Jetson TX2 ........ MIN: 44.5 AVG: 46.3 MAX: 47.5 Meta Performance Per Watt Performance Per Watt Performance Per Watt > Higher Is Better Jetson AGX Xavier . 822887.13 |================================================ Jetson TX2 ........ 311895.90 |================== System Power Consumption Monitor Phoronix Test Suite System Monitoring Watts Jetson AGX Xavier . MIN: 11.5 AVG: 20.7 MAX: 47.1 Jetson TX2 ........ MIN: 5.1 AVG: 9.0 MAX: 17.5 System Temperature Monitor Phoronix Test Suite System Monitoring Celsius Jetson AGX Xavier . MIN: 34.0 AVG: 42.5 MAX: 50.5 Jetson TX2 ........ MIN: 42.0 AVG: 50.5 MAX: 61.0