codekingpro/portable-devtools
114k
1=== NVIDIA TensorRT ===
2
3NVIDIA® TensorRT™ is a C++ library that facilitates high-performance inference
4on NVIDIA GPUs. TensorRT takes a trained network, which consists of a network
5definition and a set of trained parameters, and produces a highly optimized
6runtime engine that performs inference for that network. TensorRT provides APIs
7using C++ and Python that help to express deep learning models using the Network
8Definition API or load a pre-defined model using the parsers that allow TensorRT
9to optimize and run them on an NVIDIA GPU. TensorRT applies graph optimizations,
10layer fusion, among other optimizations, while also finding the fastest
11implementation of that model leveraging a diverse collection of highly optimized
12kernels. TensorRT also supplies a runtime that you can use to execute this
13network on NVIDIA’s GPUs.
14
15For more information about TensorRT, visit https://developer.nvidia.com/tensorrt.
16
17In previous TensorRT releases, PDF documentation was included inside the TensorRT
18package. The PDF documentation has been removed from the package in favor of
19online documentation, which is updated regularly. Online documentation can be
20found at https://docs.nvidia.com/deeplearning/tensorrt/latest/index.html.
21
22For details on TensorRT's license agreement, visit https://docs.nvidia.com/deeplearning/tensorrt/latest/reference/sla.html.
23
24=== References ===
25
26Quick Start Guide: https://docs.nvidia.com/deeplearning/tensorrt/latest/getting-started/quick-start-guide.html
27Release Notes: https://docs.nvidia.com/deeplearning/tensorrt/latest/getting-started/release-notes.html
28Support Matrix: https://docs.nvidia.com/deeplearning/tensorrt/latest/getting-started/support-matrix.html
29Installation Guide: https://docs.nvidia.com/deeplearning/tensorrt/latest/installing-tensorrt/overview.html
30C++ API: https://docs.nvidia.com/deeplearning/tensorrt/latest/inference-library/c-api-docs.html
31Python API: https://docs.nvidia.com/deeplearning/tensorrt/latest/inference-library/python-api-docs.html
32 