pytorch 的 TensorRT 和 NVIDIA 的 TensorRT 是什么关系？

Question

我想使用 tensorRT 加速 pytorch 的 resnet50 网络的推理速度，但是我看到了和 tensorRT 相关的项目有两个：

• https://github.com/pytorch/TensorRT
• https://github.com/NVIDIA/TensorRT

我该用哪个?

Answer 1

pytorch/TensorRT。

pytorch/TensorRT 可以把 pytorch/TorchScript 编译成可以用于 TensorRT 推理的形式。

Torch-TensorRT is a compiler for PyTorch/TorchScript/FX, targeting NVIDIA GPUs via NVIDIA's TensorRT Deep Learning Optimizer and Runtime.

NVIDIA/TensorRT 应该是 NVIDIA 的一些 TensorRT 工具。

This repository contains the Open Source Software (OSS) components of NVIDIA TensorRT. It includes the sources for TensorRT plugins and parsers (Caffe and ONNX), as well as sample applications demonstrating usage and capabilities of the TensorRT platform. These open source software components are a subset of the TensorRT General Availability (GA) release with some extensions and bug-fixes.