推理、部署与运行时

TensorRT

NVIDIA/TensorRT

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

★ 13.2K星级
⑂ 2.4KFork 数
615未解决的问题
C++语言
Apache-2.0许可证
Q94编辑评分

概览

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

要求、安装和快速入门

安装要求未在仓库元数据中说明。

用法

用法未在仓库元数据中注明。

模型兼容性与使用场景

仓库元数据未说明模型兼容性。

许可证与风险说明

Apache-2.0

ToolAI metadata-only listing: repository metadata is public; editorial content and manual verification are still pending. Quality score was recomputed from live GitHub repository facts on 2026-08-22 UTC using the seven-dimension channel formula.

vllm

vllm-project/vllm

★ 89.5KPython

sglang

sgl-project/sglang

★ 32.2KPython

OpenVINO

openvinotoolkit/openvino

★ 10.6KC++

GPUStack

gpustack/gpustack

★ 5.4KPython