推理、部署与运行时

FastDeploy

PaddlePaddle/FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

★ 3.7K星级
⑂ 755Fork 数
697未解决的问题
Python语言
Apache-2.0许可证
Q98编辑评分

概览

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

要求、安装和快速入门

安装要求未在仓库元数据中说明。

用法

用法未在仓库元数据中注明。

模型兼容性与使用场景

仓库元数据未说明模型兼容性。

许可证与风险说明

Apache-2.0

ToolAI metadata-only listing: repository metadata is public; editorial content and manual verification are still pending. Quality score was recomputed from live GitHub repository facts on 2026-08-22 UTC using the seven-dimension channel formula.

vllm

vllm-project/vllm

★ 89.5KPython

sglang

sgl-project/sglang

★ 32.2KPython

OpenVINO

openvinotoolkit/openvino

★ 10.6KC++

GPUStack

gpustack/gpustack

★ 5.4KPython