推理、部署与运行时

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 32.1K星级
⑂ 8KFork 数
4869未解决的问题
Python语言
Apache-2.0许可证
Q@project.QualityScore编辑评分

概览

SGLang is a high-performance serving framework for large language models and multimodal models.

要求、安装和快速入门

安装要求未在仓库元数据中说明。

用法

用法未在仓库元数据中注明。

模型兼容性与使用场景

仓库元数据未说明模型兼容性。

许可证与风险说明

Apache-2.0

ToolAI metadata-only listing: repository metadata is public; editorial content and manual verification are still pending.

vllm

vllm-project/vllm

★ 89.4KPython

OpenVINO

openvinotoolkit/openvino

★ 10.6KC++

GPUStack

gpustack/gpustack

★ 5.4KPython