Inference, Deployment & Runtime

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 32.2KStars
⑂ 8.1KForks
4927Open issues
PythonLanguage
Apache-2.0License
Q98Editorial score

Overview

SGLang is a high-performance serving framework for large language models and multimodal models.

Requirements, installation and quick start

Installation requirements are not stated in the repository metadata.

Usage

Usage is not stated in the repository metadata.

Model compatibility and use cases

Model compatibility is not stated in the repository metadata.

License and risk notes

Apache-2.0

ToolAI metadata-only listing: repository metadata is public; editorial content and manual verification are still pending.

vllm

vllm-project/vllm

★ 89.5KPython

OpenVINO

openvinotoolkit/openvino

★ 10.6KC++

GPUStack

gpustack/gpustack

★ 5.4KPython

FastDeploy

PaddlePaddle/FastDeploy

★ 3.7KPython