推理、部署与运行时

llmgateway

theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

★ 1.6K星级
⑂ 172Fork 数
66未解决的问题
TypeScript语言
NOASSERTION许可证
Q98编辑评分

概览

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

要求、安装和快速入门

安装要求未在仓库元数据中说明。

用法

用法未在仓库元数据中注明。

模型兼容性与使用场景

仓库元数据未说明模型兼容性。

许可证与风险说明

NOASSERTION

ToolAI metadata-only listing: repository metadata is public; editorial content and manual verification are still pending.

vllm

vllm-project/vllm

★ 89.5KPython

sglang

sgl-project/sglang

★ 32.2KPython

OpenVINO

openvinotoolkit/openvino

★ 10.6KC++

GPUStack

gpustack/gpustack

★ 5.4KPython