MCP & Tool-Aufrufe
berriai/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
★ 56,8K⑂ 10,8KPython
NOASSERTIONQ98
RAG & Wissenssysteme
milvus-io/milvus
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
★ 45,7K⑂ 4,2KGo
Apache-2.0Q98
Agenten & Multi-Agenten
elizaos/eliza
Open source agentic operating system
★ 19,1K⑂ 5,7KTypeScript
MITQ98
AI-Programmierung & Entwicklertools
QwenLM/qwen-code
An open-source AI coding agent that lives in your terminal
★ 27,2K⑂ 2,9KTypeScript
Apache-2.0Q86
Agenten & Multi-Agenten
NVIDIA/NemoClaw
Run agents like Hermes, LangChain Deep Agents, and OpenClaw more securely inside NVIDIA OpenShell with managed inference
★ 22,2K⑂ 3KPython
Apache-2.0Q86
AI-Programmierung & Entwicklertools
openai/codex
Lightweight coding agent that runs in your terminal
★ 107,1K⑂ 16,3KRust
Apache-2.0Q86
MCP & Tool-Aufrufe
raullenchai/rapid-mlx
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
★ 3,5K⑂ 401Python
NOASSERTIONQ96
Inferenz, Bereitstellung & Laufzeit
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1,6K⑂ 172TypeScript
NOASSERTIONQ98
Inferenz, Bereitstellung & Laufzeit
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 32,2K⑂ 8,1KPython
Apache-2.0Q98
Feinabstimmung, Training & Daten
deepspeedai/deepspeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
★ 43K⑂ 4,9KPython
Apache-2.0Q94
Agenten & Multi-Agenten
ctxrs/ctx
Search the coding agent history already on your machine
★ 1K⑂ 61Rust
Apache-2.0Q90
Inferenz, Bereitstellung & Laufzeit
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 89,5K⑂ 21KPython
Apache-2.0Q98