MCP en toolaanroepen
berriai/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
★ 56,8K⑂ 10,8KPython
NOASSERTIONQ98
RAG en kennissystemen
milvus-io/milvus
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
★ 45,7K⑂ 4,2KGo
Apache-2.0Q98
Agents en multi-agents
elizaos/eliza
Open source agentic operating system
★ 19,1K⑂ 5,7KTypeScript
MITQ98
AI-programmeer- en ontwikkelaarstools
QwenLM/qwen-code
An open-source AI coding agent that lives in your terminal
★ 27,2K⑂ 2,9KTypeScript
Apache-2.0Q86
Agents en multi-agents
NVIDIA/NemoClaw
Run agents like Hermes, LangChain Deep Agents, and OpenClaw more securely inside NVIDIA OpenShell with managed inference
★ 22,2K⑂ 3KPython
Apache-2.0Q86
AI-programmeer- en ontwikkelaarstools
openai/codex
Lightweight coding agent that runs in your terminal
★ 107,1K⑂ 16,3KRust
Apache-2.0Q86
MCP en toolaanroepen
raullenchai/rapid-mlx
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
★ 3,5K⑂ 401Python
NOASSERTIONQ96
Inferentie, implementatie en runtime
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1,6K⑂ 172TypeScript
NOASSERTIONQ98
Inferentie, implementatie en runtime
sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
★ 32,2K⑂ 8,1KPython
Apache-2.0Q98
Fine-tuning, training en data
deepspeedai/deepspeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
★ 43K⑂ 4,9KPython
Apache-2.0Q94
Agents en multi-agents
ctxrs/ctx
Search the coding agent history already on your machine
★ 1K⑂ 61Rust
Apache-2.0Q90
Inferentie, implementatie en runtime
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 89,5K⑂ 21KPython
Apache-2.0Q98