MCP & Tool Calling

litellm

berriai/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

★ 56.7KStars
⑂ 10.7KForks
4959Open issues
PythonLanguage
NOASSERTIONLicense
Q@project.QualityScoreEditorial score

Overview

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Requirements, installation and quick start

Installation requirements are not stated in the repository metadata.

Usage

Usage is not stated in the repository metadata.

Model compatibility and use cases

Model compatibility is not stated in the repository metadata.

License and risk notes

NOASSERTION

ToolAI metadata-only listing: repository metadata is public; editorial content and manual verification are still pending.

MemPalace

mempalace/mempalace

★ 58KPython

QwenPaw

agentscope-ai/qwenpaw

★ 33.9KPython

Composio

composiohq/composio

★ 29.5KTypeScript