ToolAI.io · GitHub Channel

Trending AI Projects on GitHub

Track active open-source AI repositories across LLM, agent, MCP, RAG and coding topics, with stars and verified project facts.

Public repository data

Project index

308 projects
Data Engineering & Pipelines

langextract

google/langextract

LLM-based structured extraction with source-text alignment and visualization for reviewable document processing.

★ 38.6K⑂ 2.7KPython
Apache-2.0Q90
LLM & Foundation Models

Outlines

dottxt-ai/outlines

A library for generating structured, constrained outputs from language models.

★ 15.9K⑂ 901Python
Apache-2.0Q84
Data Engineering & Pipelines

spaCy

explosion/spaCy

An engineering-oriented NLP pipeline library for tokenization, entities, syntax, and classification.

★ 33.9K⑂ 4.7KPython
MITQ90
MCP & Tool Calling

litellm

berriai/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

★ 56.8K⑂ 10.8KPython
NOASSERTIONQ98
RAG & Knowledge Systems

milvus

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

★ 45.7K⑂ 4.2KGo
Apache-2.0Q98
Agents & Multi-Agent

eliza

elizaos/eliza

Open source agentic operating system

★ 19.1K⑂ 5.7KTypeScript
MITQ98
MCP & Tool Calling

Rapid-MLX

raullenchai/rapid-mlx

The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.

★ 3.5K⑂ 401Python
NOASSERTIONQ96
Inference, Deployment & Runtime

llmgateway

theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

★ 1.6K⑂ 172TypeScript
NOASSERTIONQ98
Inference, Deployment & Runtime

sglang

sgl-project/sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

★ 32.2K⑂ 8.1KPython
Apache-2.0Q98

Page 7 / 26 · 308 projects

Recently updated

Craft Anythingstorytold/craft-anything★ 27.4K elephant-goldfish-modelgoogle/elephant-goldfish-model★ 15.6K DeepInferdeepseek-ai/DeepInfer★ 25.7K ComfyUIComfy-Org/ComfyUI★ 136.7K CrewAICrewAIInc/crewAI★ 59.5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K