ToolAI.io · GitHub Channel

Trending AI Projects on GitHub

Track active open-source AI repositories across LLM, agent, MCP, RAG and coding topics, with stars and verified project facts.

Public repository data

Project index

76 projects
MCP & Tool Calling

litellm

berriai/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

★ 56.8K⑂ 10.8KPython
NOASSERTIONQ98
Screenshot of TensorRT-LLM — Optimized LLM inference
Inference, Deployment & Runtime

TensorRT-LLM — Optimized LLM inference

NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way

★ 14.4K⑂ 2.7KC++
NOASSERTIONQ82
Screenshot of Alith
Agents & Multi-Agent

Alith

0xlazai/alith

A simple, composable, and high-performance AI agent framework designed for Web3 and Crypto, enabling developers to build, deploy, and manage on-chain AI agents with multi-language support and LazAI Gateway integration.

★ 44⑂ 31Rust
Apache-2.0Q88
Screenshot of LLMix
Agents & Multi-Agent

LLMix

sno-ai/llmix

A production LLM call layer for AI agents and tools that wraps existing provider SDKs with config-driven model presets, caching, resilience patterns, and key rotation across Python, TypeScript, and Rust.

★ 131⑂ 28Python
Apache-2.0Q91
Screenshot of STACKIT RAG Template
RAG & Knowledge Systems

STACKIT RAG Template

stackitcloud/rag-template

A template for building AI chatbots and document management systems using Retrieval-Augmented Generation (RAG), vector search, and FastAPI, designed for deployment on Kubernetes.

★ 86⑂ 10Python
Apache-2.0Q89
Screenshot of SkillOpt — Skill optimization for agents
Agents & Multi-Agent

SkillOpt — Skill optimization for agents

microsoft/SkillOpt

SkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits, validation-gated updates, and deployable best_skill.md artifacts

★ 16.2K⑂ 1.5KPython
MITQ86
Screenshot of Pydantic AI
Agents & Multi-Agent

Pydantic AI

pydantic/pydantic-ai

A Python agent framework designed to help developers build production-grade applications and workflows with Generative AI, emphasizing type-safety, structured validation, and ergonomic design.

★ 19.1K⑂ 2.5KPython
MITQ98

Page 3 / 7 · 76 projects

Recently updated

Craft Anythingstorytold/craft-anything★ 27.4K elephant-goldfish-modelgoogle/elephant-goldfish-model★ 15.6K DeepInferdeepseek-ai/DeepInfer★ 25.7K ComfyUIComfy-Org/ComfyUI★ 136.7K CrewAICrewAIInc/crewAI★ 59.5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K