ToolAI.io · GitHub Channel

Trending AI Projects on GitHub

Track active open-source AI repositories across LLM, agent, MCP, RAG and coding topics, with stars and verified project facts.

Public repository data

Project index

295 projects
Fine-tuning, Training & Data

DeepSpeed

deepspeedai/deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

★ 43K⑂ 4.9KPython
Apache-2.0Q94
Agents & Multi-Agent

ctx

ctxrs/ctx

Search the coding agent history already on your machine

★ 1K⑂ 61Rust
Apache-2.0Q90
Inference, Deployment & Runtime

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 89.5K⑂ 21KPython
Apache-2.0Q98
Agents & Multi-Agent

CodeWhale

hmbown/codewhale

Open-source, community-driven agent harness

★ 40.8K⑂ 3.5KRust
MITQ92
Agents & Multi-Agent

matrixone

matrixorigin/matrixone

AI-native HTAP database with Git-for-Data and built-in vector search, serving as the data and memory backbone for intelligent agents and applications.

★ 1.9K⑂ 307Go
Apache-2.0Q94
Screenshot of 1flowbase
Agents & Multi-Agent

1flowbase

taichuy/1flowbase

An open-source AI gateway that allows local agent clients to publish fusion-style multi-model workflows as OpenAI and Claude-compatible virtual models, providing full observability into traces, tokens, latency, and costs.

★ 259⑂ 19Rust
Apache-2.0Q89
Screenshot of TensorRT-LLM — Optimized LLM inference
Inference, Deployment & Runtime

TensorRT-LLM — Optimized LLM inference

NVIDIA/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way

★ 14.4K⑂ 2.7KC++
NOASSERTIONQ82
Screenshot of hal0
Inference, Deployment & Runtime

hal0

hal0ai/hal0

An open-source, self-hosted home AI inference platform designed to turn a Linux box into an OpenAI-compatible inference appliance, with native optimization for AMD Strix Halo hardware.

★ 68⑂ 7Python
Apache-2.0Q89
Screenshot of DotCraft
Agents & Multi-Agent

DotCraft

dotharness/dotcraft

An open-source, self-hosted, project-scoped AI agent runtime that provides persistent sessions, memory, background work, and automations shared across Desktop, CLI, bots, and applications.

★ 386⑂ 16C#
Apache-2.0Q88
Screenshot of OrchestKit
MCP & Tool Calling

OrchestKit

yonatangross/orchestkit

A comprehensive AI development toolkit and Claude Code plugin providing production-ready patterns, specialized agents, and automated quality gates for full-stack development.

★ 223⑂ 22TypeScript
MITQ89
MCP & Tool Calling

ai-agent-book

bojieli/ai-agent-book

《深入理解 AI Agent:设计原理与工程实践》(李博杰 著)开源主仓库:全书正文、编译版 PDF 与按章配套代码

★ 40.2K⑂ 4.4KPython
Apache-2.0Q91

Page 7 / 25 · 295 projects

Recently updated

TypeSafe Python SDKtypesafe-ai/typesafe-sdk-python★ 218 TypeSafe JavaScript SDKtypesafe-ai/typesafe-sdk-js★ 231 TypeSafe Agent Skillstypesafe-ai/skills★ 2K cherry-studioCherryHQ/cherry-studio★ 51.5K onyxonyx-dot-app/onyx★ 32K siyuansiyuan-note/siyuan★ 46.2K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K