ToolAI.io · GitHub Channel

New AI Projects on GitHub

Discover newly added open-source AI projects on GitHub with repository facts, setup notes, licenses and related resources.

Public repository data

Project index

132 projects
Inference, Deployment & Runtime

FastDeploy

PaddlePaddle/FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

★ 3.7K⑂ 755Python
Apache-2.0Q98
LLM & Foundation Models

GLM-5

zai-org/GLM-5

GLM-5: From Vibe Coding to Agentic Engineering

★ 6.8K⑂ 848—
Apache-2.0Q95
MCP & Tool Calling

awesome-agentic-ai-zh

wenyuchiou/awesome-agentic-ai-zh

A trilingual (繁中 / English / 简中) learning roadmap for agentic AI: from LLM basics to multi-agent systems, with 240+ curated resources and hands-on examples. 中文 AI agent 學習地圖。

★ 6.1K⑂ 814Python
MITQ96
Agents & Multi-Agent

second-brain

henrydaum/second-brain

Second Brain is an agentic framework that acts as an operating system, using local file intelligence, workflow automation, and LLMs to complete tasks and communicate over multiple modalities and messaging platforms.

★ 607⑂ 75Python
MITQ92
Inference, Deployment & Runtime

llmgateway

theopenco/llmgateway

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.

★ 1.6K⑂ 172TypeScript
NOASSERTIONQ98
Agents & Multi-Agent

rig

0xplaygrounds/rig

⚙️🦀 Build modular and scalable LLM Applications in Rust

★ 8.3K⑂ 937Rust
MITQ98
Fine-tuning, Training & Data

aikit

kaito-project/aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!

★ 535⑂ 57Go
MITQ94
MCP & Tool Calling

litellm

berriai/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

★ 56.8K⑂ 10.8KPython
NOASSERTIONQ98
Inference, Deployment & Runtime

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 89.5K⑂ 21KPython
Apache-2.0Q98
Screenshot of EvalScope
RAG & Knowledge Systems

EvalScope

modelscope/evalscope

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

★ 3.2K⑂ 440Python
Apache-2.0Q98
Screenshot of TruLens: Evaluation and Tracking for LLM Experiments and AI Agents
Agents & Multi-Agent

TruLens: Evaluation and Tracking for LLM Experiments and AI Agents

truera/trulens

TruLens is an open-source, OpenTelemetry-native evaluation and tracking library for LLM applications and AI agents, enabling developers to trace every step, score performance with LLM judges, and compare app versions.

★ 3.5K⑂ 319Python
MITQ98
Screenshot of OpenAgents
Agents & Multi-Agent

OpenAgents

openagents-org/openagents

An open-source platform providing a collaborative operating system for AI agents, enabling unified workspace management, multi-agent coordination, and network integration without vendor lock-in.

★ 4K⑂ 403TypeScript
Apache-2.0Q98

Page 5 / 11 · 132 projects

Recently updated

Craft Anythingstorytold/craft-anything★ 27.4K elephant-goldfish-modelgoogle/elephant-goldfish-model★ 15.6K DeepInferdeepseek-ai/DeepInfer★ 25.7K ComfyUIComfy-Org/ComfyUI★ 136.7K CrewAICrewAIInc/crewAI★ 59.5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K