ToolAI.io · GitHub Channel

Inference, Deployment & Runtime · Open-source AI Projects on GitHub

A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.

Popular tags Agent LLM RAG MCP Coding Inference Tool calling Embeddings Vector database Multimodal Fine-tuning Evaluation Open source Self-hosted Python TypeScript Rust Voice Vision Workflow

Public repository data

Project index

1 projects
Inference, Deployment & Runtime

LocalAI

mudler/LocalAI

A local inference engine for self-hosting models and AI services.

★ 48.9K⑂ 4.4KGo
MITQ85

Recently updated

TypeSafe Python SDKtypesafe-ai/typesafe-sdk-python★ 218 TypeSafe JavaScript SDKtypesafe-ai/typesafe-sdk-js★ 231 TypeSafe Agent Skillstypesafe-ai/skills★ 2K cherry-studioCherryHQ/cherry-studio★ 51.5K onyxonyx-dot-app/onyx★ 32K siyuansiyuan-note/siyuan★ 46.2K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K