ToolAI.io · GitHub Channel
A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.
Public repository data
katanemo/plano
Plano is an AI-native proxy server and data plane built in Rust that centralizes LLM routing, agent orchestration, observability, and guardrails, allowing developers to focus on core agent logic rather than infrastructure plumbing.
clearml/clearml
ClearML is an open-source MLOps/LLMOps suite providing auto-magical CI/CD to streamline AI workloads. It integrates experiment management, data management, pipeline orchestration, scheduling, and model serving into a single comprehensive platform.
plastic-labs/honcho
Memory infrastructure for building stateful AI agents that understand changing people, agents, groups, projects, and ideas over time.
genkit-ai/genkit
Genkit is an open-source framework built and used in production by Google's Firebase for developing full-stack, AI-powered applications. It provides cross-language SDKs and unified APIs for integrating various AI models to build chatbots, automations, and recommendation systems.
kvcache-ai/mooncake
Mooncake is a C++ infrastructure project for large-scale LLM inference and training. It separates prefill, decode, and storage resources while providing high-performance transfer, distributed KV-cache storage, and fault-tolerant expert-parallel communication.
giskard-ai/giskard-oss
An open-source Python library for evaluating and testing LLM-based and agentic systems, including multi-turn evaluations, LLM-as-judge checks and automated vulnerability scanning.
gpustack/gpustack
GPUStack is an open-source GPU cluster manager for serving AI models and provisioning on-demand, SSH-accessible GPU instances. It orchestrates inference engines including vLLM, SGLang, and TensorRT-LLM across on-premises, Kubernetes, and cloud environments.
lemonade-sdk/lemonade
Lemonade is an open-source local AI server that enables users to run optimized Large Language Models (LLMs), speech, and image generation models directly on their own GPUs and NPUs, providing a free and private alternative to cloud APIs.
homeassistant-ai/ha-mcp
A comprehensive Model Context Protocol (MCP) server enabling AI assistants to interact with, configure, build, and debug Home Assistant smart home setups using natural language.
opencsgs/csghub
CSGHub is an open-source, on-premise platform for managing the full lifecycle of Large Language Model assets, including models, datasets, spaces, and code, offering functionality comparable to a private Hugging Face.
openagents-org/openagents
An open-source platform providing a collaborative operating system for AI agents, enabling unified workspace management, multi-agent coordination, and network integration without vendor lock-in.
llm-d/llm-d
llm-d is an open-source serving stack that adds distributed orchestration, routing, cache management, autoscaling, and batch processing around model servers such as vLLM and SGLang. It targets high-scale production inference on Kubernetes and modern hardware accelerators.
Page 4 / 11 · 126 projects
