ToolAI.io · Kanal GitHub

Proyek AI sumber terbuka di GitHub

Indeks berbasis fakta untuk proyek pengembangan LLM, agen, MCP, RAG, dan AI, dengan lisensi, pengaturan, unduhan, tangkapan layar, dan sumber daya terkait untuk setiap entri.

Data repositori publik

Indeks proyek

75 Proyek
Tangkapan layar Genkit: Open-Source Framework for Agentic AI Applications
Agen & Multi-Agen

Genkit: Open-Source Framework for Agentic AI Applications

genkit-ai/genkit

Genkit is an open-source framework built and used in production by Google's Firebase for developing full-stack, AI-powered applications. It provides cross-language SDKs and unified APIs for integrating various AI models to build chatbots, automations, and recommendation systems.

★ 6,3K⑂ 816TypeScript
Apache-2.0Q98
Inferensi, Deployment & Runtime

Mooncake: KVCache-Centric Infrastructure for Distributed LLM Serving

kvcache-ai/mooncake

Mooncake is a C++ infrastructure project for large-scale LLM inference and training. It separates prefill, decode, and storage resources while providing high-performance transfer, distributed KV-cache storage, and fault-tolerant expert-parallel communication.

★ 6,1K⑂ 1KC++
Apache-2.0Q98
Inferensi, Deployment & Runtime

GPUStack

gpustack/gpustack

GPUStack is an open-source GPU cluster manager for serving AI models and provisioning on-demand, SSH-accessible GPU instances. It orchestrates inference engines including vLLM, SGLang, and TensorRT-LLM across on-premises, Kubernetes, and cloud environments.

★ 5,4K⑂ 604Python
Apache-2.0Q98
Tangkapan layar Lemonade: Local AI Server for GPU and NPU Inference
MCP & Pemanggilan Tool

Lemonade: Local AI Server for GPU and NPU Inference

lemonade-sdk/lemonade

Lemonade is an open-source local AI server that enables users to run optimized Large Language Models (LLMs), speech, and image generation models directly on their own GPUs and NPUs, providing a free and private alternative to cloud APIs.

★ 5,2K⑂ 436C++
Apache-2.0Q98
Tangkapan layar ha-mcp: The Unofficial Home Assistant MCP Server
MCP & Pemanggilan Tool

ha-mcp: The Unofficial Home Assistant MCP Server

homeassistant-ai/ha-mcp

A comprehensive Model Context Protocol (MCP) server enabling AI assistants to interact with, configure, build, and debug Home Assistant smart home setups using natural language.

★ 4,3K⑂ 177Python
MITQ98
Tangkapan layar CSGHub: Open-Source LLM Asset Management Platform
Agen & Multi-Agen

CSGHub: Open-Source LLM Asset Management Platform

opencsgs/csghub

CSGHub is an open-source, on-premise platform for managing the full lifecycle of Large Language Model assets, including models, datasets, spaces, and code, offering functionality comparable to a private Hugging Face.

★ 4,2K⑂ 525Vue
Apache-2.0Q98
Tangkapan layar OpenAgents
Agen & Multi-Agen

OpenAgents

openagents-org/openagents

An open-source platform providing a collaborative operating system for AI agents, enabling unified workspace management, multi-agent coordination, and network integration without vendor lock-in.

★ 4K⑂ 403TypeScript
Apache-2.0Q98
Inferensi, Deployment & Runtime

llm-d: Distributed LLM Inference on Kubernetes

llm-d/llm-d

llm-d is an open-source serving stack that adds distributed orchestration, routing, cache management, autoscaling, and batch processing around model servers such as vLLM and SGLang. It targets high-scale production inference on Kubernetes and modern hardware accelerators.

★ 4K⑂ 649Shell
Apache-2.0Q98
Agen & Multi-Agen

LangWatch

langwatch/langwatch

An open-core platform for evaluating, testing, tracing, and monitoring LLM applications and AI agents before release and in production.

★ 3,5K⑂ 345TypeScript
Apache-2.0Q98
Tangkapan layar TruLens: Evaluation and Tracking for LLM Experiments and AI Agents
Agen & Multi-Agen

TruLens: Evaluation and Tracking for LLM Experiments and AI Agents

truera/trulens

TruLens is an open-source, OpenTelemetry-native evaluation and tracking library for LLM applications and AI agents, enabling developers to trace every step, score performance with LLM judges, and compare app versions.

★ 3,5K⑂ 319Python
MITQ98
Tangkapan layar EvalScope
RAG & sistem pengetahuan

EvalScope

modelscope/evalscope

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

★ 3,2K⑂ 440Python
Apache-2.0Q98

Halaman 4 / 7 · 75 proyek

Baru diperbarui

qwen-code — Command-line coding agentQwenLM/qwen-code★ 27,1K SBproxysoapbucket/sbproxy★ 49 XERJxerj-org/xerj★ 1,4K PwrAgentpwrdrvr/pwragent★ 29 OpenGenicloudgeni-ai/opengeni★ 56 NemoClaw — Agent runtime and deployment toolingNVIDIA/NemoClaw★ 22,2K

Paling banyak diberi bintang

Hermes Agentnousresearch/hermes-agent★ 227,1K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,3K skills — Reusable agent skills and workflowsanthropics/skills★ 170,1K Hugging Face Transformershuggingface/transformers★ 163,3K Firecrawlfirecrawl/firecrawl★ 161,1K LangChainlangchain-ai/langchain★ 143,6K