추론, 배포 및 런타임
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 89.5K⑂ 21KPython
ToolAI.io · GitHub 채널
GitHub의 오픈 소스 AI 프로젝트
각 항목에 라이선스, 설정, 다운로드, 스크린샷 및 관련 리소스를 제공하는 LLM, 에이전트, MCP, RAG 및 AI 개발 프로젝트의 사실 기반 색인입니다.
markitdown — Document conversion and extraction
Python tool for converting files and office documents to Markdown
★ 174.9K · Pythonskills — Reusable agent skills and workflows
Public repository for Agent Skills
★ 170.6K · Markdownclaude-code — Agentic coding in the terminal
Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands
★ 142.1K · TypeScriptwhisper — Speech recognition and transcription
Robust Speech Recognition via Large-Scale Weak Supervision
★ 107.7K · PythonDeepSeek-V3 — Large language model research and inference
An open-source project focused on large language model research and inference.
★ 104.4K · PythonDeepSeek-R1 — Reasoning model research and evaluation
An open-source project focused on reasoning model research and evaluation.
★ 92K · PythonHermes Agent
A self-improving AI agent built by Nous Research that features a closed learning loop, multi-platform messaging integration, and flexible model provider switching. It is designed to run on low-cost VPS, GPU clusters, or serverless infrastructure.
★ 227.1K · PythonHugging Face Transformers
A model-definition framework for state-of-the-art machine learning models across text, vision, audio, and multimodal domains, supporting both inference and training.
★ 163.3K · PythonFirecrawl
An open-source web context API to search, scrape, and interact with the web at scale, converting web data into clean Markdown or structured JSON for AI agents and LLMs.
★ 161.1K · TypeScript MCP 및 도구 호출Dify: Collaborative Platform for Agentic Workflows and RAG Applications
Dify is an LLM application development platform for visually building workflows, RAG pipelines, and tool-using agents. It combines model management, prompt development, observability, and application APIs in a collaborative workspace that can be used as a hosted service or self-hosted.
★ 151.2K · TypeScriptLangChain
An open-source Python framework for building LLM-powered applications and agents through interoperable, chainable components and third-party integrations.
★ 143.6K · PythonGraphify: Turn Any Codebase into a Queryable Knowledge Graph
Graphify is a local-first CLI tool and AI assistant skill that parses codebases, docs, SQL schemas, and PDFs into a queryable knowledge graph using deterministic AST parsing, eliminating the need for vector stores or embeddings.
★ 104K · Python공개 리포지토리 데이터
프로젝트 색인
에이전트 및 멀티 에이전트
RAGFlow
infiniflow/ragflow
RAGFlow is an open-source Retrieval-Augmented Generation engine that combines document ingestion, retrieval, grounded citations, configurable language and embedding models, and agent capabilities to provide context for LLM applications.
★ 86.7K⑂ 10.2KGo
에이전트 및 멀티 에이전트
OpenHands Agent Canvas
openhands/openhands
A self-hosted developer control center for running, managing, and automating coding agents across local, remote, and cloud environments.
★ 83.1K⑂ 10.7KTypeScript
에이전트 및 멀티 에이전트
Unsloth: Local Model Training, Inference, and Agent Integration
unslothai/unsloth
Unsloth is a Python-based, self-hosted toolkit with a beta web UI and code-based core for running, fine-tuning, exporting, and serving language, vision, audio, and embedding models locally.
★ 69.4K⑂ 6.3KPython
MCP 및 도구 호출
Headroom: Context Compression Layer for AI Agents
headroomlabs-ai/headroom
Headroom is a local-first context compression layer that reduces token usage for AI agents by compressing tool outputs, logs, files, and RAG chunks before they reach the LLM. It offers library, proxy, and MCP server modes and claims to preserve answer accuracy while cutting tokens by 15-95% depending on workload.
★ 65K⑂ 4.9KPython
에이전트 및 멀티 에이전트
AnythingLLM by Mintplex-Labs
mintplex-labs/anything-llm
An all-in-one, local-first AI application for chatting with documents, building AI agents, and running a private, multi-user ChatGPT-like experience with zero setup friction.
★ 64.5K⑂ 7.1KJavaScript
에이전트 및 멀티 에이전트
Mem0: Universal Memory Layer for AI Agents
mem0ai/mem0
Mem0 is an open-source memory layer for AI agents and assistants, enabling personalized, long-term memory across user sessions. It provides multi-level memory retention, hybrid retrieval, and temporal reasoning through Python and npm SDKs, a self-hosted server, or a managed cloud platform.
★ 62.5K⑂ 7.3KPython
MCP 및 도구 호출
MemPalace
mempalace/mempalace
A local-first, open-source AI memory system that stores conversation history and project files as verbatim text for semantic retrieval, achieving 96.6% R@5 on LongMemEval without requiring LLMs or API calls.
★ 58K⑂ 7.5KPython
MCP 및 도구 호출
litellm
berriai/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
★ 56.8K⑂ 10.8KPython
에이전트 및 멀티 에이전트
LlamaIndex
run-llama/llama_index
LlamaIndex is an open-source Python data framework for building LLM applications with private data, offering data connectors, indexing structures, and advanced retrieval interfaces. It is complemented by LlamaParse, an enterprise platform for agentic OCR, parsing, extraction, and indexing.
★ 51.4K⑂ 7.9KPython
RAG 및 지식 시스템
milvus
milvus-io/milvus
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
★ 45.7K⑂ 4.2KGo
MCP 및 도구 호출
AstrBot: Open-Source AI Agent Assistant & Development Framework
astrbotdevs/astrbot
AstrBot is an open-source, all-in-one AI agent chatbot platform and development framework that integrates mainstream instant messaging platforms, large language models, plugins, and agent capabilities for building production-ready conversational AI applications.
★ 38.5K⑂ 2.7KPython
2 / 24페이지 · 프로젝트 282개