ToolAI.io · Kênh GitHub
Theo dõi các kho lưu trữ AI mã nguồn mở đang hoạt động trong các chủ đề LLM, tác nhân, MCP, RAG và lập trình, kèm số sao và thông tin dự án đã xác minh.
Dữ liệu kho lưu trữ công khai
infiniflow/ragflow
RAGFlow is an open-source Retrieval-Augmented Generation engine that combines document ingestion, retrieval, grounded citations, configurable language and embedding models, and agent capabilities to provide context for LLM applications.
kvcache-ai/mooncake
Mooncake is a C++ infrastructure project for large-scale LLM inference and training. It separates prefill, decode, and storage resources while providing high-performance transfer, distributed KV-cache storage, and fault-tolerant expert-parallel communication.
mlflow/mlflow
An open-source AI engineering platform for tracing, evaluating, monitoring, optimizing, governing, and deploying agents, LLM applications, and machine-learning models.
langfuse/langfuse
An open-source LLM engineering platform for tracing, evaluating, debugging, and improving AI applications, with prompt management, datasets, metrics, a playground, APIs, and managed or self-hosted deployment options.
llm-d/llm-d
llm-d is an open-source serving stack that adds distributed orchestration, routing, cache management, autoscaling, and batch processing around model servers such as vLLM and SGLang. It targets high-scale production inference on Kubernetes and modern hardware accelerators.
alibaba/open-code-review
An open-source AI code review CLI from Alibaba that combines deterministic review pipelines with an LLM agent to produce structured, line-level feedback.
giskard-ai/giskard-oss
An open-source Python library for evaluating and testing LLM-based and agentic systems, including multi-turn evaluations, LLM-as-judge checks and automated vulnerability scanning.
maximhq/bifrost
Bifrost is a Go-based AI gateway that provides a unified, OpenAI-compatible API for 23+ AI providers. It supports routing, fallbacks, load balancing, semantic caching, governance, observability, multimodal requests, plugins, and Model Context Protocol integrations.
oumi-ai/oumi
Oumi is a Python-based platform for preparing data, training and fine-tuning open-weight foundation models, evaluating results, running inference, and deploying models. It provides configuration recipes and a consistent CLI for local, cluster, and cloud workflows.
gpustack/gpustack
GPUStack is an open-source GPU cluster manager for serving AI models and provisioning on-demand, SSH-accessible GPU instances. It orchestrates inference engines including vLLM, SGLang, and TensorRT-LLM across on-premises, Kubernetes, and cloud environments.
mempalace/mempalace
A local-first, open-source AI memory system that stores conversation history and project files as verbatim text for semantic retrieval, achieving 96.6% R@5 on LongMemEval without requiring LLMs or API calls.
neuml/txtai
txtai is a Python-based AI framework for semantic and vector search, retrieval-augmented generation, LLM orchestration, autonomous agents and multimodal language-model workflows.
Trang 8 / 10 · 118 dự án
