ToolAI.io · Kanal GitHub

Proyek AI yang sedang tren di GitHub

Lacak repositori AI open source aktif dalam topik LLM, agen, MCP, RAG, dan coding, lengkap dengan jumlah bintang serta informasi proyek yang terverifikasi.

Data repositori publik

Indeks proyek

118 Proyek
Agen & Multi-Agen

RAGFlow

infiniflow/ragflow

RAGFlow is an open-source Retrieval-Augmented Generation engine that combines document ingestion, retrieval, grounded citations, configurable language and embedding models, and agent capabilities to provide context for LLM applications.

★ 86,7K⑂ 10,2KGo
Apache-2.0Q98
Inferensi, Deployment & Runtime

Mooncake: KVCache-Centric Infrastructure for Distributed LLM Serving

kvcache-ai/mooncake

Mooncake is a C++ infrastructure project for large-scale LLM inference and training. It separates prefill, decode, and storage resources while providing high-performance transfer, distributed KV-cache storage, and fault-tolerant expert-parallel communication.

★ 6,1K⑂ 1KC++
Apache-2.0Q98
Agen & Multi-Agen

MLflow

mlflow/mlflow

An open-source AI engineering platform for tracing, evaluating, monitoring, optimizing, governing, and deploying agents, LLM applications, and machine-learning models.

★ 27,3K⑂ 6,1KPython
Apache-2.0Q98
Fine-tuning, Pelatihan & Data

Langfuse

langfuse/langfuse

An open-source LLM engineering platform for tracing, evaluating, debugging, and improving AI applications, with prompt management, datasets, metrics, a playground, APIs, and managed or self-hosted deployment options.

★ 32,4K⑂ 3,5KTypeScript
NOASSERTIONQ98
Inferensi, Deployment & Runtime

llm-d: Distributed LLM Inference on Kubernetes

llm-d/llm-d

llm-d is an open-source serving stack that adds distributed orchestration, routing, cache management, autoscaling, and batch processing around model servers such as vLLM and SGLang. It targets high-scale production inference on Kubernetes and modern hardware accelerators.

★ 4K⑂ 649Shell
Apache-2.0Q98
Agen & Multi-Agen

OpenCodeReview

alibaba/open-code-review

An open-source AI code review CLI from Alibaba that combines deterministic review pipelines with an LLM agent to produce structured, line-level feedback.

★ 18K⑂ 1,2KGo
Apache-2.0Q98
MCP & Pemanggilan Tool

Bifrost AI Gateway

maximhq/bifrost

Bifrost is a Go-based AI gateway that provides a unified, OpenAI-compatible API for 23+ AI providers. It supports routing, fallbacks, load balancing, semantic caching, governance, observability, multimodal requests, plugins, and Model Context Protocol integrations.

★ 7K⑂ 984Go
Apache-2.0Q98
Fine-tuning, Pelatihan & Data

Oumi: Open-Source Foundation Model Training, Evaluation, Inference, and Deployment

oumi-ai/oumi

Oumi is a Python-based platform for preparing data, training and fine-tuning open-weight foundation models, evaluating results, running inference, and deploying models. It provides configuration recipes and a consistent CLI for local, cluster, and cloud workflows.

★ 9,4K⑂ 784Python
Apache-2.0Q98
Inferensi, Deployment & Runtime

GPUStack

gpustack/gpustack

GPUStack is an open-source GPU cluster manager for serving AI models and provisioning on-demand, SSH-accessible GPU instances. It orchestrates inference engines including vLLM, SGLang, and TensorRT-LLM across on-premises, Kubernetes, and cloud environments.

★ 5,4K⑂ 604Python
Apache-2.0Q98
Tangkapan layar MemPalace
MCP & Pemanggilan Tool

MemPalace

mempalace/mempalace

A local-first, open-source AI memory system that stores conversation history and project files as verbatim text for semantic retrieval, achieving 96.6% R@5 on LongMemEval without requiring LLMs or API calls.

★ 58K⑂ 7,5KPython
MITQ98

Halaman 8 / 10 · 118 proyek

Baru diperbarui

cherry-studioCherryHQ/cherry-studio★ 51,5K siyuansiyuan-note/siyuan★ 46,2K career-opscareer-ops-hq/career-ops★ 70,2K tensorflowtensorflow/tensorflow★ 198,8K streamlitstreamlit/streamlit★ 45,7K pytorchpytorch/pytorch★ 102,8K

Paling banyak diberi bintang

ECCaffaan-m/ECC★ 248,8K Hermes Agentnousresearch/hermes-agent★ 227,1K tensorflowtensorflow/tensorflow★ 198,8K AutoGPTSignificant-Gravitas/AutoGPT★ 187,1K ollamaollama/ollama★ 180,2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,9K