ToolAI.io · Kênh GitHub
Khám phá các dự án AI nguồn mở mới được thêm trên GitHub, cùng thông tin kho lưu trữ, hướng dẫn thiết lập, giấy phép và tài nguyên liên quan.
Dữ liệu kho lưu trữ công khai
langfuse/langfuse
An open-source LLM engineering platform for tracing, evaluating, debugging, and improving AI applications, with prompt management, datasets, metrics, a playground, APIs, and managed or self-hosted deployment options.
comet-ml/opik
Opik is an Apache-2.0-licensed platform for tracing, evaluating, debugging and monitoring LLM applications, RAG systems and multi-step agent workflows. It supports self-hosting, a hosted Comet.com option, client SDKs, a REST API, automated evaluations, prompt experimentation and production dashboards.
alibaba/open-code-review
An open-source AI code review CLI from Alibaba that combines deterministic review pipelines with an LLM agent to produce structured, line-level feedback.
mlflow/mlflow
An open-source AI engineering platform for tracing, evaluating, monitoring, optimizing, governing, and deploying agents, LLM applications, and machine-learning models.
neuml/txtai
txtai is a Python-based AI framework for semantic and vector search, retrieval-augmented generation, LLM orchestration, autonomous agents and multimodal language-model workflows.
kvcache-ai/mooncake
Mooncake is a C++ infrastructure project for large-scale LLM inference and training. It separates prefill, decode, and storage resources while providing high-performance transfer, distributed KV-cache storage, and fault-tolerant expert-parallel communication.
gpustack/gpustack
GPUStack is an open-source GPU cluster manager for serving AI models and provisioning on-demand, SSH-accessible GPU instances. It orchestrates inference engines including vLLM, SGLang, and TensorRT-LLM across on-premises, Kubernetes, and cloud environments.
giskard-ai/giskard-oss
An open-source Python library for evaluating and testing LLM-based and agentic systems, including multi-turn evaluations, LLM-as-judge checks and automated vulnerability scanning.
llm-d/llm-d
llm-d is an open-source serving stack that adds distributed orchestration, routing, cache management, autoscaling, and batch processing around model servers such as vLLM and SGLang. It targets high-scale production inference on Kubernetes and modern hardware accelerators.
langwatch/langwatch
An open-core platform for evaluating, testing, tracing, and monitoring LLM applications and AI agents before release and in production.
vllm-project/vllm-ascend
A community-maintained hardware plugin that enables vLLM to run model inference and serving workloads on supported Ascend NPUs.
bionic-gpt/bionic-gpt
Bionic is a Rust-based, on-premise alternative to ChatGPT designed for private generative AI deployments. It provides a familiar chat interface, local or remote model access, team controls, retrieval-augmented assistants, data integrations, observability, and Kubernetes-oriented scaling.
Trang 4 / 7 · 75 dự án
