ToolAI.io · GitHub 频道

GitHub 上的热门 AI 项目

一个基于事实的 LLM、智能体、MCP、RAG 和 AI 开发项目索引；每个条目均包含许可证、设置、下载、截图及相关资源。

热门标签智能体 LLM RAG MCP 编程推理工具调用嵌入向量向量数据库多模态微调评估打开源代码自托管 Python TypeScript Rust 语音视觉工作流

搜索仓库

公开仓库数据

项目索引

295 项目

微调、训练与数据

DeepSpeed

deepspeedai/deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

★ 43K⑂ 4.9KPython

Apache-2.0Q94

智能体与多智能体

ctx

ctxrs/ctx

Search the coding agent history already on your machine

★ 1K⑂ 61Rust

Apache-2.0Q90

推理、部署与运行时

vllm

vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 89.5K⑂ 21KPython

Apache-2.0Q98

智能体与多智能体

CodeWhale

hmbown/codewhale

Open-source, community-driven agent harness

★ 40.8K⑂ 3.5KRust

MITQ92

智能体与多智能体

matrixone

matrixorigin/matrixone

AI-native HTAP database with Git-for-Data and built-in vector search, serving as the data and memory backbone for intelligent agents and applications.

★ 1.9K⑂ 307Go

Apache-2.0Q94

智能体与多智能体

1flowbase

taichuy/1flowbase

一款开源 AI 网关，允许本地代理客户端将融合式多模型工作流发布为兼容 OpenAI 和 Claude 的虚拟模型，并提供对追踪、Token、延迟和成本的完全可观测性。

★ 259⑂ 19Rust

Apache-2.0Q89

推理、部署与运行时

TensorRT-LLM：Optimized LLM inference

NVIDIA/TensorRT-LLM

ToolAI 对 NVIDIA/TensorRT-LLM 的客观项目介绍。TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way

★ 14.4K⑂ 2.7KC++

NOASSERTIONQ82