推理、部署与运行时
checkpoint-engine
MoonshotAI/checkpoint-engine
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
★ 982⑂ 100Python
ToolAI.io · GitHub 频道
GitHub 上的 AI 项目目录
一个基于事实的 LLM、智能体、MCP、RAG 和 AI 开发项目索引；每个条目均包含许可证、设置、下载、截图及相关资源。
公开仓库数据
项目索引
LLM 与基础模型
Qwen3：Open-weight multilingual language models
QwenLM/Qwen3
ToolAI 对 QwenLM/Qwen3 的客观项目介绍。Qwen3 is the large language model series developed by Qwen team, Alibaba Cloud
★ 27.5K⑂ 2KPython
评估、可观测性与安全
evals：Model evaluation framework
openai/evals
ToolAI 对 openai/evals 的客观项目介绍。Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks
★ 19.2K⑂ 3.1KPython
LLM 与基础模型
Qwen3-Coder：Code-focused language models
QwenLM/Qwen3-Coder
ToolAI 对 QwenLM/Qwen3-Coder 的客观项目介绍。Qwen3-Coder is the code version of Qwen3, the large language model series developed by Qwen team
★ 16.8K⑂ 1.2KPython
推理、部署与运行时
TensorRT-LLM：Optimized LLM inference
NVIDIA/TensorRT-LLM
ToolAI 对 NVIDIA/TensorRT-LLM 的客观项目介绍。TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way
★ 14.4K⑂ 2.7KC++
AI 编程与开发者工具
ai-development-patterns
paulduvall/ai-development-patterns
A comprehensive collection of AI development patterns for building software with AI assistance, organized by implementation maturity and development lifecycle phases. Includes Foundation, Development, and Operations patterns with practical examples and anti-patterns.
★ 638⑂ 53Python
MCP 与工具调用
Synapse
zai-org/Synapse
Self-hosted AI workspace with shareable AI teammates, shared conversations, memory, and governed access to plugins, MCP tools, and local devices.
★ 331⑂ 24TypeScript
LLM 与基础模型
PaddleFormers
PaddlePaddle/PaddleFormers
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
★ 13K⑂ 2.2KPython
多模态 AI
CogVideo
zai-org/CogVideo
text and image to video generation: CogVideoX (2024) and CogVideo (ICLR 2023)
★ 12.9K⑂ 1.3KPython
智能体与多智能体
langcrew
01-ai/langcrew
A high-level multi-agent development framework built on LangGraph, combining CrewAI’s intuitive concepts with enterprise-grade features, ready-to-use templates, and full-stack UI for rapid productization.
★ 115⑂ 9Python
推理、部署与运行时
jan
janhq/jan
支持在个人电脑上运行模型的本地 AI 对话应用。
★ 44.3K⑂ 3KTypeScript
多模态 AI
Hunyuan3D-2
Tencent-Hunyuan/Hunyuan3D-2
High-Resolution 3D Assets Generation with Large Scale Hunyuan3D Diffusion Models.
★ 14.4K⑂ 1.5KPython
第 24 / 25 页 · 295 个项目