FastDeploy
PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
ToolAI.io · GitHub 频道
一个基于事实的 LLM、智能体、MCP、RAG 和 AI 开发项目索引;每个条目均包含许可证、设置、下载、截图及相关资源。
公开仓库数据
PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
zai-org/GLM-5
GLM-5: From Vibe Coding to Agentic Engineering
wenyuchiou/awesome-agentic-ai-zh
A trilingual (繁中 / English / 简中) learning roadmap for agentic AI: from LLM basics to multi-agent systems, with 240+ curated resources and hands-on examples. 中文 AI agent 學習地圖。
henrydaum/second-brain
Second Brain is an agentic framework that acts as an operating system, using local file intelligence, workflow automation, and LLMs to complete tasks and communicate over multiple modalities and messaging platforms.
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
0xplaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
kaito-project/aikit
🏗️ Fine-tune, build, and deploy open-source LLMs easily!
berriai/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
modelscope/evalscope
一个轻量且可定制的大模型(LLM、VLM、AIGC)评测与性能基准测试框架。
truera/trulens
TruLens 是一个开源的、原生支持 OpenTelemetry 的评估与追踪库,适用于 LLM 应用和 AI 智能体。它帮助开发者追踪每一步骤,使用 LLM 作为评判者对性能进行打分,并比较不同版本的应用。
openagents-org/openagents
一个开源平台,为 AI 智能体提供协作式操作系统,支持统一工作区管理、多智能体协调和网络集成,且无供应商锁定。
第 5 / 11 页 · 132 个项目