Inference, Deployment & Runtime
checkpoint-engine
MoonshotAI/checkpoint-engine
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
★ 982⑂ 100Python
ToolAI.io · GitHub Channel
New AI Projects on GitHub
Discover newly added open-source AI projects on GitHub with repository facts, setup notes, licenses and related resources.
Public repository data
Project index
LLM & Foundation Models
PaddleFormers
PaddlePaddle/PaddleFormers
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
★ 13K⑂ 2.2KPython
LLM & Foundation Models
ERNIE
PaddlePaddle/ERNIE
The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.
★ 7.7K⑂ 1.4KPython
Inference, Deployment & Runtime
Model-Optimizer
NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
★ 3.3K⑂ 513Python
LLM & Foundation Models
Qwen
QwenLM/Qwen
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
★ 21.5K⑂ 1.9KPython
LLM & Foundation Models
PaddleNLP
PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
★ 13K⑂ 3KPython
Inference, Deployment & Runtime
FastDeploy
PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
★ 3.7K⑂ 755Python
LLM & Foundation Models
GLM-5
zai-org/GLM-5
GLM-5: From Vibe Coding to Agentic Engineering
★ 6.8K⑂ 848—
MCP & Tool Calling
awesome-agentic-ai-zh
wenyuchiou/awesome-agentic-ai-zh
A trilingual (繁中 / English / 简中) learning roadmap for agentic AI: from LLM basics to multi-agent systems, with 240+ curated resources and hands-on examples. 中文 AI agent 學習地圖。
★ 6.1K⑂ 814Python
Agents & Multi-Agent
second-brain
henrydaum/second-brain
Second Brain is an agentic framework that acts as an operating system, using local file intelligence, workflow automation, and LLMs to complete tasks and communicate over multiple modalities and messaging platforms.
★ 607⑂ 75Python
Inference, Deployment & Runtime
llmgateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1.6K⑂ 172TypeScript
Agents & Multi-Agent
rig
0xplaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
★ 8.3K⑂ 937Rust
Page 4 / 11 · 126 projects