Inferenza, distribuzione e runtime
checkpoint-engine
MoonshotAI/checkpoint-engine
Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
★ 982⑂ 100Python
ToolAI.io · Canale GitHub
Nuovi progetti AI su GitHub
Scopri i nuovi progetti AI open source aggiunti su GitHub, con informazioni sul repository, note di configurazione, licenze e risorse correlate.
Dati del repository pubblico
Indice del progetto
LLM e modelli fondamentali
PaddleFormers
PaddlePaddle/PaddleFormers
PaddleFormers is an easy-to-use library of pre-trained large language model zoo based on PaddlePaddle.
★ 13K⑂ 2,2KPython
LLM e modelli fondamentali
ERNIE
PaddlePaddle/ERNIE
The official repository for ERNIE 4.5 and ERNIEKit – its industrial-grade development toolkit based on PaddlePaddle.
★ 7,7K⑂ 1,4KPython
Inferenza, distribuzione e runtime
Model-Optimizer
NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
★ 3,3K⑂ 513Python
LLM e modelli fondamentali
Qwen
QwenLM/Qwen
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
★ 21,5K⑂ 1,9KPython
LLM e modelli fondamentali
PaddleNLP
PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
★ 13K⑂ 3KPython
Inferenza, distribuzione e runtime
FastDeploy
PaddlePaddle/FastDeploy
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
★ 3,7K⑂ 755Python
LLM e modelli fondamentali
GLM-5
zai-org/GLM-5
GLM-5: From Vibe Coding to Agentic Engineering
★ 6,8K⑂ 848—
MCP e chiamate agli strumenti
awesome-agentic-ai-zh
wenyuchiou/awesome-agentic-ai-zh
A trilingual (繁中 / English / 简中) learning roadmap for agentic AI: from LLM basics to multi-agent systems, with 240+ curated resources and hands-on examples. 中文 AI agent 學習地圖。
★ 6,1K⑂ 814Python
Agenti e multi-agente
second-brain
henrydaum/second-brain
Second Brain is an agentic framework that acts as an operating system, using local file intelligence, workflow automation, and LLMs to complete tasks and communicate over multiple modalities and messaging platforms.
★ 607⑂ 75Python
Inferenza, distribuzione e runtime
llmgateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1,6K⑂ 172TypeScript
Agenti e multi-agente
rig
0xplaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
★ 8,3K⑂ 937Rust
Pagina 4 / 11 · 126 progetti