ToolAI.io · Kanal GitHub

Inferensi, Deployment & Runtime · Proyek AI sumber terbuka di GitHub

Indeks berbasis fakta untuk proyek pengembangan LLM, agen, MCP, RAG, dan AI, dengan lisensi, pengaturan, unduhan, tangkapan layar, dan sumber daya terkait untuk setiap entri.

Data repositori publik

Indeks proyek

2 Proyek
Inferensi, Deployment & Runtime

Model-Optimizer

NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

★ 3,3K⑂ 513Python
Apache-2.0Q86
Inferensi, Deployment & Runtime

DeepInfer

deepseek-ai/DeepInfer

DeepSeek’s own high-performance inference framework, open-sourced for offline inference of DeepSeek-V4.1-Flash on NVIDIA SM100 GPUs and Huawei Ascend 950 NPUs.

★ 25,7K⑂ 3,2KPython
Apache-2.0Q82

Baru diperbarui

Craft Anythingstorytold/craft-anything★ 27,4K elephant-goldfish-modelgoogle/elephant-goldfish-model★ 15,6K DeepInferdeepseek-ai/DeepInfer★ 25,7K ComfyUIComfy-Org/ComfyUI★ 136,7K CrewAICrewAIInc/crewAI★ 59,5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K

Paling banyak diberi bintang

ECCaffaan-m/ECC★ 248,8K Hermes Agentnousresearch/hermes-agent★ 227,1K tensorflowtensorflow/tensorflow★ 198,8K AutoGPTSignificant-Gravitas/AutoGPT★ 187,1K ollamaollama/ollama★ 180,2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,9K