Inferensi, Deployment & Runtime
llmgateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1,6K⑂ 172TypeScript
ToolAI.io · Kanal GitHub
Direktori proyek AI di GitHub
Jelajahi direktori lengkap ToolAI yang berisi proyek AI sumber terbuka di GitHub, yang diatur berdasarkan topik, bahasa, dan lisensi.
Data repositori publik
Indeks proyek
Inferensi, Deployment & Runtime
xLLM: High-Performance Inference Engine for Diverse AI Accelerators
xllm-ai/xllm
xLLM is a C++ inference framework for LLM, VLM, DiT and REC models. It targets high-throughput, low-latency deployment on several AI accelerator families and separates service-layer scheduling and availability from engine-layer computation.
★ 1,5K⑂ 279C++
Agen & Multi-Agen
connectonion
openonion/connectonion
The Best AI Agent Framework for Agent Collaboration.
★ 1,4K⑂ 201Python
Agen & Multi-Agen
adk-js
google/adk-js
An open-source, code-first Typescript toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
★ 1,4K⑂ 190TypeScript
MCP & Pemanggilan Tool
awesome-agentic-ai-zh
wenyuchiou/awesome-agentic-ai-zh
A trilingual (繁中 / English / 简中) learning roadmap for agentic AI: from LLM basics to multi-agent systems, with 240+ curated resources and hands-on examples. 中文 AI agent 學習地圖。
★ 6,1K⑂ 814Python
MCP & Pemanggilan Tool
Rapid-MLX
raullenchai/rapid-mlx
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
★ 3,5K⑂ 401Python
LLM & Model Fondasi
PaddleNLP
PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
★ 13K⑂ 3KPython
LLM & Model Fondasi
GLM-5
zai-org/GLM-5
GLM-5: From Vibe Coding to Agentic Engineering
★ 6,8K⑂ 848—
AI Applications & Automation
qlib
microsoft/qlib
Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from exploring ideas to implementing productions. Qlib supports diverse ML modeling paradigms, including supervised learning, market dynamics modeling, and RL, and is now equipped with https://github.com/microsoft/RD-Agent to automate R&D process.
★ 46,7K⑂ 7,4KPython
Fine-tuning, Pelatihan & Data
DeepSpeed
deepspeedai/deepspeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
★ 43K⑂ 4,9KPython
Inferensi, Deployment & Runtime
TensorRT
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
★ 13,2K⑂ 2,4KC++
Agen & Multi-Agen
UFO
microsoft/UFO
UFO³: Weaving the Digital Agent Galaxy
★ 9,3K⑂ 1KPython
Halaman 9 / 25 · 295 proyek