추론, 배포 및 런타임
llmgateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1.6K⑂ 172TypeScript
ToolAI.io · GitHub 채널
GitHub의 AI 프로젝트 디렉터리
GitHub의 전체 ToolAI 오픈 소스 AI 프로젝트 디렉터리를 주제, 언어 및 라이선스별로 살펴보세요.
공개 리포지토리 데이터
프로젝트 색인
추론, 배포 및 런타임
xLLM: High-Performance Inference Engine for Diverse AI Accelerators
xllm-ai/xllm
xLLM is a C++ inference framework for LLM, VLM, DiT and REC models. It targets high-throughput, low-latency deployment on several AI accelerator families and separates service-layer scheduling and availability from engine-layer computation.
★ 1.5K⑂ 279C++
에이전트 및 멀티 에이전트
connectonion
openonion/connectonion
The Best AI Agent Framework for Agent Collaboration.
★ 1.4K⑂ 201Python
에이전트 및 멀티 에이전트
adk-js
google/adk-js
An open-source, code-first Typescript toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
★ 1.4K⑂ 190TypeScript
MCP 및 도구 호출
awesome-agentic-ai-zh
wenyuchiou/awesome-agentic-ai-zh
A trilingual (繁中 / English / 简中) learning roadmap for agentic AI: from LLM basics to multi-agent systems, with 240+ curated resources and hands-on examples. 中文 AI agent 學習地圖。
★ 6.1K⑂ 814Python
MCP 및 도구 호출
Rapid-MLX
raullenchai/rapid-mlx
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
★ 3.5K⑂ 401Python
LLM 및 파운데이션 모델
PaddleNLP
PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
★ 13K⑂ 3KPython
LLM 및 파운데이션 모델
GLM-5
zai-org/GLM-5
GLM-5: From Vibe Coding to Agentic Engineering
★ 6.8K⑂ 848—
AI Applications & Automation
qlib
microsoft/qlib
Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from exploring ideas to implementing productions. Qlib supports diverse ML modeling paradigms, including supervised learning, market dynamics modeling, and RL, and is now equipped with https://github.com/microsoft/RD-Agent to automate R&D process.
★ 46.7K⑂ 7.4KPython
파인튜닝, 학습 및 데이터
DeepSpeed
deepspeedai/deepspeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
★ 43K⑂ 4.9KPython
추론, 배포 및 런타임
TensorRT
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
★ 13.2K⑂ 2.4KC++
에이전트 및 멀티 에이전트
UFO
microsoft/UFO
UFO³: Weaving the Digital Agent Galaxy
★ 9.3K⑂ 1KPython
9 / 25페이지 · 프로젝트 295개