Inferenz, Bereitstellung & Laufzeit
llmgateway
theopenco/llmgateway
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface.
★ 1,6K⑂ 172TypeScript
ToolAI.io · GitHub-Kanal
AI-Projektverzeichnis auf GitHub
Durchsuchen Sie das vollständige ToolAI-Verzeichnis mit Open-Source-AI-Projekten auf GitHub, geordnet nach Thema, Sprache und Lizenz.
Daten des öffentlichen Repositorys
Projektindex
Inferenz, Bereitstellung & Laufzeit
xLLM: High-Performance Inference Engine for Diverse AI Accelerators
xllm-ai/xllm
xLLM is a C++ inference framework for LLM, VLM, DiT and REC models. It targets high-throughput, low-latency deployment on several AI accelerator families and separates service-layer scheduling and availability from engine-layer computation.
★ 1,5K⑂ 279C++
Agenten & Multi-Agenten
connectonion
openonion/connectonion
The Best AI Agent Framework for Agent Collaboration.
★ 1,4K⑂ 201Python
Agenten & Multi-Agenten
adk-js
google/adk-js
An open-source, code-first Typescript toolkit for building, evaluating, and deploying sophisticated AI agents with flexibility and control.
★ 1,4K⑂ 190TypeScript
MCP & Tool-Aufrufe
awesome-agentic-ai-zh
wenyuchiou/awesome-agentic-ai-zh
A trilingual (繁中 / English / 简中) learning roadmap for agentic AI: from LLM basics to multi-agent systems, with 240+ curated resources and hands-on examples. 中文 AI agent 學習地圖。
★ 6,1K⑂ 814Python
MCP & Tool-Aufrufe
Rapid-MLX
raullenchai/rapid-mlx
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replacement. Works with Claude Code, Cursor, Aider.
★ 3,5K⑂ 401Python
LLM & Basismodelle
PaddleNLP
PaddlePaddle/PaddleNLP
Easy-to-use and powerful LLM and SLM library with awesome model zoo.
★ 13K⑂ 3KPython
LLM & Basismodelle
GLM-5
zai-org/GLM-5
GLM-5: From Vibe Coding to Agentic Engineering
★ 6,8K⑂ 848—
AI Applications & Automation
qlib
microsoft/qlib
Qlib is an AI-oriented Quant investment platform that aims to use AI tech to empower Quant Research, from exploring ideas to implementing productions. Qlib supports diverse ML modeling paradigms, including supervised learning, market dynamics modeling, and RL, and is now equipped with https://github.com/microsoft/RD-Agent to automate R&D process.
★ 46,7K⑂ 7,4KPython
Feinabstimmung, Training & Daten
DeepSpeed
deepspeedai/deepspeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
★ 43K⑂ 4,9KPython
Inferenz, Bereitstellung & Laufzeit
TensorRT
NVIDIA/TensorRT
NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.
★ 13,2K⑂ 2,4KC++
Agenten & Multi-Agenten
UFO
microsoft/UFO
UFO³: Weaving the Digital Agent Galaxy
★ 9,3K⑂ 1KPython
Seite 9 / 25 · 295 Projekte