ToolAI.io · Kanal GitHub

Proyek AI sumber terbuka di GitHub

Indeks berbasis fakta untuk proyek pengembangan LLM, agen, MCP, RAG, dan AI, dengan lisensi, pengaturan, unduhan, tangkapan layar, dan sumber daya terkait untuk setiap entri.

Data repositori publik

Indeks proyek

75 Proyek
Inferensi, Deployment & Runtime

vLLM Ascend

vllm-project/vllm-ascend

A community-maintained hardware plugin that enables vLLM to run model inference and serving workloads on supported Ascend NPUs.

★ 2,7K⑂ 2,1KC++
Apache-2.0Q98
LLM & Model Fondasi

Bionic GPT

bionic-gpt/bionic-gpt

Bionic is a Rust-based, on-premise alternative to ChatGPT designed for private generative AI deployments. It provides a familiar chat interface, local or remote model access, team controls, retrieval-augmented assistants, data integrations, observability, and Kubernetes-oriented scaling.

★ 2,4K⑂ 239Rust
NOASSERTIONQ98
Inferensi, Deployment & Runtime

any-llm: A Unified Python Interface for LLM Providers

mozilla-ai/any-llm

any-llm is a Python SDK for communicating with multiple LLM providers through one interface. It supports switching providers and models with minimal code changes while using official provider SDKs when available.

★ 2,2K⑂ 211Python
Apache-2.0Q98
Agen & Multi-Agen

Future AGI

future-agi/future-agi

An open-source, self-hostable platform for evaluating, tracing, simulating, protecting, routing, and optimizing LLM and AI-agent applications.

★ 1,7K⑂ 498Python
Apache-2.0Q98
Inferensi, Deployment & Runtime

xLLM: High-Performance Inference Engine for Diverse AI Accelerators

xllm-ai/xllm

xLLM is a C++ inference framework for LLM, VLM, DiT and REC models. It targets high-throughput, low-latency deployment on several AI accelerator families and separates service-layer scheduling and availability from engine-layer computation.

★ 1,5K⑂ 279C++
Apache-2.0Q98
Tangkapan layar Askimo
MCP & Pemanggilan Tool

Askimo

askimo-ai/askimo

A native desktop AI client for chat, local RAG, multi-step AI workflows (Plans), and agent skills, supporting multiple cloud and local LLM providers while keeping user files strictly on the machine.

★ 338⑂ 71Kotlin
AGPL-3.0Q94
Tangkapan layar NeuroLink
MCP & Pemanggilan Tool

NeuroLink

juspay/neurolink

A TypeScript integration platform providing a unified API for 30+ AI providers and 100+ models, enabling provider swapping, multi-modal voice processing, RAG, memory, and MCP-native tool integration.

★ 121⑂ 124TypeScript
MITQ93
Tangkapan layar comfyui-mcp
MCP & Pemanggilan Tool

comfyui-mcp

artokun/comfyui-mcp

A local-first, agent-native control plane for ComfyUI that provides an MCP server and sidebar agent to generate images, video, and audio, author and run workflows, and edit live graphs using natural language across any LLM.

★ 599⑂ 93TypeScript
MITQ92
Tangkapan layar models
Agen & Multi-Agen

models

reyamira/models

A TUI and CLI tool for browsing AI models, benchmarks, coding agents, and provider statuses.

★ 492⑂ 19Rust
MITQ92
Tangkapan layar memra
Inferensi, Deployment & Runtime

memra

avifenesh/memra

A from-scratch LLM inference engine built in Rust and CUDA, specifically optimized for RTX 5090 (sm_120a) and H100 (sm_90a) architectures, delivering exactness-gated performance without relying on frameworks like ggml.

★ 314⑂ 35Rust
MITQ92
Tangkapan layar LLMix
Agen & Multi-Agen

LLMix

sno-ai/llmix

A production LLM call layer for AI agents and tools that wraps existing provider SDKs with config-driven model presets, caching, resilience patterns, and key rotation across Python, TypeScript, and Rust.

★ 131⑂ 28Python
Apache-2.0Q91
Tangkapan layar 1flowbase
Agen & Multi-Agen

1flowbase

taichuy/1flowbase

An open-source AI gateway that allows local agent clients to publish fusion-style multi-model workflows as OpenAI and Claude-compatible virtual models, providing full observability into traces, tokens, latency, and costs.

★ 257⑂ 19Rust
Apache-2.0Q89

Halaman 5 / 7 · 75 proyek

Baru diperbarui

qwen-code — Command-line coding agentQwenLM/qwen-code★ 27,1K SBproxysoapbucket/sbproxy★ 49 XERJxerj-org/xerj★ 1,4K PwrAgentpwrdrvr/pwragent★ 29 OpenGenicloudgeni-ai/opengeni★ 56 NemoClaw — Agent runtime and deployment toolingNVIDIA/NemoClaw★ 22,2K

Paling banyak diberi bintang

Hermes Agentnousresearch/hermes-agent★ 227,1K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,3K skills — Reusable agent skills and workflowsanthropics/skills★ 170,1K Hugging Face Transformershuggingface/transformers★ 163,3K Firecrawlfirecrawl/firecrawl★ 161,1K LangChainlangchain-ai/langchain★ 143,6K