ToolAI.io · Kanal GitHub

Proyek AI baru di GitHub

Temukan proyek AI sumber terbuka yang baru ditambahkan di GitHub, lengkap dengan informasi repositori, catatan penyiapan, lisensi, dan sumber daya terkait.

Data repositori publik

Indeks proyek

305 Proyek
Inferensi, Deployment & Runtime

Mooncake: KVCache-Centric Infrastructure for Distributed LLM Serving

kvcache-ai/mooncake

Mooncake is a C++ infrastructure project for large-scale LLM inference and training. It separates prefill, decode, and storage resources while providing high-performance transfer, distributed KV-cache storage, and fault-tolerant expert-parallel communication.

★ 6,1K⑂ 1KC++
Apache-2.0Q98
Inferensi, Deployment & Runtime

GPUStack

gpustack/gpustack

GPUStack is an open-source GPU cluster manager for serving AI models and provisioning on-demand, SSH-accessible GPU instances. It orchestrates inference engines including vLLM, SGLang, and TensorRT-LLM across on-premises, Kubernetes, and cloud environments.

★ 5,4K⑂ 604Python
Apache-2.0Q98
Inferensi, Deployment & Runtime

llm-d: Distributed LLM Inference on Kubernetes

llm-d/llm-d

llm-d is an open-source serving stack that adds distributed orchestration, routing, cache management, autoscaling, and batch processing around model servers such as vLLM and SGLang. It targets high-scale production inference on Kubernetes and modern hardware accelerators.

★ 4K⑂ 649Shell
Apache-2.0Q98
Agen & Multi-Agen

LangWatch

langwatch/langwatch

An open-core platform for evaluating, testing, tracing, and monitoring LLM applications and AI agents before release and in production.

★ 3,5K⑂ 345TypeScript
Apache-2.0Q98
Inferensi, Deployment & Runtime

vLLM Ascend

vllm-project/vllm-ascend

A community-maintained hardware plugin that enables vLLM to run model inference and serving workloads on supported Ascend NPUs.

★ 2,7K⑂ 2,1KC++
Apache-2.0Q98
LLM & Model Fondasi

Bionic GPT

bionic-gpt/bionic-gpt

Bionic is a Rust-based, on-premise alternative to ChatGPT designed for private generative AI deployments. It provides a familiar chat interface, local or remote model access, team controls, retrieval-augmented assistants, data integrations, observability, and Kubernetes-oriented scaling.

★ 2,4K⑂ 239Rust
NOASSERTIONQ98
Agen & Multi-Agen

Embabel Agent Framework

embabel/embabel-agent

Embabel is an open-source JVM framework for building strongly typed agentic applications that combine LLM interactions, regular code, tools, and domain models. It supports dynamic planning and can be used from Kotlin or Java.

★ 4,3K⑂ 417Kotlin
Apache-2.0Q98
Agen & Multi-Agen

dstack

dstackai/dstack

A vendor-agnostic control plane for provisioning and orchestrating training, inference, development, and agentic workloads across GPU clouds, Kubernetes, and on-premises infrastructure.

★ 2,2K⑂ 249Python
MPL-2.0Q98
Inferensi, Deployment & Runtime

any-llm: A Unified Python Interface for LLM Providers

mozilla-ai/any-llm

any-llm is a Python SDK for communicating with multiple LLM providers through one interface. It supports switching providers and models with minimal code changes while using official provider SDKs when available.

★ 2,2K⑂ 211Python
Apache-2.0Q98
Agen & Multi-Agen

Future AGI

future-agi/future-agi

An open-source, self-hostable platform for evaluating, tracing, simulating, protecting, routing, and optimizing LLM and AI-agent applications.

★ 1,7K⑂ 498Python
Apache-2.0Q98

Halaman 21 / 26 · 305 proyek

Baru diperbarui

ComfyUIComfy-Org/ComfyUI★ 136,7K CrewAICrewAIInc/crewAI★ 59,5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K TRLhuggingface/trl★ 19,5K mcp-usemcp-use/mcp-use★ 10,7K OpenLITopenlit/openlit★ 2,8K

Paling banyak diberi bintang

ECCaffaan-m/ECC★ 248,8K Hermes Agentnousresearch/hermes-agent★ 227,1K tensorflowtensorflow/tensorflow★ 198,8K AutoGPTSignificant-Gravitas/AutoGPT★ 187,1K ollamaollama/ollama★ 180,2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174,9K