एजेंट और मल्टी-एजेंट
katanemo/plano
Plano is an AI-native proxy server and data plane built in Rust that centralizes LLM routing, agent orchestration, observability, and guardrails, allowing developers to focus on core agent logic rather than infrastructure plumbing.
★ 7K⑂ 484Rust
Apache-2.0Q98
LLM और फ़ाउंडेशन मॉडल
clearml/clearml
ClearML is an open-source MLOps/LLMOps suite providing auto-magical CI/CD to streamline AI workloads. It integrates experiment management, data management, pipeline orchestration, scheduling, and model serving into a single comprehensive platform.
★ 6.8K⑂ 789Python
Apache-2.0Q98
एजेंट और मल्टी-एजेंट
plastic-labs/honcho
Memory infrastructure for building stateful AI agents that understand changing people, agents, groups, projects, and ideas over time.
★ 6.5K⑂ 788Python
AGPL-3.0Q98
एजेंट और मल्टी-एजेंट
genkit-ai/genkit
Genkit is an open-source framework built and used in production by Google's Firebase for developing full-stack, AI-powered applications. It provides cross-language SDKs and unified APIs for integrating various AI models to build chatbots, automations, and recommendation systems.
★ 6.3K⑂ 816TypeScript
Apache-2.0Q98
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
kvcache-ai/mooncake
Mooncake is a C++ infrastructure project for large-scale LLM inference and training. It separates prefill, decode, and storage resources while providing high-performance transfer, distributed KV-cache storage, and fault-tolerant expert-parallel communication.
★ 6.1K⑂ 1KC++
Apache-2.0Q98
एजेंट और मल्टी-एजेंट
giskard-ai/giskard-oss
An open-source Python library for evaluating and testing LLM-based and agentic systems, including multi-turn evaluations, LLM-as-judge checks and automated vulnerability scanning.
★ 5.7K⑂ 513Python
Apache-2.0Q98
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
gpustack/gpustack
GPUStack is an open-source GPU cluster manager for serving AI models and provisioning on-demand, SSH-accessible GPU instances. It orchestrates inference engines including vLLM, SGLang, and TensorRT-LLM across on-premises, Kubernetes, and cloud environments.
★ 5.4K⑂ 604Python
Apache-2.0Q98
MCP और टूल कॉलिंग
lemonade-sdk/lemonade
Lemonade is an open-source local AI server that enables users to run optimized Large Language Models (LLMs), speech, and image generation models directly on their own GPUs and NPUs, providing a free and private alternative to cloud APIs.
★ 5.2K⑂ 436C++
Apache-2.0Q98
MCP और टूल कॉलिंग
homeassistant-ai/ha-mcp
A comprehensive Model Context Protocol (MCP) server enabling AI assistants to interact with, configure, build, and debug Home Assistant smart home setups using natural language.
★ 4.3K⑂ 177Python
MITQ98
एजेंट और मल्टी-एजेंट
opencsgs/csghub
CSGHub is an open-source, on-premise platform for managing the full lifecycle of Large Language Model assets, including models, datasets, spaces, and code, offering functionality comparable to a private Hugging Face.
★ 4.2K⑂ 525Vue
Apache-2.0Q98
एजेंट और मल्टी-एजेंट
openagents-org/openagents
An open-source platform providing a collaborative operating system for AI agents, enabling unified workspace management, multi-agent coordination, and network integration without vendor lock-in.
★ 4K⑂ 403TypeScript
Apache-2.0Q98
इन्फरेंस, डिप्लॉयमेंट और रनटाइम
llm-d/llm-d
llm-d is an open-source serving stack that adds distributed orchestration, routing, cache management, autoscaling, and batch processing around model servers such as vLLM and SGLang. It targets high-scale production inference on Kubernetes and modern hardware accelerators.
★ 4K⑂ 649Shell
Apache-2.0Q98