ইনফারেন্স, ডিপ্লয়মেন্ট ও রানটাইম
vllm
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
★ 89.5K⑂ 21KPython
ToolAI.io · GitHub চ্যানেল
GitHub-এ AI প্রজেক্ট ডিরেক্টরি
বিষয়, ভাষা ও লাইসেন্স অনুযায়ী সাজানো GitHub-এর ওপেন-সোর্স AI প্রজেক্টের সম্পূর্ণ ToolAI ডিরেক্টরি ব্রাউজ করুন।
পাবলিক রিপোজিটরির তথ্য
প্রকল্পের সূচি
এজেন্ট ও মাল্টি-এজেন্ট
RAGFlow
infiniflow/ragflow
RAGFlow is an open-source Retrieval-Augmented Generation engine that combines document ingestion, retrieval, grounded citations, configurable language and embedding models, and agent capabilities to provide context for LLM applications.
★ 86.7K⑂ 10.2KGo
এজেন্ট ও মাল্টি-এজেন্ট
OpenHands Agent Canvas
openhands/openhands
A self-hosted developer control center for running, managing, and automating coding agents across local, remote, and cloud environments.
★ 83.1K⑂ 10.7KTypeScript
এজেন্ট ও মাল্টি-এজেন্ট
Unsloth: Local Model Training, Inference, and Agent Integration
unslothai/unsloth
Unsloth is a Python-based, self-hosted toolkit with a beta web UI and code-based core for running, fine-tuning, exporting, and serving language, vision, audio, and embedding models locally.
★ 69.4K⑂ 6.3KPython
MCP ও টুল কলিং
Headroom: Context Compression Layer for AI Agents
headroomlabs-ai/headroom
Headroom is a local-first context compression layer that reduces token usage for AI agents by compressing tool outputs, logs, files, and RAG chunks before they reach the LLM. It offers library, proxy, and MCP server modes and claims to preserve answer accuracy while cutting tokens by 15-95% depending on workload.
★ 65K⑂ 4.9KPython
এজেন্ট ও মাল্টি-এজেন্ট
AnythingLLM by Mintplex-Labs
mintplex-labs/anything-llm
An all-in-one, local-first AI application for chatting with documents, building AI agents, and running a private, multi-user ChatGPT-like experience with zero setup friction.
★ 64.5K⑂ 7.1KJavaScript
এজেন্ট ও মাল্টি-এজেন্ট
Mem0: Universal Memory Layer for AI Agents
mem0ai/mem0
Mem0 is an open-source memory layer for AI agents and assistants, enabling personalized, long-term memory across user sessions. It provides multi-level memory retention, hybrid retrieval, and temporal reasoning through Python and npm SDKs, a self-hosted server, or a managed cloud platform.
★ 62.5K⑂ 7.3KPython
MCP ও টুল কলিং
MemPalace
mempalace/mempalace
A local-first, open-source AI memory system that stores conversation history and project files as verbatim text for semantic retrieval, achieving 96.6% R@5 on LongMemEval without requiring LLMs or API calls.
★ 58K⑂ 7.5KPython
MCP ও টুল কলিং
litellm
berriai/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
★ 56.8K⑂ 10.8KPython
এজেন্ট ও মাল্টি-এজেন্ট
LlamaIndex
run-llama/llama_index
LlamaIndex is an open-source Python data framework for building LLM applications with private data, offering data connectors, indexing structures, and advanced retrieval interfaces. It is complemented by LlamaParse, an enterprise platform for agentic OCR, parsing, extraction, and indexing.
★ 51.4K⑂ 7.9KPython
RAG ও জ্ঞান সিস্টেম
milvus
milvus-io/milvus
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
★ 45.7K⑂ 4.2KGo
MCP ও টুল কলিং
AstrBot: Open-Source AI Agent Assistant & Development Framework
astrbotdevs/astrbot
AstrBot is an open-source, all-in-one AI agent chatbot platform and development framework that integrates mainstream instant messaging platforms, large language models, plugins, and agent capabilities for building production-ready conversational AI applications.
★ 38.5K⑂ 2.7KPython
পৃষ্ঠা 2 / 22 · 253টি প্রজেক্ট