Inference, Deployment & Runtime
tiktoken — Fast tokenization
openai/tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models
★ 19K⑂ 1.6KRust
ToolAI.io · GitHub Channel
Open-source AI Projects on GitHub
A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.
Featured
Browse list →markitdown — Document conversion and extraction
Python tool for converting files and office documents to Markdown
★ 174.9K · Pythonskills — Reusable agent skills and workflows
Public repository for Agent Skills
★ 170.6K · Markdownclaude-code — Agentic coding in the terminal
Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflows - all through natural language commands
★ 142.1K · TypeScriptwhisper — Speech recognition and transcription
Robust Speech Recognition via Large-Scale Weak Supervision
★ 107.7K · PythonDeepSeek-V3 — Large language model research and inference
An open-source project focused on large language model research and inference.
★ 104.4K · PythonDeepSeek-R1 — Reasoning model research and evaluation
An open-source project focused on reasoning model research and evaluation.
★ 92K · PythonHermes Agent
A self-improving AI agent built by Nous Research that features a closed learning loop, multi-platform messaging integration, and flexible model provider switching. It is designed to run on low-cost VPS, GPU clusters, or serverless infrastructure.
★ 227.1K · PythonHugging Face Transformers
A model-definition framework for state-of-the-art machine learning models across text, vision, audio, and multimodal domains, supporting both inference and training.
★ 163.3K · PythonFirecrawl
An open-source web context API to search, scrape, and interact with the web at scale, converting web data into clean Markdown or structured JSON for AI agents and LLMs.
★ 161.1K · TypeScript MCP & Tool CallingDify: Collaborative Platform for Agentic Workflows and RAG Applications
Dify is an LLM application development platform for visually building workflows, RAG pipelines, and tool-using agents. It combines model management, prompt development, observability, and application APIs in a collaborative workspace that can be used as a hosted service or self-hosted.
★ 151.2K · TypeScriptLangChain
An open-source Python framework for building LLM-powered applications and agents through interoperable, chainable components and third-party integrations.
★ 143.6K · PythonGraphify: Turn Any Codebase into a Queryable Knowledge Graph
Graphify is a local-first CLI tool and AI assistant skill that parses codebases, docs, SQL schemas, and PDFs into a queryable knowledge graph using deterministic AST parsing, eliminating the need for vector stores or embeddings.
★ 104K · PythonPublic repository data
Project index
Multimodal AI
Janus — Unified multimodal understanding and generation
deepseek-ai/Janus
Janus-Series: Unified Multimodal Understanding and Generation Models
★ 17.8K⑂ 2.2KPython
Fine-tuning, Training & Data
Megatron-LM
NVIDIA/Megatron-LM
Ongoing research training transformer models at scale
★ 17.2K⑂ 4.3KPython
Agents & Multi-Agent
Qwen-Agent — Tool-using and RAG agents
QwenLM/Qwen-Agent
Agent framework and applications built upon Qwen>=3.0, featuring Function Calling, MCP, Code Interpreter, RAG, Chrome extension, etc
★ 17K⑂ 1.7KPython
Agents & Multi-Agent
SkillOpt — Skill optimization for agents
microsoft/SkillOpt
SkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits, validation-gated updates, and deployable best_skill.md artifacts
★ 16.2K⑂ 1.5KPython
AI Coding & Developer Tools
openai-node
openai/openai-node
Official JavaScript / TypeScript library for the OpenAI API
★ 11.1K⑂ 1.5KTypeScript
AI Coding & Developer Tools
kimi-cli
MoonshotAI/kimi-cli
Kimi Code CLI is your next CLI agent.
★ 10.8K⑂ 1.3KPython
Agents & Multi-Agent
kimi-code
MoonshotAI/kimi-code
Kimi Code CLI — The Starting Point for Next-Gen Agents
★ 5.1K⑂ 742TypeScript
Inference, Deployment & Runtime
Model-Optimizer
NVIDIA/Model-Optimizer
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
★ 3.3K⑂ 513Python
Multimodal AI
HY-World-2.0
Tencent-Hunyuan/HY-World-2.0
HY-World 2.0: A Multi-Modal World Model for Reconstructing, Generating, and Simulating 3D Worlds
★ 2.4K⑂ 209Python
AI Coding & Developer Tools
PaddleScience
PaddlePaddle/PaddleScience
PaddleScience is SDK and library for developing AI-driven scientific computing applications based on PaddlePaddle.
★ 448⑂ 236Python
Agents & Multi-Agent
OpenGeni
cloudgeni-ai/opengeni
An open, self-hostable agentic runtime for organizations that provides durable, replayable agent sessions, human approvals, governed credentials and memory, and flexible compute targets including managed sandboxes and enrolled user hardware.
★ 56⑂ 5TypeScript
Page 17 / 22 · 253 projects