ToolAI.io · GitHub Channel

Inference, Deployment & Runtime · Open-source AI Projects on GitHub

A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.

Popular tags Agent LLM RAG MCP Coding Inference Tool calling Embeddings Vector database Multimodal Fine-tuning Evaluation Open source Self-hosted Python TypeScript Rust Voice Vision Workflow

Public repository data

Project index

1 projects
Screenshot of hal0
Inference, Deployment & Runtime

hal0

hal0ai/hal0

An open-source, self-hosted home AI inference platform designed to turn a Linux box into an OpenAI-compatible inference appliance, with native optimization for AMD Strix Halo hardware.

★ 67⑂ 7Python
Apache-2.0Q89

Recently updated

codex — Coding agent and developer workflowsopenai/codex★ 106.5K NemoClaw — Agent runtime and deployment toolingNVIDIA/NemoClaw★ 22.2K XERJxerj-org/xerj★ 1.4K LangWatchlangwatch/langwatch★ 3.5K OrchestKityonatangross/orchestkit★ 222 hal0hal0ai/hal0★ 67

Most starred

Hermes Agentnousresearch/hermes-agent★ 227.1K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.2K skills — Reusable agent skills and workflowsanthropics/skills★ 169.9K Hugging Face Transformershuggingface/transformers★ 163.3K Firecrawlfirecrawl/firecrawl★ 161.1K LangChainlangchain-ai/langchain★ 143.6K