ToolAI.io · GitHub Channel

Open-source AI Projects on GitHub

A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.

Popular tags Agent LLM RAG MCP Coding Inference Tool calling Embeddings Vector database Multimodal Fine-tuning Evaluation Open source Self-hosted Python TypeScript Rust Voice Vision Workflow

Public repository data

Project index

16 projects
Evaluation, Observability & Safety

OpenLIT

openlit/openlit

OpenTelemetry-native observability and evaluation tools for LLM applications and AI infrastructure.

★ 2.8K⑂ 423Python
Apache-2.0Q84
Evaluation, Observability & Safety

open_spiel

google-deepmind/open_spiel

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

★ 5.4K⑂ 1.2KC++
Apache-2.0Q83
Screenshot of evals — Model evaluation framework
Evaluation, Observability & Safety

evals — Model evaluation framework

openai/evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks

★ 19.2K⑂ 3.1KPython
NOASSERTIONQ82

Page 2 / 2 · 16 projects

Recently updated

ComfyUIComfy-Org/ComfyUI★ 136.7K CrewAICrewAIInc/crewAI★ 59.5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K TRLhuggingface/trl★ 19.5K mcp-usemcp-use/mcp-use★ 10.7K OpenLITopenlit/openlit★ 2.8K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K