ToolAI.io · GitHub Channel

AI Project Directory on GitHub

Browse the complete ToolAI directory of open-source AI projects on GitHub, organized by topic, language and license.

Public repository data

Project index

16 projects
Evaluation, Observability & Safety

OpenLIT

openlit/openlit

OpenTelemetry-native observability and evaluation tools for LLM applications and AI infrastructure.

★ 2.8K⑂ 423Python
Apache-2.0Q84
Evaluation, Observability & Safety

open_spiel

google-deepmind/open_spiel

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

★ 5.4K⑂ 1.2KC++
Apache-2.0Q83
Screenshot of evals — Model evaluation framework
Evaluation, Observability & Safety

evals — Model evaluation framework

openai/evals

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks

★ 19.2K⑂ 3.1KPython
NOASSERTIONQ82

Page 2 / 2 · 16 projects

Recently updated

ComfyUIComfy-Org/ComfyUI★ 136.7K CrewAICrewAIInc/crewAI★ 59.5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K TRLhuggingface/trl★ 19.5K mcp-usemcp-use/mcp-use★ 10.7K OpenLITopenlit/openlit★ 2.8K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K