ToolAI.io · GitHub Channel

Evaluation, Observability & Safety · Open-source AI Projects on GitHub

A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.

Public repository data

Project index

3 projects
Evaluation, Observability & Safety

SkillSpector

NVIDIA/SkillSpector

Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, and security risks.

★ 13.8K⑂ 1.1KPython
Apache-2.0Q98
Evaluation, Observability & Safety

strix

usestrix/strix

An AI-assisted vulnerability discovery tool for authorized application security testing.

★ 60.6K⑂ 6.6KPython
Apache-2.0Q90
Evaluation, Observability & Safety

OpenLIT

openlit/openlit

OpenTelemetry-native observability and evaluation tools for LLM applications and AI infrastructure.

★ 2.8K⑂ 423Python
Apache-2.0Q84

Recently updated

Craft Anythingstorytold/craft-anything★ 27.4K elephant-goldfish-modelgoogle/elephant-goldfish-model★ 15.6K DeepInferdeepseek-ai/DeepInfer★ 25.7K ComfyUIComfy-Org/ComfyUI★ 136.7K CrewAICrewAIInc/crewAI★ 59.5K Microsoft Agent Frameworkmicrosoft/agent-framework★ 14K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K