ToolAI.io · GitHub Channel

Evaluation, Observability & Safety · Open-source AI Projects on GitHub

A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.

Popular tags Agent LLM RAG MCP Coding Inference Tool calling Embeddings Vector database Multimodal Fine-tuning Evaluation Open source Self-hosted Python TypeScript Rust Voice Vision Workflow

Public repository data

Project index

4 projects
Evaluation, Observability & Safety

SkillSpector

NVIDIA/SkillSpector

Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, and security risks.

★ 13.8K⑂ 1.1KPython
Apache-2.0Q98
Evaluation, Observability & Safety

netdata

netdata/netdata

Real-time system and application monitoring with AI-assisted operational analysis.

★ 80.4K⑂ 6.6KGo
GPL-3.0Q90
Evaluation, Observability & Safety

strix

usestrix/strix

An AI-assisted vulnerability discovery tool for authorized application security testing.

★ 60.6K⑂ 6.6KPython
Apache-2.0Q90
Evaluation, Observability & Safety

open_spiel

google-deepmind/open_spiel

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

★ 5.4K⑂ 1.2KC++
Apache-2.0Q83

Recently updated

TypeSafe Python SDKtypesafe-ai/typesafe-sdk-python★ 218 TypeSafe JavaScript SDKtypesafe-ai/typesafe-sdk-js★ 231 TypeSafe Agent Skillstypesafe-ai/skills★ 2K cherry-studioCherryHQ/cherry-studio★ 51.5K onyxonyx-dot-app/onyx★ 32K siyuansiyuan-note/siyuan★ 46.2K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K