ToolAI.io · GitHub Channel

Evaluation, Observability & Safety · Open-source AI Projects on GitHub

A fact-based index of LLM, agent, MCP, RAG and AI development projects, with license, setup, download, screenshots and related resources for each entry.

Popular tags Agent LLM RAG MCP Coding Inference Tool calling Embeddings Vector database Multimodal Fine-tuning Evaluation Open source Self-hosted Python TypeScript Rust Voice Vision Workflow

Public repository data

Project index

2 projects
Evaluation, Observability & Safety

SkillSpector

NVIDIA/SkillSpector

Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, and security risks.

★ 13.8K⑂ 1.1KPython
Apache-2.0Q98
Evaluation, Observability & Safety

strix

usestrix/strix

An AI-assisted vulnerability discovery tool for authorized application security testing.

★ 60.6K⑂ 6.6KPython
Apache-2.0Q90

Recently updated

TypeSafe Python SDKtypesafe-ai/typesafe-sdk-python★ 218 TypeSafe JavaScript SDKtypesafe-ai/typesafe-sdk-js★ 231 TypeSafe Agent Skillstypesafe-ai/skills★ 2K cherry-studioCherryHQ/cherry-studio★ 51.5K onyxonyx-dot-app/onyx★ 32K siyuansiyuan-note/siyuan★ 46.2K

Most starred

ECCaffaan-m/ECC★ 248.8K Hermes Agentnousresearch/hermes-agent★ 227.1K tensorflowtensorflow/tensorflow★ 198.8K AutoGPTSignificant-Gravitas/AutoGPT★ 187.1K ollamaollama/ollama★ 180.2K markitdown — Document conversion and extractionmicrosoft/markitdown★ 174.9K