ToolAI.io · GitHub Channel
Browse the complete ToolAI directory of open-source AI projects on GitHub, organized by topic, language and license.
Public repository data
promptfoo/promptfoo
An open-source CLI and library for evaluating, testing, and red-teaming LLM applications, RAGs, and agents. It enables side-by-side model comparison and vulnerability scanning with declarative configs and CI/CD integration.
comet-ml/opik
Opik is an Apache-2.0-licensed platform for tracing, evaluating, debugging and monitoring LLM applications, RAG systems and multi-step agent workflows. It supports self-hosting, a hosted Comet.com option, client SDKs, a REST API, automated evaluations, prompt experimentation and production dashboards.
NVIDIA/SkillSpector
Security scanner for AI agent skills. Detect vulnerabilities, malicious patterns, and security risks.
dataelement/bisheng
BISHENG is an open-source LLM application DevOps platform designed for next-generation enterprise AI applications, offering comprehensive features like GenAI workflow orchestration, RAG, Agent management, and enterprise-grade system controls.
giskard-ai/giskard-oss
An open-source Python library for evaluating and testing LLM-based and agentic systems, including multi-turn evaluations, LLM-as-judge checks and automated vulnerability scanning.
langwatch/langwatch
An open-core platform for evaluating, testing, tracing, and monitoring LLM applications and AI agents before release and in production.
truera/trulens
TruLens is an open-source, OpenTelemetry-native evaluation and tracking library for LLM applications and AI agents, enabling developers to trace every step, score performance with LLM judges, and compare app versions.
modelscope/evalscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
anthropics/claude-cookbooks
Anthropic’s collection of Claude development examples covers classification, summarization, retrieval augmentation, tool use, image understanding, and evaluation. It is suitable for learning from specific tasks and adapting the code.
netdata/netdata
Real-time system and application monitoring with AI-assisted operational analysis.
scikit-learn/scikit-learn
A Python machine learning library for classification, regression, clustering and model evaluation.
usestrix/strix
An AI-assisted vulnerability discovery tool for authorized application security testing.
Page 1 / 2 · 15 projects
