Оценка, наблюдаемость и безопасность
OpenLIT
openlit/openlit
OpenTelemetry-native observability and evaluation tools for LLM applications and AI infrastructure.
★ 2,8K⑂ 423Python
ToolAI.io · Канал GitHub
Популярные AI-проекты на GitHub
Отслеживайте активные AI-репозитории с открытым исходным кодом по темам LLM, агентов, MCP, RAG и программирования, с количеством звёзд и проверенными сведениями о проектах.
Данные публичного репозитория
Индекс проекта
Оценка, наблюдаемость и безопасность
strix
usestrix/strix
An AI-assisted vulnerability discovery tool for authorized application security testing.
★ 60,6K⑂ 6,6KPython
Оценка, наблюдаемость и безопасность
netdata
netdata/netdata
Real-time system and application monitoring with AI-assisted operational analysis.
★ 80,4K⑂ 6,6KGo
Дообучение, обучение и данные
scikit-learn
scikit-learn/scikit-learn
A Python machine learning library for classification, regression, clustering and model evaluation.
★ 67,2K⑂ 27,4KPython
Оценка, наблюдаемость и безопасность
garak — LLM vulnerability scanning
NVIDIA/garak
the LLM vulnerability scanner
★ 8,9K⑂ 1,2KPython
Агенты и мультиагенты
LangWatch
langwatch/langwatch
An open-core platform for evaluating, testing, tracing, and monitoring LLM applications and AI agents before release and in production.
★ 3,5K⑂ 345TypeScript
Агенты и мультиагенты
TruLens: Evaluation and Tracking for LLM Experiments and AI Agents
truera/trulens
TruLens is an open-source, OpenTelemetry-native evaluation and tracking library for LLM applications and AI agents, enabling developers to trace every step, score performance with LLM judges, and compare app versions.
★ 3,5K⑂ 319Python
RAG и системы знаний
EvalScope
modelscope/evalscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
★ 3,2K⑂ 440Python
Агенты и мультиагенты
BISHENG
dataelement/bisheng
BISHENG is an open-source LLM application DevOps platform designed for next-generation enterprise AI applications, offering comprehensive features like GenAI workflow orchestration, RAG, Agent management, and enterprise-grade system controls.
★ 11,8K⑂ 1,9KPython
Агенты и мультиагенты
promptfoo
promptfoo/promptfoo
An open-source CLI and library for evaluating, testing, and red-teaming LLM applications, RAGs, and agents. It enables side-by-side model comparison and vulnerability scanning with declarative configs and CI/CD integration.
★ 23,9K⑂ 2,2KTypeScript
Агенты и мультиагенты
Opik: Open-Source LLM Observability, Evaluation and Agent Tracing
comet-ml/opik
Opik is an Apache-2.0-licensed platform for tracing, evaluating, debugging and monitoring LLM applications, RAG systems and multi-step agent workflows. It supports self-hosting, a hosted Comet.com option, client SDKs, a REST API, automated evaluations, prompt experimentation and production dashboards.
★ 21,1K⑂ 1,7KPython
Агенты и мультиагенты
Giskard OSS: Evaluation, Red Teaming and Test Generation for AI Agents
giskard-ai/giskard-oss
An open-source Python library for evaluating and testing LLM-based and agentic systems, including multi-turn evaluations, LLM-as-judge checks and automated vulnerability scanning.
★ 5,7K⑂ 513Python
Страница 1 / 2 · 16 проектов