RAG 및 지식 시스템
EvalScope
modelscope/evalscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
★ 3.2K⑂ 440Python
ToolAI.io · GitHub 채널
GitHub의 새로운 AI 프로젝트
GitHub에서 새로 추가된 오픈 소스 AI 프로젝트를 살펴보고, 저장소 정보, 설정 안내, 라이선스 및 관련 리소스를 확인하세요.
공개 리포지토리 데이터
프로젝트 색인
에이전트 및 멀티 에이전트
TruLens: Evaluation and Tracking for LLM Experiments and AI Agents
truera/trulens
TruLens is an open-source, OpenTelemetry-native evaluation and tracking library for LLM applications and AI agents, enabling developers to trace every step, score performance with LLM judges, and compare app versions.
★ 3.5K⑂ 319Python
에이전트 및 멀티 에이전트
BISHENG
dataelement/bisheng
BISHENG is an open-source LLM application DevOps platform designed for next-generation enterprise AI applications, offering comprehensive features like GenAI workflow orchestration, RAG, Agent management, and enterprise-grade system controls.
★ 11.8K⑂ 1.9KPython
에이전트 및 멀티 에이전트
promptfoo
promptfoo/promptfoo
An open-source CLI and library for evaluating, testing, and red-teaming LLM applications, RAGs, and agents. It enables side-by-side model comparison and vulnerability scanning with declarative configs and CI/CD integration.
★ 23.9K⑂ 2.2KTypeScript
에이전트 및 멀티 에이전트
Opik: Open-Source LLM Observability, Evaluation and Agent Tracing
comet-ml/opik
Opik is an Apache-2.0-licensed platform for tracing, evaluating, debugging and monitoring LLM applications, RAG systems and multi-step agent workflows. It supports self-hosting, a hosted Comet.com option, client SDKs, a REST API, automated evaluations, prompt experimentation and production dashboards.
★ 21.1K⑂ 1.7KPython
에이전트 및 멀티 에이전트
Giskard OSS: Evaluation, Red Teaming and Test Generation for AI Agents
giskard-ai/giskard-oss
An open-source Python library for evaluating and testing LLM-based and agentic systems, including multi-turn evaluations, LLM-as-judge checks and automated vulnerability scanning.
★ 5.7K⑂ 513Python
에이전트 및 멀티 에이전트
LangWatch
langwatch/langwatch
An open-core platform for evaluating, testing, tracing, and monitoring LLM applications and AI agents before release and in production.
★ 3.5K⑂ 345TypeScript
평가, 옵저버빌리티 및 안전
garak — LLM vulnerability scanning
NVIDIA/garak
the LLM vulnerability scanner
★ 8.8K⑂ 1.2KPython
평가, 옵저버빌리티 및 안전
evals — Model evaluation framework
openai/evals
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks
★ 19.2K⑂ 3.1KPython