Agen & Multi-Agen

Future AGI

future-agi/future-agi

An open-source, self-hostable platform for evaluating, tracing, simulating, protecting, routing, and optimizing LLM and AI-agent applications.

★ 1,7KBintang
⑂ 497Fork
684Isu terbuka
PythonBahasa
Apache-2.0Lisensi
Q@project.QualityScoreSkor editorial

Ringkasan

Future AGI combines OpenTelemetry-based observability, evaluation metrics, agent simulations, datasets, guardrails, prompt optimization, and an OpenAI-compatible gateway. It can run as a managed cloud service or as a self-hosted stack. The repository metadata lists Python as the primary language, while the documented runtime also includes a Go gateway, a React/Vite frontend, and supporting data services.

Fitur utama

  • OpenTelemetry-native tracing with instrumentation for more than 50 AI frameworks
  • More than 50 evaluation metrics using LLM-as-judge, heuristic, and machine-learning approaches
  • Persona-driven, adversarial, edge-case, text, and voice simulations
  • 18 built-in guardrail scanners and 15 vendor adapters
  • OpenAI-compatible gateway supporting more than 100 providers and 15 routing strategies
  • Prompt optimization with six documented algorithms
  • Datasets, experiments, dashboards, annotation queues, and prompt management
  • Managed cloud and Docker-based self-hosting options
  • Interfaces based on OpenTelemetry OTLP, OpenAI-compatible HTTP, and SQL storage

Persyaratan, instalasi, dan mulai cepat

Cloud use requires no platform installation; the README shows `pip install ai-evaluation` for the evaluation package. For self-hosting on macOS, Linux, or WSL: `git clone https://github.com/future-agi/future-agi.git`, `cd future-agi`, then `./bin/install`. On Windows PowerShell, run the same clone and directory commands followed by `.\bin\install.ps1`. Open `http://localhost:3000` after startup. For production Compose deployment, the README directs users to `./deploy/setup.sh` to generate secrets, pin image versions, pull images, and start the stack.

Penggunaan

After deployment, register an instrumentation project and enable the relevant framework instrumentor around existing application code. The README demonstrates Python with `fi_instrumentation` and `traceai_openai`, and TypeScript with `@traceai/fi-core` and `@traceai/openai`. Existing OpenAI chat-completion calls are then traced. Evaluations, simulations, monitoring, protection, gateway routing, datasets, and optimization are accessed through the platform and its independently packaged SDKs. Detailed usage documentation is available at https://docs.futureagi.com.

Kompatibilitas model dan kasus penggunaan

The repository describes an OpenAI-compatible gateway with support for more than 100 providers. Named integrations include OpenAI, Anthropic, Google Gemini, Vertex AI, AWS Bedrock, Azure OpenAI, Mistral, Groq, Cohere, Together, Perplexity, OpenRouter, Fireworks, xAI, Replicate, HuggingFace, Ollama, vLLM, LM Studio, TGI, and Llamafile. Framework integrations include LangChain, LangGraph, LlamaIndex, CrewAI, AutoGen, Phidata, PydanticAI, Claude SDK, LiteLLM, Haystack, DSPy, Instructor, and Smol-agents. Exact compatibility by model version is not stated in the repository metadata.

Catatan lisensi dan risiko

The repository metadata identifies the project license as Apache-2.0, and the README points to LICENSE and NOTICE. The README separately says ecosystem SDKs may be Apache- or MIT-licensed, so each independently packaged SDK should be checked before use.

Rilis dan pemeliharaan

The supplied README describes a nightly release for early testing and says a stable version is coming soon. Recently shipped items include a prompt optimization engine, feed clustering, dataset experiment agent runs, simulations from production calls, an agent playground, dashboards, MCP access, annotation queues, and the Agent Command Center. In-progress or planned work includes fuller agent tracing, multimodal support, agent changelog views, queue assignment, computer-use and coding-agent simulations, and scheduled simulations. Specific release version and release date are not stated in the repository metadata.

Firecrawl

firecrawl/firecrawl

★ 161,1KTypeScript

LangChain

langchain-ai/langchain

★ 143,6KPython

RAGFlow

infiniflow/ragflow

★ 86,7KGo