Screenshot del progetto
Panoramica
Firecrawl provides a suite of APIs and SDKs designed to extract, structure, and interact with web data. It handles complex web scraping challenges such as JavaScript-rendered pages, proxy rotation, and rate limits. The platform offers core endpoints for searching, scraping, and interacting with pages, alongside advanced features like an autonomous AI agent for data gathering, website crawling, URL mapping, and batch scraping. It outputs LLM-ready formats like Markdown and structured JSON to facilitate integration with AI applications.
Funzionalità principali
- Web Search with full page content extraction
- Single page Scrape to Markdown, HTML, JSON, or screenshots
- Page Interact for clicking, scrolling, and writing via AI prompts
- Autonomous Agent for automated data gathering using natural language
- Website Crawl for scraping all URLs asynchronously
- URL Map for instant site discovery
- Batch Scrape for processing thousands of URLs
- LLM-ready output formats to reduce token usage
- Built-in handling of proxies, rate limits, and JS-blocked content
- Media parsing for web-hosted PDFs and DOCX files
Requisiti, installazione e avvio rapido
Node.js: npm install firecrawl
Go: go get github.com/firecrawl/firecrawl/apps/go-sdk
Ruby: gem install firecrawl-sdk
.NET: dotnet add package firecrawl-sdk
PHP: composer require firecrawl/firecrawl-sdk
Rust: Add firecrawl = "2" to Cargo.toml dependencies
Elixir: Add {:firecrawl, "~> 1.0" to deps
Java: Add 'com.github.firecrawl:firecrawl-java-sdk:2.0' via Gradle/Maven with JitPack
Utilizzo
Compatibilità del modello e casi d'uso
The Agent endpoint supports model selection between 'spark-1-mini' (default, lower cost) and 'spark-1-pro' (standard cost, for complex research and critical data gathering).
Note su licenza e rischi
The project is primarily licensed under the GNU Affero General Public License v3.0 (AGPL-3.0). The SDKs and some UI components are licensed under the MIT License.
Editorial verification 2026-08-09: repository URL, owner, description, license and repository statistics were reviewed. License metadata: AGPL-3.0. README was fetched for the channel draft; re-check repository dependencies, releases and model terms before production use.
Rilascio e manutenzione
Not stated in the repository metadata