# Firecrawl

Firecrawl connects web crawling and scraping capabilities to Duvo, enabling your assignments to extract structured data from websites at scale. Instead of manual copy-paste work or custom scraping scripts, your assignments can automatically navigate, scrape, and organize web content as part of any workflow.

## Setup

Click **Enable** on the [Connections page](https://app.duvo.ai/integrations) and enter your Firecrawl API key. You can generate an API key from your [Firecrawl dashboard](https://www.firecrawl.dev/app).

> **Note:** Duvo also includes a built-in [Web Scraper](https://docs.duvo.ai/connections/available-connections/web-scraper) connection that provides web scraping capabilities with no setup required. Use this Firecrawl connection only if you need to use your own Firecrawl account.

## Capabilities

* **Crawl websites** — Navigate through multiple pages of a website systematically, following links to gather content across an entire site or section.
* **Scrape web pages** — Extract text, data, and structured content from individual pages, handling dynamic content and complex page structures.
* **Extract structured data** — Pull specific data points from web pages and return them in an organized format ready for downstream processing.

## Key Benefits

* **Scale web data collection** — Gather data from hundreds of pages without manual browsing, replacing tedious copy-paste workflows.
* **Get clean, structured output** — Receive organized data instead of raw HTML, ready to feed into analysis or reporting steps.
* **Handle complex sites reliably** — Purpose-built infrastructure manages dynamic pages, JavaScript rendering, and complex site structures.
* **Integrate into end-to-end workflows** — Feed scraped data directly into downstream steps like spreadsheet updates, email summaries, or team notifications.

## Works Well With

* **Google Sheets or Microsoft Excel** — Scrape web data and write it directly into spreadsheets for tracking, analysis, or reporting.
* **Gmail or Microsoft Outlook** — Crawl websites for updates and send summary emails when changes are detected.
* **Slack** — Scrape competitor or market data and post automated alerts to relevant team channels.