Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.duvo.ai/llms.txt

Use this file to discover all available pages before exploring further.

Firecrawl connects web crawling and scraping capabilities to Duvo, enabling your assignments to extract structured data from websites at scale. Instead of manual copy-paste work or custom scraping scripts, your assignments can automatically navigate, scrape, and organize web content as part of any workflow.

​
Setup

Click Enable on the Connections page and enter your Firecrawl API key. You can generate an API key from your Firecrawl dashboard.
Note: Duvo also includes a built-in Web Scraper connection that provides web scraping capabilities with no setup required. Use this Firecrawl connection only if you need to use your own Firecrawl account.

​
Capabilities

  • Crawl websites — Navigate through multiple pages of a website systematically, following links to gather content across an entire site or section.
  • Scrape web pages — Extract text, data, and structured content from individual pages, handling dynamic content and complex page structures.
  • Extract structured data — Pull specific data points from web pages and return them in an organized format ready for downstream processing.

​
Key Benefits

  • Scale web data collection — Gather data from hundreds of pages without manual browsing, replacing tedious copy-paste workflows.
  • Get clean, structured output — Receive organized data instead of raw HTML, ready to feed into analysis or reporting steps.
  • Handle complex sites reliably — Purpose-built infrastructure manages dynamic pages, JavaScript rendering, and complex site structures.
  • Integrate into end-to-end workflows — Feed scraped data directly into downstream steps like spreadsheet updates, email summaries, or team notifications.

​
Works Well With

  • Google Sheets or Microsoft Excel — Scrape web data and write it directly into spreadsheets for tracking, analysis, or reporting.
  • Gmail or Microsoft Outlook — Crawl websites for updates and send summary emails when changes are detected.
  • Slack — Scrape competitor or market data and post automated alerts to relevant team channels.