# Web Scraper

The Web Scraper connection lets your assignments scrape, crawl, and extract structured data from websites. Use it to pull content from individual pages or crawl entire sites, feeding live web data into your automated workflows.

## Setup

No setup is needed. The Web Scraper connection is automatically available to all assignments.

## Capabilities

* **Scrape web pages** — Extract text, tables, structured content, or screenshots from any publicly accessible URL, including JavaScript-rendered pages.
* **Crawl websites** — Follow links across multiple pages to gather data from an entire site or section.
* **Extract structured data** — Pull specific data points such as product listings, pricing tables, or contact details from one or more pages in a single operation.
* **Discover URLs** — Map a website's structure to find relevant page URLs before scraping, useful for large sites where the exact page location is unknown.

## Key Benefits

* **Live web data on demand** — Access current information from websites without manual copy-paste or browser work.
* **Scale across pages** — Crawl dozens or hundreds of pages in a single job, far faster than manual collection.
* **Structured output** — Get clean, organized data ready for spreadsheets, CRMs, or further analysis.
* **No credentials required** — Works out of the box with publicly accessible sites, so you can start scraping immediately.

## Works Well With

* **Deep Research** — Use Web Scraper to pull raw content from specific pages, then hand it to Deep Research for synthesis and a structured summary.
* **Google Sheets or Microsoft Excel** — Write scraped data directly into a spreadsheet for reporting, comparison, or sharing with your team.
* **HubSpot or Attio** — Feed company or contact data extracted from websites into your CRM to keep records current without manual data entry.