---
title: "WebCrawlerAPI integration | Growf"
description: "WebCrawlerAPI provides crawling, page scraping, AI web agents, and monitored website feeds through a unified API. Connect WebCrawlerAPI to Growf."
url: "https://www.growf.io/integrations/webcrawlerapi/"
language: "en"
---

Integration / Developer Tools & DevOps

![WebCrawlerAPI logo](https://logos.composio.dev/api/webcrawlerapi)

# WebCrawlerAPI integration

WebCrawlerAPI provides crawling, page scraping, AI web agents, and monitored website feeds through a unified API.

[Get a demo](https://www.growf.io/demo/)

About WebCrawlerAPI

## WebCrawlerAPI is a unified API for crawling websites, scraping pages, running AI web agents, and monitoring website feeds. It helps you extract fresh web data without building crawler infrastructure yourself.

[All integrations](https://www.growf.io/integrations/)

Category

Developer Tools & DevOps, AI & Machine Learning

Connection

API key

Type

Tool

Actions

1499

Tags

library

Example prompts

## What you can ask Growf to do with WebCrawlerAPI

- “Scrape competitor pricing pages weekly”

- “Crawl documentation and extract broken links”

- “Monitor product pages for content changes”

Available actions

## 1499 actions your agents can run in WebCrawlerAPI

- Create Crawl  
Start a metered asynchronous crawl over a site and return its job ID. The crawl may visit and charge for up to items\_limit pages; use GET\_CRAWL\_JOB to monitor it.
- Create Feed  
Create a recurring website-change feed. Creation immediately schedules an initial crawl that may consume metered credits, and future scheduled runs may also consume credits; delete the feed when it is no longer needed.
- Delete Feed  
Permanently cancel a feed so it cannot be resumed. The feed is removed from feed listings, but retained history may remain directly readable for 30 days.
- Get Crawl Job  
Get a crawl job's status, configuration, per-page results, content URLs, errors, and observed costs. Respect recommended\_pull\_delay\_ms when polling.
- Get Feed  
Get one feed's configuration, lifecycle status, and recent run history, including per-run crawl counts and cost. Canceled feeds remain directly readable while retained by the provider.
- Get Organization Costs  
Return current spendable balance plus request count and USD usage for a date range. The connected API key is used for both organization routes.
- List Feed Changes  
Return one page of detected feed changes as structured JSON, with an opaque continuation cursor for older pages.
- List Feeds  
List active and paused feeds for the connected organization, newest first. Logically canceled feeds are omitted.
- Scrape Page  
Scrape one web page synchronously and return requested content or structured extraction. This consumes metered credits; supplying a prompt adds $0.002 per request.
- Set Feed State  
Pause an active feed's future scheduled runs or resume a paused feed. Pausing does not stop a run that has already started, and resuming schedules future crawls that may consume metered credits.

## Put WebCrawlerAPI to work inside Growf.

Connect it once and every workspace, agent and workflow can use it — securely, with your team in the loop.

[Get a demo](https://www.growf.io/demo/)