Skip to main content
Scrape Do logo
  • Category: web scraping & browser
  • Auth: API_KEY
  • Composio-managed OAuth available? N/A
  • Tools: 16
  • Triggers: 0
  • Slug: SCRAPE_DO
  • Version: 20261101_00

Tools

Slug: SCRAPE_DO_CANCEL_ASYNC_JOBTool to cancel an asynchronous scraping job. Use when you need to stop processing of pending tasks in a job. Completed tasks remain available.

Input Parameters

string
required
Authentication token for Scrape.do API
string
required
Unique identifier of the job to cancel

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_CREATE_ASYNC_JOBTool to create an asynchronous scraping job with specified targets and options. Use when you need to scrape multiple URLs in parallel without waiting for results. Returns a job ID immediately for polling results later via the get job status action.

Input Parameters

string
HTTP request body for POST/PUT/PATCH requests
boolean
Use residential/mobile proxy networks (default: false)
string ("desktop" | "mobile" | "tablet")
Device types for scraping emulation.
string ("GET" | "POST" | "PUT" | "PATCH" | "HEAD" | "DELETE")
HTTP methods for async scraping requests.
string ("raw" | "markdown")
Output format for scraped content.
object
Options for headless browser rendering.
string
Country code for geo-targeting (e.g., ‘us’, ‘gb’, ‘de’)
object
Custom HTTP headers to send with requests
array
required
Array of target URLs to scrape. Each URL will be processed asynchronously.
integer
Total request timeout in milliseconds (default: 60000)
string
Sticky session ID to reuse same IP address across requests
string
Cookies to include with the request
string
Webhook URL to send results to when job completes
boolean
Disable automatic retry mechanism (default: false)
integer
Retry timeout per request in milliseconds (default: 15000)
boolean
Use only provided headers, discard default headers (default: false)
object
Additional headers to send with webhook notification
string
Regional code for more specific geo-targeting
boolean
Disable following HTTP redirects (default: false)
boolean
Return raw target website response without processing (default: false)

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_GET_ACCOUNT_INFORetrieves account information and usage statistics from Scrape.do. This action makes a GET request to the Scrape.do info endpoint to fetch: - Subscription status - Concurrent request limits and usage - Monthly request limits and remaining requests - Real-time usage statistics Rate limit: Maximum 10 requests per minute. Use remaining request counts to monitor credits proactively, as different scraping operations (e.g., rendered-page requests) consume varying credit amounts and exhaustion mid-run causes failures.

Input Parameters

string
required
Authentication token for Scrape.do API

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_GET_AMAZON_OFFERSGet all seller offers for any Amazon product. Retrieves every seller listing including pricing, shipping costs, seller information, and Buy Box status in structured JSON format. Use when you need to compare prices across multiple sellers or find the best deal for a specific product.

Input Parameters

string
required
Amazon Standard Identification Number (10-character product ID)
string
required
Country code for Amazon marketplace (e.g., us, gb, de, jp, fr, es, it, ca)
string
required
Postal/ZIP code formatted according to country requirements
boolean
Enable residential/mobile proxies for higher success rates. Costs 10x credits
boolean
When true, includes the full raw HTML alongside structured JSON

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_GET_AMAZON_PRODUCTExtract structured product data from Amazon product detail pages (PDP). Returns comprehensive product information including title, pricing, ratings, images, best seller rankings, and technical specifications in JSON format.

Input Parameters

string
required
Amazon Standard Identification Number (10-character product ID)
string
required
Country code (e.g., us, gb, de, jp, fr, ca)
string
required
Postal code formatted according to country requirements
string
Language code in ISO 639-1 format (e.g., EN, DE, FR)
boolean
Enable residential/mobile proxies for higher success rates. Costs 10x credits
boolean
When true, includes the full raw HTML alongside structured JSON

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_GET_AMAZON_RAW_HTMLTool to get raw HTML from any Amazon page with ZIP code geo-targeting. Use when you need complete unprocessed HTML source from Amazon URLs with location-based targeting. Ideal for scraping pages not covered by other structured endpoints.

Input Parameters

string
required
Full Amazon URL to scrape (e.g., https://www.amazon.com/dp/B08N5WRWNW)
boolean
Enable residential/mobile proxies for higher success rates. Costs 10x credits. Default is false.
string
Output format - must be ‘html’ for raw HTML content
string
required
Country code for geo-targeting (e.g., us, gb, de, jp)
integer
Request timeout in milliseconds
string
required
Postal code formatted according to country requirements (e.g., 10001 for US, SW1A 1AA for UK)
string
Language code in ISO 639-1 format (e.g., EN, DE, FR, ES)

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_GET_ASYNC_ACCOUNT_INFOTool to get account information for the Async API including concurrency limits and usage statistics. Use when you need to check available concurrency slots, active jobs, or remaining credits for Async API operations.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_GET_ASYNC_JOBTool to retrieve details and status of a specific asynchronous scraping job. Use when you need to check the progress, status, or results of a previously created async job. Returns job metadata including creation time, completion time, task counts, and detailed task list.

Input Parameters

string
required
Unique identifier of the job to retrieve

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_GET_ASYNC_TASKTool to retrieve the result of a specific task within an asynchronous job. Returns the scraped content for that particular URL. Use when you need to check the status and result of a previously submitted async scraping task.

Input Parameters

string
required
Authentication token for Scrape.do API
string
required
Unique identifier of the job
string
required
Unique identifier of the task within the job

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_GET_PAGEA tool to scrape web pages using scrape.do’s API service. Makes a basic GET request to fetch webpage content while handling anti-bot protections and proxy rotation automatically. Does not execute JavaScript by default — pages requiring client-side rendering (SPAs, dynamically loaded content) will return incomplete HTML; use SCRAPE_DO_GET_RENDER_PAGE or set render=true for those cases.

Input Parameters

string
required
Target web page URL to scrape
boolean
Use residential & mobile proxy networks
integer
Browser viewport width (requires render=true)
string ("desktop" | "mobile" | "tablet")
Specify device type (desktop, mobile, tablet)
integer
Browser viewport height (requires render=true)
string ("raw" | "markdown")
Output format (raw or markdown)
boolean
Enable headless browser rendering Use for JS-heavy pages, SPAs, or sites with anti-bot JS challenges. Increase timeout when enabling to ensure full page load before cutoff.
integer
Maximum request timeout in ms (5000-120000)
string
Choose country for target web page (e.g. ‘us’, ‘gb’)
boolean
Return network requests in JSON format
string
Set cookies for target web page
boolean
Add/modify headers
integer
Maximum retry timeout in ms (5000-55000). Cannot be used with render=true
boolean
Handle all request headers
boolean
Block CSS and image sources
boolean
Disable request redirection

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_LIST_ASYNC_JOBSTool to list all asynchronous scraping jobs. Returns paginated list of jobs with their status and metadata. Use when you need to retrieve job history or monitor job statuses. Supports pagination with up to 100 jobs per page.

Input Parameters

integer
Page number for pagination (default: 1, minimum: 1)
integer
Number of jobs per page (default: 10, maximum: 100)

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_PROXY_MODEThis tool implements the Proxy Mode functionality of scrape.do, which allows routing requests through their proxy server. It provides an alternative way to access web scraping capabilities by handling complex JavaScript-rendered pages, geolocation-based routing, device simulation, and built-in anti-bot and retry mechanisms.

Input Parameters

string
required
The target URL to scrape
string
Device type to simulate (desktop, mobile, tablet)
boolean
Enable/disable JavaScript rendering
string
Geographic location for the request (e.g., ‘us’, ‘uk’)
boolean
Whether to forward custom headers to the target website

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_SCRAPE_URL_POSTScrape a target URL using a POST request through Scrape.do, with an optional request body and options for rendering, location, proxy mode, device, session, timeout, headers and cookies.

Input Parameters

string
required
Target web page URL to scrape with POST request
string
HTTP request body for POST request. Can be JSON string, form data, or plain text
boolean
Enable residential/mobile proxies. Costs 10x credits
string ("desktop" | "mobile" | "tablet")
Device types for scraping emulation.
boolean
Enable JavaScript rendering with headless browser
string
Country code for geo-targeting (e.g. ‘us’, ‘gb’, ‘de’)
integer
Total request timeout in milliseconds (5000-120000)
string
Sticky session ID to reuse same IP address across multiple requests
string
Cookies to include with the request (format: key1=value1; key2=value2)
boolean
Enable sending custom headers with the request

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_SEARCH_AMAZONTool to search Amazon and scrape product listings with structured results. Performs keyword searches and returns structured product data including titles, prices, ratings, Prime status, sponsored flags, and position rankings in JSON format. Use when you need to search for products on Amazon marketplace or gather product information from search results.

Input Parameters

integer
Page number for pagination (default: 1)
boolean
Enable residential/mobile proxies for higher success rates. Costs 10x credits (default: false)
string
required
Country code for Amazon marketplace (e.g., us, gb, de, jp, ca, fr, it, es, in)
string
required
Search query term (will be URL-encoded automatically)
string
required
Postal/ZIP code formatted according to country requirements (e.g., 10001 for US, SW1A 1AA for UK)
string
Language code in ISO 639-1 format (e.g., EN, DE, FR, ES)
boolean
When true, includes the full raw HTML alongside structured JSON (default: false)

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_SET_BLOCK_URLSValidate a nonempty list of URL patterns and return them in a success response. This action does not configure URL blocking or apply the patterns to scraping requests.

Input Parameters

array
required
List of URL patterns to block during scraping. Can be full URLs or patterns.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPE_DO_SET_REGIONAL_GEO_CODERequest a target URL with regional geographic targeting and super mode enabled. The action expects a JSON response containing status and message; it does not save a regional setting for later requests.

Input Parameters

string
required
The target URL to scrape with the specified regional geo code
string ("europe" | "asia" | "africa" | "oceania" | "northamerica" | "southamerica")
required
The region code to target for scraping requests

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not