- Category: web scraping & browser
- Auth: API_KEY
- Composio-managed OAuth available? N/A
- Tools: 12
- Triggers: 0
- Slug:
SCRAPFLY - Version: 20261101_00
Tools
Capture Website Screenshot
Capture Website Screenshot
Slug:
SCRAPFLY_CAPTURE_SCREENSHOTCapture a full-page, viewport, or selected-element screenshot of a website, with options such as custom resolution and dark mode. Returns a downloadable screenshot image.Input Parameters
Screenshot image format (jpg, png, webp, or gif). Default is jpg.
Area to capture: ‘viewport’ for visible area, ‘fullpage’ for entire page, or a CSS/XPath selector for a specific element. Default is viewport.
Proxy geolocation country code (e.g., ‘US’, ‘FR’, ‘DE’) to capture screenshot from that region.
Comma-separated screenshot options: ‘dark_mode’ for dark theme, ‘block_banners’ to hide cookie/privacy banners, ‘print_media_format’ for print styles.
Time to wait after page load before capturing screenshot, in milliseconds. Useful for waiting for dynamic content.
CSS selector or XPath to wait for before capturing. Screenshot is taken after this element appears.
Output
Capture Screenshot Metadata (HEAD)
Capture Screenshot Metadata (HEAD)
Slug:
SCRAPFLY_CAPTURE_SCREENSHOT_HEADTool to capture screenshot metadata without downloading the image body. Use this for async screenshot workflows where you need the URL to retrieve the image later. Returns the screenshot URL in response, saving bandwidth compared to full screenshot retrieval.Input Parameters
Capture area: ‘viewport’ for visible area, ‘fullpage’ for entire page, or a CSS selector/XPath for specific element.
Comma-separated flags: ‘dark_mode’ for dark theme, ‘block_banners’ to hide ads/popups, ‘print_media_format’ for print styles.
Accessibility simulation options for vision deficiency.
Output
Create Scrapfly Crawler
Create Scrapfly Crawler
Extract Structured Data
Extract Structured Data
Slug:
SCRAPFLY_EXTRACT_DATATool to extract structured data from HTML or other content using AI models, LLM prompts, or custom templates. Use when you need to parse web pages or documents into structured JSON data. Supports predefined extraction models for common types (articles, products, events) or custom extraction via prompts/templates.Input Parameters
Base URL for converting relative URLs to absolute URLs in the extracted data. Useful when extracting links and images.
Document charset encoding. Use ‘auto’ for automatic detection or specify a charset like ‘utf-8’, ‘iso-8859-1’, etc.
HTML, text, or structured content to extract data from. This will be sent as the request body.
string ("text/html" | "text/plain" | "text/markdown" | "text/csv" | "application/json" | "application/ld+json" | "application/xml" | "application/xhtml+xml")
required
Content type of the document body. Required to properly parse the input content.
Webhook name for asynchronous processing. If provided, the extraction will be processed asynchronously and results sent to the webhook.
string ("article" | "event" | "food_recipe" | "hotel" | "hotel_listing" | "job_listing" | "job_posting" | "organization" | "product" | "product_listing" | "real_estate_property" | "real_estate_property_listing" | "review_list" | "search_engine_results" | "social_media_post" | "software" | "stock" | "vehicle_ad" | "vehicle_ad_listing")
AI extraction models for structured data extraction.
Custom LLM prompt for extraction. Use this when you need custom extraction logic beyond predefined models. Cannot be used together with extraction_model or extraction_template.
JSON extraction template defining custom extraction rules. Cannot be used together with extraction_model or extraction_prompt.
Output
Get Scrapfly Account Information
Get Scrapfly Account Information
Get Crawler Artifact
Get Crawler Artifact
Slug:
SCRAPFLY_GET_CRAWLER_ARTIFACTTool to download crawler artifact files in WARC or HAR format. Use when you need to retrieve the complete crawl results as an archive file. WARC format is recommended for large crawls as it includes gzip compression.Input Parameters
The artifact format type. WARC format is recommended for large crawls with gzip compression.
Output
Get Crawler Contents
Get Crawler Contents
Slug:
SCRAPFLY_GET_CRAWLER_CONTENTSTool to retrieve extracted content from crawled pages. Supports multiple output formats including markdown, text, HTML, and JSON. Use when you need to access the actual content extracted during a crawl, with optional filtering by URL and format selection.Input Parameters
Specific URL to query for single-URL retrieval. When specified, returns content only for this URL.
Return raw content without JSON wrapper. Only works with single URL queries (when ‘url’ parameter is specified).
Comma-separated list of content formats to retrieve. Available formats: html (raw HTML), clean_html (HTML with boilerplate removed), markdown (LLM-optimized markdown), text (plain text only), json (structured JSON), extracted_data (AI-extracted structured data), page_metadata (page metadata like title, description).
Output
Get Crawler Status
Get Crawler Status
Get Crawler URLs
Get Crawler URLs
Slug:
SCRAPFLY_GET_CRAWLER_URLSRetrieve discovered and crawled URLs from a crawler, optionally filtered by status. Supports pagination for large result sets.Input Parameters
Filter results by status. Use ‘visited’ for successfully crawled URLs or ‘failed’ to get URLs that failed with error codes.
Output
Scrapfly Scrape
Scrapfly Scrape
Slug:
SCRAPFLY_SCRAPERequest a web scrape with options such as JavaScript rendering, proxy location, and extraction. The action requires a Bearer API key in metadata headers and reads results from the response’s data wrapper.Input Parameters
HTTP method to use for request, default is GET.
Target country for the proxy (e.g., ‘US’, ‘FR’, ‘DE’). Matching the target site’s region can improve success rates against geo-restricted or anti-bot measures.
Enable JavaScript rendering for sites requiring it. Default returns static HTML only; dynamic/SPA content requires this set to true.
Output
Scrapfly Scrape POST
Scrapfly Scrape POST
Slug:
SCRAPFLY_SCRAPE_POSTTool to scrape web pages using POST method to send data in the request body. Use when you need to scrape endpoints that require POST requests, such as form submissions or APIs that expect data payload.Input Parameters
POST request body payload as JSON object. This data will be sent in the request body to the target URL.
Custom HTTP request headers to send to the target URL. Note: Content-Type defaults to application/json for POST requests.
Output
Scrape With PUT
Scrape With PUT
Slug:
SCRAPFLY_SCRAPE_WITH_PUTTool to scrape web pages using PUT method with body payload. Use when the target API requires PUT requests with data in the request body. Forwards PUT request with custom body to the target URL. If not specified, content-type defaults to application/x-www-form-urlencoded.Input Parameters
Request body payload to send with the PUT request. Should be JSON string for JSON payloads.
Custom HTTP request headers to send. For JSON body, include ‘content-type’: ‘application/json’.