Skip to main content
Scrapingbee logo
  • Category: web scraping & browser
  • Auth: API_KEY
  • Composio-managed OAuth available? N/A
  • Tools: 5
  • Triggers: 0
  • Slug: SCRAPINGBEE
  • Version: 20261101_00

Tools

Slug: SCRAPINGBEE_DATA_EXTRACTIONExtract structured data from a webpage using CSS or XPath selectors via ScrapingBee’s extract_rules feature. Requires an explicit ScrapingBee API key in the request.

Input Parameters

string
required
The webpage URL to extract data from.
integer
Seconds to wait before extraction (for dynamic content).
string ("desktop" | "mobile")
Emulate device type (desktop or mobile).
string
required
Your ScrapingBee API key.
object
required
JSON object defining fields to extract and their CSS/XPath selectors. For nested selectors, use object with ‘selector’ and optional ‘type’ keys. Misaligned or invalid selectors silently drop fields with no error — verify each selector matches the target DOM before large-scale use.
boolean
Whether to render JavaScript before extraction.
string
Two-letter country code for proxy geolocation (e.g., ‘us’, ‘de’).
boolean
Use premium proxy for higher reliability.
boolean
Block images, CSS, and resources to speed up extraction.
object
Custom HTTP headers to forward to the target website. Provide as a dict, e.g., {‘Accept-Language’: ‘en-US’}. Headers will be prefixed with ‘Spb-’ and forwarded to the target.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPINGBEE_HTML_FETCHFetch page content or a screenshot through ScrapingBee’s HTML API, with optional JavaScript rendering, proxy and resource controls. For screenshot requests, the returned HTML field may be empty.

Input Parameters

string
required
The URL to scrape.
integer
Milliseconds to wait before returning content.
integer
Number of retries on request failure.
string ("desktop" | "mobile")
Device type to emulate (‘desktop’ or ‘mobile’).
string
Cookies to send in requests (HTTP header string).
string
CSS selector to wait for before returning content.
boolean
Block ads and tracking scripts.
boolean
Render JavaScript before returning HTML. Required for client-side rendered pages where dynamic data is absent in raw HTML.
string
JavaScript snippet to execute before returning content.
boolean
Return screenshot as base64-encoded PNG.
string
JSON scenario for custom headless browser actions.
string
Two-letter country code for geolocation (e.g., ‘us’).
string
Extraction rules (CSS selector or JSONPath).
boolean
Use premium proxy for scraping.
boolean
Use stealth (undetectable) proxy mode.
boolean
Block images and CSS resources on the page to speed up scraping.
string
CSS selector of element to screenshot.
boolean
Capture full-page screenshot instead of only viewport.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPINGBEE_SCRAPING_BEE_PROXY_MODEFetch web content through ScrapingBee’s HTML API with optional JavaScript rendering, proxy selection, and resource blocking.

Input Parameters

string
required
The target URL to scrape through ScrapingBee Proxy Mode.
object
Cookies to send with the request as a key-value mapping.
object
Additional HTTP headers to forward to the target site. Each header will be prefixed with ‘Spb-’ and forwarded when forward_headers is enabled.
integer
Request timeout in milliseconds.
boolean
Block ads and tracking scripts to speed up scraping.
boolean
Enable JavaScript rendering before returning content.
integer
Session identifier (integer) to keep the same IP for multiple requests. Use the same number to maintain consistent IP across requests.
string
Custom JavaScript scenario name for advanced interactions.
string ("us" | "de" | "fr" | "uk" | "ca" | "it" | "es")
Two-letter country code for geolocated proxy (e.g., ‘us’, ‘fr’).
boolean
Use premium proxies for higher reliability.
boolean
Use stealth proxy mode for extra undetectability.
boolean
Block images and CSS resources to speed up scraping. Only relevant when render_js is enabled.
boolean
Forward original request headers to the target site.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPINGBEE_STEALTH_PROXYFetch web content through ScrapingBee with optional stealth proxy and JavaScript rendering for sites with anti-bot measures. Stealth proxy must be enabled explicitly.

Input Parameters

string
required
The URL of the webpage to retrieve using stealth proxy.
integer
Wait time in milliseconds before returning the response.
string ("desktop" | "mobile")
Device type to emulate during rendering. Options: ‘desktop’ or ‘mobile’.
string
Custom cookies in semicolon-separated format: ‘name1=value1;name2=value2’.
boolean
Render JavaScript on the page before returning the response.
string
Two-letter country code for proxy geolocation (e.g., ‘us’, ‘de’).
string
Extraction rules in JSON string for structured data.
boolean
Use premium proxies for higher reliability.
boolean
Enable stealth proxy mode. Use when the target site blocks bots.
boolean
Block images, styles, and fonts for faster loads.
boolean
Forward original request headers from the browser.
boolean
Return the raw page source instead of text.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not
Slug: SCRAPINGBEE_USAGE_STATSRetrieve ScrapingBee account usage statistics, including credit usage, concurrency limits and current concurrency, and subscription renewal date.

Output

string
required
Data from the action execution
string
Error if any occurred during the execution of the action
boolean
required
Whether or not the action execution was successful or not