- Category: developer tools
- Auth: API_KEY
- Composio-managed OAuth available? N/A
- Tools: 10
- Triggers: 0
- Slug:
WEBSCRAPER_IO - Version: 20261101_00
Tools
Create Sitemap
Create Sitemap
Slug:
WEBSCRAPER_IO_CREATE_SITEMAPTool to create a new sitemap configuration for web scraping. Use when you need to define a new scraping structure with start URLs and selector rules for data extraction from a website.Input Parameters
Array of selector objects defining data extraction rules. Minimum one selector required.
Unique identifier for the sitemap. Must be alphanumeric with hyphens (e.g., ‘webscraper-io-landing’).
Output
Delete Sitemap
Delete Sitemap
Disable Sitemap Scheduler
Disable Sitemap Scheduler
Enable Sitemap Scheduler
Enable Sitemap Scheduler
Slug:
WEBSCRAPER_IO_ENABLE_SITEMAP_SCHEDULERTool to enable and configure automatic scheduling for sitemap scraping jobs. Use when you need to automate scraping jobs to run at specific times using cron expressions with customizable request intervals, page load delays, driver types, and proxy settings.Input Parameters
Proxy configuration. Use format ‘datacenter-{country_code}’ (e.g., ‘datacenter-us’) or ‘residential-{country_code}’ (e.g., ‘residential-us’), or 0 for no proxy, or 1 to use proxy, or proxy id for Scale plan users
Scraper driver type. ‘fast’ doesn’t execute JavaScript and extracts from raw HTML. ‘fulljs’ is full driver with JavaScript execution
Day of month field of cron expression. Use ’*’ for any day, ‘1-31’ for range, or specific values
Hour field of cron expression. Use ’*’ for any hour, ‘0-23’ for range, or specific values like ‘9,17’
Month field of cron expression. Use ’*’ for any month, ‘1-12’ for range, or specific values
Minute field of cron expression. Use '' for any minute, ‘/10’ for every 10 minutes, or specific values like ‘0,15,30,45’
Day of week field of cron expression. Use ’*’ for any weekday, ‘0-6’ for range (0=Sunday), or specific values
Timezone for cron schedule using tz database format (e.g., ‘Europe/Riga’, ‘America/New_York’, ‘Asia/Tokyo’)
Time period in milliseconds that scraper will wait for the page to load before extracting data. Default is 2000ms (2 seconds)
Page request interval in milliseconds. Default is 2000ms (2 seconds). Defines the delay between page requests during scraping
Output
Get Account Info
Get Account Info
Get Scraping Jobs
Get Scraping Jobs
Get Sitemap
Get Sitemap
Get Sitemaps
Get Sitemaps
Get Sitemap Scheduler
Get Sitemap Scheduler