This community node integrates ScrapeOps services into n8n, allowing you to use their Proxy API, Parser API, and Data API directly in your workflows.
ScrapeOps provides a suite of tools to simplify web scraping operations:
- Proxy API: Access high-quality proxies through a single endpoint for reliable web scraping
- Parser API: Extract structured data from HTML content
- Data API: Retrieve and query data from ScrapeOps datasets
Follow the installation guide in the n8n community nodes documentation.
npm install @scrapeops/n8n-nodes-scrapeops
- Make GET and POST requests through ScrapeOps proxies
- Configure options like JavaScript rendering, geolocation, and custom headers
- Choose between standard and premium proxies
- Control response format and advanced parameters
- Parse HTML from a URL or direct HTML content
- Define extraction rules for structured data
- Retrieve complete datasets from ScrapeOps
- Execute custom queries against datasets
To use this node, you'll need a ScrapeOps API key. You can get one by signing up at ScrapeOps and visiting your dashboard at Dashboard.
This example shows how to use the ScrapeOps Proxy API to scrape a website with JavaScript rendering enabled:
- Add a ScrapeOps node
- Select "Proxy API" and "Request" operation
- Enter the target URL
- Enable JavaScript rendering in Advanced Options
- Run the workflow
This example shows how to extract structured data from a webpage:
- Add a ScrapeOps node
- Select "Parser API" and "Parse HTML" operation
- Enter the target URL
- Define extraction rules in JSON format
- Run the workflow