Help Center Web Scraper Integration

Web Scraper Integration

Integrations Updated Mar 1, 2026

How It Works

The Web Scraper automatically crawls your website to find and extract product information. It uses intelligent detection to identify product pages and extract:

  • Product title
  • Description
  • Price
  • Images
  • Stock status (when available)
  • Product URL

Setup

  1. Enter your website URL during the setup wizard
  2. Relio starts discovering product pages automatically
  3. Product detection typically takes 2-10 minutes depending on site size
  4. Review imported products on the Products page

Limitations

Limitation Detail
600-product cap The scraper imports a maximum of 600 products per site. Stores with larger catalogs should use Google Feed or CSV instead
JavaScript-rendered content Some SPAs (Single Page Apps) may not scrape fully
Login-gated products Products behind authentication are not accessible
Inconsistent HTML Unusual page structures may require support
Edit restrictions You cannot edit product details (title, price, description), as they are read-only because the scraper is the source of truth

Note: During auto-refresh and manual refresh, only the existing imported products (up to 600) are scanned. No additional products beyond the 600 limit will be imported.

Advantages

  • No technical setup required, just paste your URL
  • Works with any website: WordPress, custom sites, Wix, Squarespace, etc.
  • Auto-refresh: Products stay up-to-date automatically
  • Scan for new products: Periodically discover newly added products (within the 600 limit)
  • Brand detection: Extracts brand and manufacturer information from your product pages

Refreshing Products

With the scraper, you have three refresh options:

  • Manual Refresh: Click "Refresh Products" on the Products page to update all product data (prices, stock, descriptions)
  • Brand Scan: Re-scan your homepage to update your chatbot's brand identity
  • Scan Products: Discover and add new product pages that were not found initially (up to the 600-product limit)
  • Auto-Refresh: Enable automatic daily updates to keep everything current

Note: You cannot manually edit product details with the scraper method. The scraper is the authoritative source and any manual edits would be overwritten on next refresh.