Web Scraping

Extract structured data from company websites using Firecrawl to enrich your leads with real-time information.

What is Web Scraping Enrichment?

Web scraping extracts data from company websites and converts it into structured fields. Unlike AI enrichment that analyzes content, scraping pulls specific data points like:

  • Pricing information
  • Services or product offerings
  • Team size or number of employees
  • Contact information
  • Technology stack
  • Recent news or announcements

Firecrawl Integration

Enrichabl uses Firecrawl for intelligent web scraping that handles JavaScript, dynamic content, and complex layouts.

Setup

  1. Sign up for Firecrawl
  2. Get your API key from the Firecrawl dashboard
  3. Add it to Enrichabl in Settings → API Keys → Firecrawl

Creating Scraping Columns

  1. Click Add Column → Web Scraping
  2. Select the URL column (usually website)
  3. Write a prompt describing what data to extract
  4. Define output fields
  5. Click Create Column

Example: Extract Pricing

Prompt: "Visit the pricing page and extract the pricing tiers"

Output Fields:
- pricing_tier_1: Starting price for basic plan
- pricing_tier_2: Price for mid-tier plan
- pricing_tier_3: Price for enterprise plan

Combining Scraping with AI

Scraped data works great as input to AI enrichment columns:

  1. Column 1 - Scrape Services: Extract list of services from website
  2. Column 2 - AI Analysis: Use {services} to identify best fit for your product
Pro Tip: Web scraping is more reliable for structured data (prices, lists), while AI is better for analysis and interpretation.

Best Practices

  • Be specific about what data you want and where to find it
  • Test on a small batch first to refine your prompts
  • Use descriptive output field names
  • Handle missing data (not all sites will have the data you want)

Rate Limits

Firecrawl has rate limits based on your plan. Check your Firecrawl dashboard for current limits and usage.

Next Steps