Home / APIs / web scraping API

Web Scraping API for Developers

Fetch public page content over REST for automation. Provide a URL (and optional CSS selector) to extract text — with SSRF protections. This is static HTML extraction, not a stealth crawler.

Get API keyTry Scrape PageDocumentation

Features

What this API actually supports in production today.

  • POST /v1/web/scrape with url
  • Optional CSS selector
  • Optional include_html / max_text controls
  • SSRF-safe outbound fetches
  • JSON response for easy piping into apps

Common use cases

  • Content monitoring and change checks
  • Enrichment for internal knowledge tools
  • Lightweight data collection from public docs

API endpoints

Base URL https://thefatbaby.com/api. Authenticate with Authorization: Bearer fb_live_YOUR_KEY.

MethodPathSummaryCredits
POST/v1/web/scrapeScrape a public URL3 credits default

Examples

Primary endpoint /v1/web/scrape · 3 credits per successful scrape (default)

cURL

curl -X POST https://thefatbaby.com/api/v1/web/scrape \
  -H "Authorization: Bearer fb_live_YOUR_KEY" \
  -H "Content-Type: application/json" \
  -d '{"url":"https://example.com","selector":""}'

JavaScript

const res = await fetch('https://thefatbaby.com/api/v1/web/scrape', {
  method: 'POST',
  headers: {
    Authorization: 'Bearer fb_live_YOUR_KEY',
    'Content-Type': 'application/json'
  },
  body: JSON.stringify({ url: 'https://example.com' })
});
const data = await res.json();

Python

import requests
r = requests.post(
  'https://thefatbaby.com/api/v1/web/scrape',
  headers={'Authorization': 'Bearer fb_live_YOUR_KEY'},
  json={'url': 'https://example.com'},
).json()
print(r.get('title'), r.get('text', '')[:200])

Request

{
  "url": "https://example.com",
  "selector": "",
  "include_html": false,
  "max_text": 20000
}

Response

{
  "url": "https://example.com",
  "status": 200,
  "title": "...",
  "text": "...",
  "credits_used": 3
}

Pricing & credits

Default 3 credits per scrape.

View pricingStart free

Common errors

  • 400 — Blocked or invalid URL
  • 402 — insufficient_credits

FAQ

Does this bypass CAPTCHAs or log into sites?

No. It fetches publicly reachable HTML under SSRF rules. It is not an anti-bot browser farm.

Related metadata endpoint?

For lighter previews, see link-preview / web metadata tools in the catalog.

Try without code

Use the matching online tool, then automate the same workflow with this API.

Try Scrape PageGet API key