PRODUCT

Anti-bot Scrape.

When the site fights back, we route through residential addresses and a real browser. Cloudflare, Akamai, PerimeterX, and captcha walls handled.

Heavyweight fetch

/v1/cloud/unblock is the path you reach for when your normal scraper hits a wall. Residential IPs, premium proxies, stealth browser, captcha-handling — you don't tune any of it.

curl -X POST https://api.crawlcrawl.com/v1/cloud/unblock \
  -H "Authorization: Bearer crk_..." \
  -d '{"url":"https://hard-site.example","return_format":"markdown"}'

# returns
{ "url": "...", "status": 200, "content": "...clean markdown...", "cost_usd": 0.001 }

Lighter alternative

For sites with no anti-bot, use /v1/cloud/scrape (or just /v1/crawls for multi-page). They cost less and run faster. Reach for /v1/cloud/unblock only when you have to.

What counts against your cap

Each unblock counts as one hard-mode request. Free tier: zero per day. Indie: 200/day. Agency: 2,000/day. Studio: 17,000/day.

Where it fits

Scrape the sites that block everyone else.

200 hard-mode pages a day on Indie. 2,000 on Agency.

Get an API key — free