When the site fights back, we route through residential addresses and a real browser. Cloudflare, Akamai, PerimeterX, and captcha walls handled.
/v1/cloud/unblock is the path you reach for when your normal scraper hits a wall. Residential IPs, premium proxies, stealth browser, captcha-handling — you don't tune any of it.
curl -X POST https://api.crawlcrawl.com/v1/cloud/unblock \
-H "Authorization: Bearer crk_..." \
-d '{"url":"https://hard-site.example","return_format":"markdown"}'
# returns
{ "url": "...", "status": 200, "content": "...clean markdown...", "cost_usd": 0.001 }
For sites with no anti-bot, use /v1/cloud/scrape (or just /v1/crawls for multi-page). They cost less and run faster. Reach for /v1/cloud/unblock only when you have to.
Each unblock counts as one hard-mode request. Free tier: zero per day. Indie: 200/day. Agency: 2,000/day. Studio: 17,000/day.
200 hard-mode pages a day on Indie. 2,000 on Agency.
Get an API key — free