Works with the best tools:
Works with the best tools:
Have a question?
Contact usScrapingBot turns public web pages into data through a single HTTP request. Create an account, copy your credentials and send your first request: it takes about five minutes.
The free plan includes 500 credits every month, with no credit card required. Most requests cost 1 credit.
Create a free accountYour API key is shown once, right after you sign up: copy it and keep it somewhere safe. Your username is displayed in your dashboard.
Lost your API key? Generate a new one from the dashboard. The previous key stops working immediately.
Every request uses HTTP Basic Auth with username:apiKey. Never put your API key in code that runs in a browser.
This request fetches the HTML of https://example.com with the Raw HTML API. Replace yourUsername and yourApiKey with your credentials. It costs 1 credit.
curl -X POST "https://api.scraping-bot.io/scrape/raw-html" \
-u "yourUsername:yourApiKey" \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com"}'A successful request returns HTTP 200 and the HTML of the page:
<!doctype html>
<html lang="en">
<head>
<title>Example Domain</title>
...
</head>
<body>
<div>
<h1>Example Domain</h1>
...
</div>
</body>
</html>The Raw HTML API returns HTML. The Retail, Real Estate, Booking, Search Engine and Social Media APIs return structured JSON.
| API | Use it for |
|---|---|
| Retail API | Product pages: title, price, currency, images, brand, stock. |
| Real Estate API | Property listings: price, surface, rooms, location, agency. |
| Booking API | Hotels and rentals: rates, rating, amenities, location. |
| Search Engine API | Google and Bing search results as JSON. |
| Social Media API | Public profiles and posts. Asynchronous: send, then poll for the result. |
| Raw HTML API | The HTML of any page, when you want to parse it yourself. |
Some websites need JavaScript rendering or a premium proxy: see Advanced Options. Ready-made scrapers for each website are listed in the API catalog.
400 URL is required | Send the body as JSON with the Content-Type: application/json header, and include https:// in the URL. |
401 Unauthorized | Check your username and API key. Basic Auth expects username:apiKey. |
402 Quota exceeded | You have used your monthly credits. See the plans. |
All error codes and rate limits are listed in Errors & limits.