{"id":5404,"date":"2022-12-23T15:08:41","date_gmt":"2022-12-23T15:08:41","guid":{"rendered":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/"},"modified":"2026-04-16T18:41:45","modified_gmt":"2026-04-16T18:41:45","slug":"scraping-with-postman-how-to","status":"publish","type":"post","link":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/","title":{"rendered":"How to scrape with Postman?"},"content":{"rendered":"\t\t
\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

You find scraping API difficult to use as a non-developer ? Below explanations will help you to use Postman and get your data with ScrapingBot without having to write a single line of code.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

What is Postman?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Postman is a software<\/strong> you can download and use for free. You can find it here<\/a>.<\/p>

It’s actually really easy to setup. We’ll walk you through the steps to configure Postman for use with ScrapingBot.
It can be used in many ways. In this article, we’ll focus on the base functionality it offers : making API calls. Just follow the below instructions and see how you can do some\ufffdscraping with postman.<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t

\n\t\t\t\t\t

How can I use Postman with ScrapingBot?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

First of all, if you do not already have one, you’ll need to create a free account on ScrapingBot.<\/p>

You don’t have a ScrapingBot account?<\/strong><\/p>

Here is what Postman should look like after you’ve installed it.<\/p>

Now to get started, simply click on “Create a request”.<\/p> \"scraping

Now, using our documentation<\/a>, we’ll fill the different elements needed in order to make API calls to ScrapingBot.<\/p>

First we need to configure the credentials, click on the “Authorization” tab and in “Type” select “Basic auth”.<\/p> \"postman

In this tab, your “Username” will be your ScrapingBot username, and the “Password” will be your API key (you can find your API key on your dashboard).<\/p>

If you don’t have a ScrapingBot account, register in a few minutes!<\/strong><\/p>

Now for this article we’ll first detail a basic usage example, trying to get the HTML content of a page.<\/p>

First, you need to set the request type to POST (click where it says “GET” and you’ll see a dropdown appear to select “POST”). Then add the URL of our “raw-html” endpoint as follows.<\/p>

http:\/\/api.scraping-bot.io\/scrape\/raw-html<\/pre> \"postman 
Now last step before send the API call. We need to configure the body of our request in order to give the API the informations it need to perform the scraping.<\/p>
On Postman, click on the “Body” tab, select “raw” and then click on “Text” to select “JSON”. We select JSON as it’s the type of data we send to the API and it will also helps with the readability.<\/p>
And finally we add the JSON containing the “url” parameter which tells the API which page it needs to extract the data from. In our example it’s an amazon product page but it can be any publicly available page.<\/p>
{\"url\":\"https:\/\/www.amazon.com\/dp\/B00FLYWNYQ\/\"}<\/pre> \"postman 
Now you can click on “Send” and after a little bit of time you’ll receive the response from the API under the request part of the screen.<\/p> 
In our example as we requested for the raw-html, the result we get is a text containing all of that page HTML content.<\/p> \"postman 
This is it ! This is how you can easily do scraping with Postman. You did your first scraping using ScrapingBot and didn’t have to type a single line of code.<\/p>
Eventually you can then save the request you just created in Postman in order to use it later. In order to do this simply click on the “Save” button. It will show a popup where you can give a name to your request and add it to a collection (A collection is just a group of request, for example for a same site, here you can create the collection ScrapingBot for example). Then just click “Save” at the bottom.<\/p> \"postman 
Now you’re ready to add more requests for other website or to use our others endpoints.<\/p>
Let’s see a more advanced version of the request using the different options we offer when calling the API. This will allow you to do scraping with postman for larger variety of websites.<\/p>
It’s time to create your FREE ScrapingBot account!<\/strong><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t
Advanced request with options<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\tThere is not a lot of difference to add options to your request. We only need to modify the JSON body in order to pass those options to the API. 
The different options<\/h3> In the example below, we have added the 3 main options you might need (all those options are explained in detail on the documentation page) :
  • \ufffdproxyCountry : allows you to set a country from which the request will be done. Can be useful when the website has some regional blocking or to get regional pricing.<\/li>
  • premiumProxy: tells the API to use the premium proxy. Those requests are less likely to get blocked by the targeted website. Often necessary for Amazon. Use only if needed.<\/li>
  • useChrome: this option tells the API to simulate a navigation to the URL using a browser. This can be necessary when a website loads data asynchronously (meaning all the data is not immediately loaded when you arrive at a page, sometimes happens on retail websites).<\/li><\/ul>
    Example<\/h4>
    You’ll notice that this time we are calling a different endpoint of our API : “\/retail”. This endpoint is very useful for scraping retail product page and returns a JSON with all the extracted data so you don’t have to look through the HTML text to find what you need, we do it for you.<\/p>
    N.B. : if the retail endpoint does not return the data you expect for a particular retail website, please contact us at support@scraping-bot.io and we’ll look into adding support for that website<\/p> \"postman 
    Finally, let’s see how to use our social media API endpoint. This will help you do\ufffdscraping with Postman for most social media platforms (LinkedIn, Instagram, Facebook, TikTok).<\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t
    \n\t\t\t\t\t
    How to use our social-media endpoints with Postman?<\/h2>\t\t\t\t<\/div>\n\t\t\t\t
    \n\t\t\t\t\t\t\t\t\t
    Overall, the concept is the same. The major difference is that for social media, you’ll need 2 different request to be able to get the result. Let’s get into it.<\/p>\ufffdThe first request is similar to the above example. It’s a POST request to send all the parameters to the API end-point for social-media. Once again, all the options and their possible value for the social-media endpoints are in the documentation page. \"postman 
    You can “Send” this first request. The API will return a response that contains a “responseId”. You’ll need this for the second request that will allow us to get the final result with the data.<\/p>
    Below you’ll see an example of what the second request looks like. This time it’s a “GET” type request, we don’t need to add a body to it, but we’ll need to add two “Params”.<\/p> \"postman 
    In the example above the scraping was already finished when we sent the second request so we got the data.
    It’s possible that the request takes a longer time to process, in which case you’ll get a different result like so :<\/p>
    { \"status\": \"pending\", \"message\": \"Scraping is not finished for this request, try again in a few\" }<\/pre>
    \ufffd<\/p>
    Lastly, if there is an error during the scraping, which can happen for many reasons, the message from the second request will clearly state it. If that happens, you need to restart the scraping process from the first request in order to get a new “responseId”.<\/p>
    \ufffd<\/p>
    And this is it. We hope this article was helpful to use our service without programming skills. You can now do all your\ufffdscraping with postman.
    If you need any extra help, please feel free to contact us using the contact form.<\/p>
    Happy scraping !<\/p>
    If you don’t already have your ScrapingBot account, it’s time to register for FREE!<\/strong><\/p> \t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t","protected":false},"excerpt":{"rendered":"
    You find scraping API difficult to use as a non-developer ? Below explanations will help you to use Postman and get your data with ScrapingBot without having to write a single line of code. What is Postman? Postman is a software you can download and use for free. You can find it here. It’s actually […]<\/p>\n","protected":false},"author":0,"featured_media":5433,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[6],"tags":[],"class_list":["post-5404","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-web-scraping-in-general"],"acf":[],"yoast_head":"\nHow to scrape with Postman? - Scraping-bot<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"How to scrape with Postman? - Scraping-bot\" \/>\n<meta property=\"og:description\" content=\"You find scraping API difficult to use as a non-developer ? Below explanations will help you to use Postman and get your data with ScrapingBot without having to write a single line of code. What is Postman? Postman is a software you can download and use for free. You can find it here. It’s actually […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/\" \/>\n<meta property=\"og:site_name\" content=\"Scraping-bot\" \/>\n<meta property=\"article:published_time\" content=\"2022-12-23T15:08:41+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2026-04-16T18:41:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/scraping-bot.io\/blogs\/wp-content\/uploads\/2022\/12\/Inf-2.webp\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"900\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/\"},\"author\":{\"name\":\"\",\"@id\":\"\"},\"headline\":\"How to scrape with Postman?\",\"datePublished\":\"2022-12-23T15:08:41+00:00\",\"dateModified\":\"2026-04-16T18:41:45+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/\"},\"wordCount\":1235,\"publisher\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/#organization\"},\"image\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/wp-content\\\/uploads\\\/2022\\\/12\\\/Inf-2.webp\",\"articleSection\":[\"Web Scraping in general\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/\",\"url\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/\",\"name\":\"How to scrape with Postman? - Scraping-bot\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/wp-content\\\/uploads\\\/2022\\\/12\\\/Inf-2.webp\",\"datePublished\":\"2022-12-23T15:08:41+00:00\",\"dateModified\":\"2026-04-16T18:41:45+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/#primaryimage\",\"url\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/wp-content\\\/uploads\\\/2022\\\/12\\\/Inf-2.webp\",\"contentUrl\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/wp-content\\\/uploads\\\/2022\\\/12\\\/Inf-2.webp\",\"width\":1200,\"height\":900},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/scraping-with-postman-how-to\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home > Blog\",\"item\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"How to scrape with Postman?\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/#website\",\"url\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/\",\"name\":\"Scraping-bot\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/#organization\",\"name\":\"Scraping-bot\",\"url\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/wp-content\\\/uploads\\\/2025\\\/10\\\/scraping-bot-logo.svg\",\"contentUrl\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/wp-content\\\/uploads\\\/2025\\\/10\\\/scraping-bot-logo.svg\",\"width\":159,\"height\":32,\"caption\":\"Scraping-bot\"},\"image\":{\"@id\":\"https:\\\/\\\/scraping-bot.io\\\/blogs\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.linkedin.com\\\/company\\\/scrapingbot\\\/\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"How to scrape with Postman? - Scraping-bot","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/","og_locale":"en_US","og_type":"article","og_title":"How to scrape with Postman? - Scraping-bot","og_description":"You find scraping API difficult to use as a non-developer ? Below explanations will help you to use Postman and get your data with ScrapingBot without having to write a single line of code. What is Postman? Postman is a software you can download and use for free. You can find it here. It’s actually […]","og_url":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/","og_site_name":"Scraping-bot","article_published_time":"2022-12-23T15:08:41+00:00","article_modified_time":"2026-04-16T18:41:45+00:00","og_image":[{"width":1200,"height":900,"url":"https:\/\/scraping-bot.io\/blogs\/wp-content\/uploads\/2022\/12\/Inf-2.webp","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/#article","isPartOf":{"@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/"},"author":{"name":"","@id":""},"headline":"How to scrape with Postman?","datePublished":"2022-12-23T15:08:41+00:00","dateModified":"2026-04-16T18:41:45+00:00","mainEntityOfPage":{"@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/"},"wordCount":1235,"publisher":{"@id":"https:\/\/scraping-bot.io\/blogs\/#organization"},"image":{"@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/#primaryimage"},"thumbnailUrl":"https:\/\/scraping-bot.io\/blogs\/wp-content\/uploads\/2022\/12\/Inf-2.webp","articleSection":["Web Scraping in general"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/","url":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/","name":"How to scrape with Postman? - Scraping-bot","isPartOf":{"@id":"https:\/\/scraping-bot.io\/blogs\/#website"},"primaryImageOfPage":{"@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/#primaryimage"},"image":{"@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/#primaryimage"},"thumbnailUrl":"https:\/\/scraping-bot.io\/blogs\/wp-content\/uploads\/2022\/12\/Inf-2.webp","datePublished":"2022-12-23T15:08:41+00:00","dateModified":"2026-04-16T18:41:45+00:00","breadcrumb":{"@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/#primaryimage","url":"https:\/\/scraping-bot.io\/blogs\/wp-content\/uploads\/2022\/12\/Inf-2.webp","contentUrl":"https:\/\/scraping-bot.io\/blogs\/wp-content\/uploads\/2022\/12\/Inf-2.webp","width":1200,"height":900},{"@type":"BreadcrumbList","@id":"https:\/\/scraping-bot.io\/blogs\/scraping-with-postman-how-to\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home > Blog","item":"https:\/\/scraping-bot.io\/blogs\/"},{"@type":"ListItem","position":2,"name":"How to scrape with Postman?"}]},{"@type":"WebSite","@id":"https:\/\/scraping-bot.io\/blogs\/#website","url":"https:\/\/scraping-bot.io\/blogs\/","name":"Scraping-bot","description":"","publisher":{"@id":"https:\/\/scraping-bot.io\/blogs\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/scraping-bot.io\/blogs\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/scraping-bot.io\/blogs\/#organization","name":"Scraping-bot","url":"https:\/\/scraping-bot.io\/blogs\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/scraping-bot.io\/blogs\/#\/schema\/logo\/image\/","url":"https:\/\/scraping-bot.io\/blogs\/wp-content\/uploads\/2025\/10\/scraping-bot-logo.svg","contentUrl":"https:\/\/scraping-bot.io\/blogs\/wp-content\/uploads\/2025\/10\/scraping-bot-logo.svg","width":159,"height":32,"caption":"Scraping-bot"},"image":{"@id":"https:\/\/scraping-bot.io\/blogs\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.linkedin.com\/company\/scrapingbot\/"]}]}},"_links":{"self":[{"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/posts\/5404","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/comments?post=5404"}],"version-history":[{"count":1,"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/posts\/5404\/revisions"}],"predecessor-version":[{"id":5451,"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/posts\/5404\/revisions\/5451"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/media\/5433"}],"wp:attachment":[{"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/media?parent=5404"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/categories?post=5404"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scraping-bot.io\/blogs\/wp-json\/wp\/v2\/tags?post=5404"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}