Scrape and collect data from Twitter sounds like a good idea. With more than 200 million users in the world, Twitter is a big social network.
Very popular with users for getting quickly informed, following trends or giving their opinion, Twitter has a lot of interesting marketing data for brands.
Collect this data to know more your audience, or to be informed of something you need.
Now, ScrapingBot has a Twitter scraper to automatically scrape and collect public data from Twitter profiles and Twitter search results (keyword or hashtag).
Retrieve the data you want in JSON, without any blocking.
What data can you collect with our Twitter Scraper?
Twitter profiles
Profile name, profile image, profile background image, number of tweets, account verification, profile bio, number followed, number of followers, latest posts data (text, time, ID, replies, retweets, likes, views, media)
Twitter search results
From a keyword or a hashtag: Username, tweet URL, created time, ID, other hashtags, user mentions, source, geo coordinates, reply count, query count, conversation ID, retweeted, possibly sensitive, language, media data (links, expanded URL, type, width and height)
How to start scraping Twitter?
ScrapingBot is here to help you scrape Twitter profiles and hashtags as easily and efficiently as possible.
Start scraping Twitter in 3 steps:
1. Create an account
Want to start scraping Twitter right now? No problem, ScrapingBot offers FREE access with 100 credits per month to get started. No payment information required, and no any engagement.
If you already have an account, just log in.
2. Configure your scraping
Once your account has been created, go to Documentation, to the “Data Scraper API” section to be able to start scraping what you want.
Setting up the endpoint is a two-step process with two API calls.
Step 1 : Get your Response ID
First, you must make a first POST request to get the ResponseID which will be used later.
- scraper: twitterProfile or twitterSearch
- url: Twitter profile URL (for twitterProfile)
- search: keyword or hashtag (for twitterSearch)
Step 2 : Configure your second request
Now that you have your responseId, configure a GET request to retrieve the response.
Complete the Response Endpoint with: responseId and scraper parameters.
3. Start scraping!
Your web scraping setup is now ready to use! You can start collecting data from Twitter Profiles and Search results.
NB: If you need more help, a sample code to execute the call to this API is available in the documentation.
