Hi Salar. I tried Web Scraper and it turned out to work well for different hashtags. It is an extension from crhome. However, python scripts could be better and more flexible and reduce the data cleansing step.

Web scraper is free if you want to extract tweets and there is an online tutorial how to do that.

Alternatively, you can extract all of the hashtags live with a Raspberry Pi and a Node-Red flow, consisting of a twitter node and a csv node.

Best Regards

Dimitri

The best way to achieve this is by using Twitter API. However, it requires technical know-how. Nevertheless, you may try using http://twlets.com/ or https://www.einsightdata.com.

in 2014 Twitter introduced a project called Twitter Data Grants (TDG), through which it allows research institutions to access Twitter’s public and historical data.

These publicly available tweets, including the user information/ retweet/replies/mentions, are available in JSON format through Twitter’s provided API. Twitter API allows accessing to both historic and real-time feeds; as for the search API, it allows the query of Twitter for recent Tweets containing specific keywords and requires an authorized application before obtaining any results from the API. While for the streaming API, it allows the filtering of live streaming tweets by many identifiers such as user ID, keyword, geographic location or random sampling.

In order to use this API, users must register with their research project information, then Twitter will provide the project with an application unique ID and then produce set of credentials to access the API. Then the user can use these credentials to setup a connection and query twitter’s tweets database either its historic data or its real-time feeds.

Then, after making the connection and running the query through the API, results in JSON format will be retrieved.

https://rapidapi.com/blog/how-to-use-the-twitter-api/

Mr. Dimitri Petrik Thank you for your recommendations. I want to extract tweets in large number from several people. So I will try Web Scraper.

Mr. Manuel B. Garcia Thank you. I tried http://twlets.com but it needed a PayPal account which is not available in my country. The other website provides Followers which I didn't want actually.

Dear Dr. Mohamed Elhadad Thank you so much for your detailed explanation about Twitter's API. Actually, I tried this method but Twitter requested details of my research project throughout registration. What I need is to extract all the tweets of several people (may be more that 300 people) and analyse them. Cheers!

Dear Salar Zrary,

Twitter has some limitations and restrictions on developers who will use their APIs; they want to ensure security and privacy for themselves and for the users of their platform. Hence, you should write simple words that describes that you are doing this for research purposes. be simple as possible, and clarify that the collected data will not be released or used for commercial purposes.

Usually, you will not face problems doing this.

Dear Dr. Mohamed Elhadad Thanks again for your valuable comments.

Dear Dr. Mohamed Elhadad Unfortunately my Twitter developer account application was NOT approved.

This screen is from my Twitter developer page

Dear Salar Zrary , I gave you some advises telling you to write simple words that describes that you are doing this for research purposes. be simple as possible, and clarify that the collected data will not be released or used for commercial purposes.

I do not know whether you have followed these advises or not.

Dear Dr. Mohamed Elhadad Actually I was trying to be simple. However, the website needed detailed account about the subject. I also told them that the data will not be distributed to 3rd party. Anyway, I am going to start it over with a new Twitter account.

Thanks again for your valuable advise.

Hi

There are many APIs for this

As friends mentioned, you can use the following apps:

https://support.gnip.com/

https://developer.twitter.com/en/docs

You can also download archived hysterical data using the following site:

https://archive.org/search.php?query=collection%3Atwitterstream&sort=-publicdate

You should pay attention to the limitations of each site

good luck

Hi

this subject is so dependent on what do you want?

you can use Twitter API to extract data with Python tweepy package. Using this َAPI, you can extract stream or historical tweets.

You can also use it from

https://archive.org/search.php?query=collection%3Atwitterstream&sort=-publicdate

website. it is been stored 1% of each month's data. you can download and use it.