Hi Ahmed,

I dont have it, but we have developed a crawler to monitor and download messages based on a query. It would not be hard to implement a crawler like this. We used Twitter4J for that.

Best,

Alisson

Thanks Alisson! I appreciate your response. The 1% sample is just not enough for the kind of analysis that I would like to do.

Hi Ahmed, 

For volumes greater than the 1% provided by the public API, you may need to contact GNIP. Most historical Twitter data is controlled by them, at a cost. Some computer science labs may have useful data - try searching for labs that have published on Twitter and Climate, or have published analysis on large amounts of Twitter data. Good luck! Bridi

As an alternative to Gnip (which is expensive), you can just search twitter using the advanced search. This gives you a 100% sample but is labour intensive, and massively so if you don't limit your search further than the one keyword. I don't think there are any other options if you want the full firehose.

Hi Ahmed 

Martin Hawksey's TAGs can be used to harvest tweets over time (I've included links below and to my blog post about how to set it up.)

I ran a short test in Socioviz - this tool allows you to set date limits, provides network analysis and a downloadable archive in xlsx. Note metadata harvested is not as comprehensive as TAGS.

I hope this helps.

Sarah

https://twitter.com/search-advanced?lang=en

https://tags.hawksey.info/

http://sarahlibrarina.tumblr.com/post/98285757460/archiving-tweets-thanks-mhawksey

http://socioviz.net/

The U.S. Library of Congress has been working on providing access to the Tweet Archive for several years now.  To my knowledge, this is still well in the future.  (See http://firstmonday.org/ojs/index.php/fm/article/view/5619/4653 and http://www.politico.com/story/2015/07/library-of-congress-twitter-archive-119698.html)

I have great news! Twitter's new API allows access to the full archive. See https://blog.twitter.com/2015/full-archive-search-api

Yes, if you have lots of money...

I'll mail them today to know the prices... maybe the offer reduction to researchers. 

Hi,

You can get twitter data from Podargos Data. 

Podargos Data can provide twitter historical and realtime data. In additional, it's able to help you retrieve other mobile App data of social networks and e-commerce. I hope this information can help you.

Podargos' website is http://www.podargos.com

Here is the data sample:

http://goo.gl/dRxyow

Yes:

https://sifter.texifter.com/

Key reading:

http://support.gnip.com/articles/hpt-timeline.html

Also see:

http://fortune.com/2014/08/22/contagion-justin-bieber-data-scientists-twitter/