Twitter (Social networking) Dataset Twitter (Social networking) Dataset hadoop hadoop

Twitter (Social networking) Dataset


Try the following three datasets:

Contains around 97 milllion tweets:

http://demeter.inf.ed.ac.uk/index.php?option=com_content&view=article&id=2:test-post-for-twitter&catid=1:twitter&Itemid=2

ed note: the dataset previously linked above is no longer available because of a request from Twitter to remove it.

Contains user graph of 47 million users:

http://an.kaist.ac.kr/traces/WWW2010.html

Following dataset contains network as well as tweets, however the data was collected by snowball sampling or something hence the friends network is not uniform. It has around 10 million tweets you can mail the researcher for even more data.

http://www.public.asu.edu/~mdechoud/datasets.html

Though have a look at the license the data is distributed under.

Hope this helps,Also can you tell me what kind of work are planning with this dataset?I have few hadoop / pig scripts to use with dataset


100 million pages were extracted from facebook :http://it.slashdot.org/story/10/07/28/1350222/100-Million-Facebook-Pages-Leaked-On-Torrent-Site?art_pos=6

I don't know what they contain, but you could have a look, it seems it's easy to find on torrents sites.

You could also use the facebook API, but if you want a dataset big enough, you would have to ask facebook the rights to access it.It contains links to friends, likes, groups, ...


Facebook social graph, application installations and Last.fm users, events, groups collected by researchers at UCIrvine: http://odysseas.calit2.uci.edu/research/