where can I find data-sets for messages sent from users to other users of online social networks?; the data-set should at least indicate WHO sent WHAT to Whom at When;
say i have a csv file like this :
user1-id,user2-id,message,time-stamp
1,2,"hello","08/04/2014"
....................................
btw; message part could be almost anything that could be SENT in a online social network;
i'm trying to model the information diffusion on a social network with epidemic models like SIR; so every suggestion would be appreciated; and thanks in advance
Hassan,
Have you tried to get the data using the API of the social network you want to work on? Each social network has an API that by connecting to it you can download its public data. As an instance, check out this link which is about Twitter API:
https://dev.twitter.com/overview/documentation
thanks @Ehsan, and yes, i've tried the APIs (Mining the Social Web by Matthew Russell is a good guide for doing so) but there are two problems;
so, before using the APIs i wanted to see are there data-sets that somebody used for their researches that are useful to me and also publicly available?, it's kinda sarcastic how there are so many researches are done about social networks and topics related to them and still so few data-sets are actually available publicly from so many research articles!;0)
would you be interested in a social network related to project management ?
Communigram is a social project management based on the Business Communication Engineering (BCE) where the data set includes the knowledge exchanges between project participants.
looks very interesting, could you please elaborate a little; i mean how could someone get access to the data-set you mentioned or at least a portion of it?
SNAP has some anaonymized datasets from social networks. As I've seen actual message content is not included in those networks. According to the Twitter user agreement tweets can't be made publicly available.
I hope higgs-twitter dataset will be useful in modelling information diffusion.
http://snap.stanford.edu/data/
thanks @Kaushalya, SNAP data-sets are good but they are mostly graphs of real world networks, including some social networks like Twitter, and they are almost only snapshots of structure of a network at a time, nothing more, so it's maybe not bad to have some user generated data as well besides mere cold graph of a social network i suppose.
I remember a fellow student presented some work using a set of emails from Enron as it was falling apart. The data set (available here: https://www.cs.cmu.edu/~./enron/) has been used in several studies of organizations and social networks. CMU researchers have developed some good tools to go along with the data---all available from the link provided. It may fit your requirements for messages sent within a group over time. Recognize that this social network existed prior to the start of messages, so you have limited resources for evaluating the development of the network over time; only the development of certain information threads within the network.
here is the reference related to communigram.net
http://www.communigram.net/
thanks @Clarence, have it already;
+@Frederi_Andres i checked http://www.communigram.net/ the other day when you mentioned it and it seems it's only a front-end website to sell some project management solution softwares or something like that; so no publications or data-sets or any hint of such.
it is an open source social network for project management.
the source code is available on Cloudforge.
dataset are produced by each communigram platform.
@Frederi_Andres; sorry to ask but would you mind posting the url to its source code please?; it seems i can't find it.
You may check my article to get relevant references.. There is one sub-section for data set of multiple online social networks.
Conference Paper Integrating and Mining Virtual Communities across Multiple O...
i think we can grab those kind of interaction in social network services such as twitter, right ? .. the output format is similar with what you are looking for ..
you can find more inforamation through
Follow source social links : http://www.communigram.net/
- Badges
- Science topic
- Similar topics
- Computer Science
- Data Mining