Embed Size (px)
Citation preview
An Introduce to Topic Model
towards a topical social dynamics
Mingli Yuan
2012-11-12
Monday, November 12, 12
Contents
• Part one: Probabilistic topic modeling
• Part two: Towards a topical social dynamics
• Last question: How about ontological social dynamics?
Monday, November 12, 12
Probabilistic topic model
creditimages from
probabilistic topic modelby D.M. Blei
2012http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12
Latent Dirichlet Allocation
creditimages from
probabilistic topic modelby D.M. Blei
2012http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12
Topic model family
creditimages from
probabilistic topic modelby D.M. Blei
2012http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12
Dynamic topic model
creditimages from
probabilistic topic modelby D.M. Blei
2012http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12
Hierarchical Dirichlet Process
creditimages from
probabilistic topic modelby D.M. Blei
2012http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12
Online demo
• Allison Chaney: Topic Model Visualization Engine (TMVE)
• lda for The American Political Science Review
• lda for 2006 arXiv
• ctm for Science (1980-2000)
• dtm for Science (1882-2001)
Monday, November 12, 12
Research groups
• David M. Blei and others from Princeton University
• http://www.cs.princeton.edu/~blei/topicmodeling.html
• Wei Li, Wang Xuerui and Andrew McCallum from University of Massachusetts
• http://people.cs.umass.edu/~mccallum/
• ......
Monday, November 12, 12
Implementations
• lda-c and others
• http://www.cs.princeton.edu/~blei/topicmodeling.html
• gensim
• http://radimrehurek.com/gensim/
• mallet
• http://mallet.cs.umass.edu/index.php
Monday, November 12, 12
Interactions on SNS
Creditby Kencf0618http://commons.wikimedia.org/wiki/File:Kencf0618FacebookNetwork.jpg
Structure:• following relationship
Interaction:• notification by @• reply• retweet
Monday, November 12, 12
Spreading and conversation
The Convesationby Arnold Lakhovskyhttp://commons.wikimedia.org/wiki/File:Lakhovsky_Conversation.jpg
by Roger McLassushttp://commons.wikimedia.org/wiki/File:2006-01-14_Surface_waves.jpg
Spreading by retweet
Conversation by reply
Monday, November 12, 12
Conversation graph
• Conversation graph:
• the graph draw by reply relationship
• One tweet is too small and very contextual
• Conversation graph can be treat as a basic unit for study
• Inside conversation-graph
• Inter conversation-graph
Monday, November 12, 12
Applying topic model
• Rational topic model for the inner-structure of the conversation-graph
creditimages from
probabilistic topic modelby D.M. Blei
2012http://www.cs.princeton.edu/~blei/kdd-tutorial.pdf
Monday, November 12, 12
The needs oftopical social dynamics
• How about the inter-structure of conversation-graph?
• we need a new tool - the topical social dynamics
• theory not available right now
• Topic model are already here
• Graph dynamical system are emerging
• slowness: lda is slow, dtm is very slow, ....
Monday, November 12, 12
The last question• How about ontological social dynamics?
• Topic is too coarse-grained
• ontological-social data are not very abundant today
• knowledge is likely to be expressed by natural language, not the ontology
• But ....
• in promising future
Monday, November 12, 12
