NewsTweet Discover what’s

happening anywhere in the world right now.

Kevin Schaeffer Insight Data Science Fellow June 2013

Exciting News Broken on Twitter But… Very Noisy!

NewsTweet

The Algorithm News

(recognized news accounts) Other

(streaming API)

Multinomial Naïve Bayes Classifier

•  Tokenize Tweets (anonymize @, #)

•  Only English Tweets with >100 characters

•  Bag of Words Model •  n=6000 training set •  86% cross-validation accuracy

Tools

Kevin Schaeffer Ph.D. in Physics from Berkeley

(String Theory)

What makes a tweet newsworthy?

§ Most informative news words: § U.S.

§ Officials

§ Law

§ Most informative words for other types of tweets: § Lol

§ Ipad

§ U