26
Joseph ‘Jofish’ Kaye, Nokia Research Anita Lillie, LinkedIn Deepak Jagdish, Nokia Research James Walkup, Nokia Rita Parada, Nokia Design Koichi Mori, Nokia Research

Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

  • Upload
    jofish

  • View
    451

  • Download
    0

Embed Size (px)

DESCRIPTION

This is the talk from the CHI 2012 Long Case Study called "Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization". Abstract Nokia Internet Pulse is a system for visualizing current discussion around a particular topic on Twitter. It consists of a time-series of stacked tag clouds consisting of the (interesting) words in tweets that match a topic. Words are sized proportional to frequency and colored according to the emotional content of the tweet: if several people tweet “I love my Nokia N900”, then “N900” will show up colored bright green, because it’s in the same tweet as the word “love”, which the system recognizes as positive. In addition to showing topics of corporate interest (“Nokia”, “N9”, etc.), the system is also useful for understanding buzz around individuals (“Rihanna”), conferences (“#chi2012”), topics (“rumor OR rumors”), Twitter-specific phenomena (“RT”) and more. Clicking on words shows a list of tweets that contain those words, allowing easy drill-down to view individual tweets. It is available at http://nip.nokia.com/

Citation preview

Page 1: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

Joseph ‘Jofish’ Kaye, Nokia ResearchAnita Lillie, LinkedInDeepak Jagdish, Nokia ResearchJames Walkup, NokiaRita Parada, Nokia DesignKoichi Mori, Nokia Research

Page 2: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

2 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Nokia Internet Pulse

1. How it works2. Evolution 3. Evaluation

Page 3: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

3 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

http://nip.nokia.com/app

Page 4: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

4 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

How it works (1): gather

First we collect tweets using Twitter’s streaming API filter:keywords = { “nokia”:[“nokia, lumia, asha, phone”],

“chi2012”:[“chi2012, chifilter”],…}

filter = keywords.values()

d=urllib2.Request('https://stream.twitter.com/1/statuses/filter.json',"track="+filter)

open(YY+"/"+MM+"/"+DD+"/"+HHMM+".result",’a’).write(d)

Then we sort them into files:for json.load(tweet) in open(file):

for keyword in keywords:

if keyword.values() in tweet:

keyword\yy\mm\dd.write(tweet)

Page 5: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

5 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

How it works (2): sentiment, wordsThen we remove stopwords and use a heavily edited version of the Pitt MPQA to identify a summary of sentiment for each tweet, producing a words file, ~50 words for each hour, day, and last-day, last-week:

{ "words": [

{"phone": {"count": 57, "sentiment": 0.15384615384615385}},

{"astound": {"count": 26, "sentiment": 1.0}},

{"c7": {"count": 28, "sentiment": 0.65384615384615385}},

{"use": {"count": 33, "sentiment": 0}},…

Page 6: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

6 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

How it works (3): tweets by topicAnd an (annotated) tweets file for each of those keywords{ "tweets": [

{"phone": [

"<span class='isAuthor'>@iNon_Chalant</span>: Teacher asked if i was strandon on an island wat would i bring? I said a NOKIA phone, those phones Never <span class= 'isNegative'>Break</span> <span class='isPositive'>lol</span>",

"<span class='isAuthor'>@ekemona</span>: Nokia To Use ST-Ericsson Chips For Windows Phone 8 Handsets: By ELIZABETH WOYKE When Nokia debuts its hotly-anti... <a href='http://bit.ly/lFqWXi'>http://bit.ly/lFqWXi</a>",

Page 7: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

7 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

How it works(4): the front end•Multiple front ends on the same json-producing backend:• The desktop Flash version you saw earlier

• Which has multiple versions:• One for the internet• One for the intranet (more searches! More sekrit!)• One for the big screens in the kitchens (some

optimizations)• One for Sesame Workshop’s offices in NYC

• The Windows Phone version (currently Nokia-internal) • A now-defunct S60 phone version

Page 8: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

8 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evolution: May 2009

Page 9: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

9 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evolution: July 2009

Page 10: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

10 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evolution: September 2009

Page 11: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

11 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evolution: January 2010

Page 12: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

12 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evolution: January 2010

Page 13: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

13 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evolution: April 2010

Page 14: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

14 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evolution: July 2011

Page 15: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

15 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evolution: January 2012

Page 16: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

16 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evaluation

We asked a randomly selected group of N=44 users to rate their enjoyment and satisfaction with Nokia Internet Pulse on a scale of 1 to 7 ranging from “Very much not” to “Extremely very much indeed”

Page 17: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

17 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evaluation

We asked a randomly selected group of N=44 employees to rate their enjoyment and satisfaction with Nokia Internet Pulse on a scale of 1 to 7 ranging from “Very much not” to “Extremely very much indeed”Oh

No

We

Did

n’t

Page 18: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

18 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evaluation

Oh, I know this. I use it every day.

8 April 2010Olli-Pekka Kallasvuo

Nokia CEO, June 2006-September 2010

Page 19: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

19 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evaluation

This is great.We need to domore like this.

25 September 2010Stephen Elop

Nokia CEO, September 2010-

Page 20: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

20 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evaluation

Page 21: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

21 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

EvaluationNokia Internet Pulse (last updated 2012-04-23) Past weekTotal (143 days)Pageviews (ranking:19 out of 203) 752193Downloads14314Forum posts15First Impression Survey score-40 (N=10)-43 (N=49)

Page 22: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

22 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Page 23: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

23 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evaluation

Page 24: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

24 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Evaluation

Page 25: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

25 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

What constitutes success?• We designed, iterated and built a system which has been

running for three years and is still running• Hundreds of people have used thousands of times in our

kitchen and around our lab in Palo Alto• NIP screens are on every floor of our new building in Sunnyvale• We officially Technology Transferred to User & Operator Insights• We worked with great people inside and outside Nokia and

spent a lot of time thinking through the implications of big data• The CTO took Anita and I out for a really seriously good dinner

with an excellent bottle of amerone• In an intangible but important way, we got the company

thinking seriously about what people are saying about us in social media

Page 26: Nokia Internet Pulse: A Long Term Deployment and Iteration of a Twitter Visualization

26 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye

Joseph ‘Jofish’ [email protected]@jofish

http://nip.nokia.com/apphttp://bit.ly/nippaperhttp://slidesha.re/NIPulse