Joseph ‘Jofish’ Kaye, Nokia ResearchAnita Lillie, LinkedInDeepak Jagdish, Nokia ResearchJames Walkup, NokiaRita Parada, Nokia DesignKoichi Mori, Nokia Research
2 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Nokia Internet Pulse
1. How it works2. Evolution 3. Evaluation
3 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
http://nip.nokia.com/app
4 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
How it works (1): gather
First we collect tweets using Twitter’s streaming API filter:keywords = { “nokia”:[“nokia, lumia, asha, phone”],
“chi2012”:[“chi2012, chifilter”],…}
filter = keywords.values()
d=urllib2.Request('https://stream.twitter.com/1/statuses/filter.json',"track="+filter)
open(YY+"/"+MM+"/"+DD+"/"+HHMM+".result",’a’).write(d)
Then we sort them into files:for json.load(tweet) in open(file):
for keyword in keywords:
if keyword.values() in tweet:
keyword\yy\mm\dd.write(tweet)
5 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
How it works (2): sentiment, wordsThen we remove stopwords and use a heavily edited version of the Pitt MPQA to identify a summary of sentiment for each tweet, producing a words file, ~50 words for each hour, day, and last-day, last-week:
{ "words": [
{"phone": {"count": 57, "sentiment": 0.15384615384615385}},
{"astound": {"count": 26, "sentiment": 1.0}},
{"c7": {"count": 28, "sentiment": 0.65384615384615385}},
{"use": {"count": 33, "sentiment": 0}},…
6 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
How it works (3): tweets by topicAnd an (annotated) tweets file for each of those keywords{ "tweets": [
{"phone": [
"<span class='isAuthor'>@iNon_Chalant</span>: Teacher asked if i was strandon on an island wat would i bring? I said a NOKIA phone, those phones Never <span class= 'isNegative'>Break</span> <span class='isPositive'>lol</span>",
"<span class='isAuthor'>@ekemona</span>: Nokia To Use ST-Ericsson Chips For Windows Phone 8 Handsets: By ELIZABETH WOYKE When Nokia debuts its hotly-anti... <a href='http://bit.ly/lFqWXi'>http://bit.ly/lFqWXi</a>",
7 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
How it works(4): the front end•Multiple front ends on the same json-producing backend:• The desktop Flash version you saw earlier
• Which has multiple versions:• One for the internet• One for the intranet (more searches! More sekrit!)• One for the big screens in the kitchens (some
optimizations)• One for Sesame Workshop’s offices in NYC
• The Windows Phone version (currently Nokia-internal) • A now-defunct S60 phone version
8 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evolution: May 2009
9 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evolution: July 2009
10 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evolution: September 2009
11 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evolution: January 2010
12 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evolution: January 2010
13 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evolution: April 2010
14 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evolution: July 2011
15 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evolution: January 2012
16 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evaluation
We asked a randomly selected group of N=44 users to rate their enjoyment and satisfaction with Nokia Internet Pulse on a scale of 1 to 7 ranging from “Very much not” to “Extremely very much indeed”
17 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evaluation
We asked a randomly selected group of N=44 employees to rate their enjoyment and satisfaction with Nokia Internet Pulse on a scale of 1 to 7 ranging from “Very much not” to “Extremely very much indeed”Oh
No
We
Did
n’t
18 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evaluation
Oh, I know this. I use it every day.
8 April 2010Olli-Pekka Kallasvuo
Nokia CEO, June 2006-September 2010
19 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evaluation
This is great.We need to domore like this.
25 September 2010Stephen Elop
Nokia CEO, September 2010-
20 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evaluation
21 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
EvaluationNokia Internet Pulse (last updated 2012-04-23) Past weekTotal (143 days)Pageviews (ranking:19 out of 203) 752193Downloads14314Forum posts15First Impression Survey score-40 (N=10)-43 (N=49)
22 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
23 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evaluation
24 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Evaluation
25 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
What constitutes success?• We designed, iterated and built a system which has been
running for three years and is still running• Hundreds of people have used thousands of times in our
kitchen and around our lab in Palo Alto• NIP screens are on every floor of our new building in Sunnyvale• We officially Technology Transferred to User & Operator Insights• We worked with great people inside and outside Nokia and
spent a lot of time thinking through the implications of big data• The CTO took Anita and I out for a really seriously good dinner
with an excellent bottle of amerone• In an intangible but important way, we got the company
thinking seriously about what people are saying about us in social media
26 © 2012 Nokia chi-NIP-presentation1.pptx v. 1 10-05-2012 Author: Jofish Kaye
Joseph ‘Jofish’ [email protected]@jofish
http://nip.nokia.com/apphttp://bit.ly/nippaperhttp://slidesha.re/NIPulse