60
Interactive Visualization for Computational Linguistics ESSLII 2009 Interaction and animation 2

Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Interactive Visualization for

Computational Linguistics

ESSLII 2009

Interaction and animation2

Page 2: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

References3

� Slides in this section are based on:

Yi et al., Toward a Deeper Understanding of the

Role of Interaction in Information Visualization,

Proceedings of IEEE Conference on Information

Visualization, 2007.

� and were designed by Petra Isenberg.

Why Interaction?4

� Datasets are too large to:

� display in one view

� comprehend in entirety

� Interest in only subset of the data

� Interest in different views of the data

� Extract relevant information & transform

� …

Page 3: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Sense-making Cycle5

Card et al., 1999

Sense-making Cycle6

Card et al., 1999

The problem

The task

Choosing an analytical abstraction

Choosing a visual abstraction

Raw data

Creating a view

Spatial layout, colours, etc.

Defining the data

Mapping data (values) into view

Explore, interpret, decide

Interaction (view & value)

Data tables

Visual structures

View

Page 4: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Interaction Techniques7

� Select – mark something as interesting

� Explore – show me something else

� Reconfigure – show me a different arrangement

� Encode – show me a different representation

� Abstract/Elaborate – more or less detail

� Filter – show me something conditionally

� Connect – show me related items

Based on user intent

Yi et al., InfoVis 2007

Selection8

� Mark something as interesting

� Often combined with other techniques

Collins, 2007

Page 5: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Explore9

� Show me something else

� Examine subset of data cases (view-based)

� E.g. Panning (move viewpoint across representation)

� E.g. Direct Walk (move viewing focus through clicks)

Reconfigure10

� Show a different arrangement

� Move data items to

� Enable better comparison

� Avoid occlusion

� Correspond to some mental model of the data

Cone Trees Table Lens

[Robertson et al., 1991] [Rao & Card, 1995](Robertson et al., 1991) (Rao & Card, 1995)

Page 6: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Star Glyphs

Parallel Coordinates

Page 7: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Rearrangement of Selected Data Items

2D Parallel Coordinates to 3D Parallel Glyphs

Page 8: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Star Glyphs aligned to coordinate axes

EPS Lens

Page 9: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

EdgeLens

Encode18

� Show a different:

� Representation Type

� Visual appearance: Colour, Size, Shape,…

Isenberg and Carpendale, InfoVis, 2007

Page 10: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Encode19

� Animation can aid encoding changes

DynaVis - Heer & Robertson, 2007

Abstract/Elaborate20

� Show me more or less detail

� Adjust level of abstraction

� Detail-on-demand

� Zooming (as long as representation isn’t fundamentally altered)

Warning: Not every technique belongs to

just one category.

Isenberg and Carpendale, InfoVis, 2007

Page 11: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Filter21

� Show subset of data based on condition

� e.g., by selecting a data range

� or filtering based on distance from focus

AlphaSlider, Ahlberg & Shneiderman, 1993; DocuBurst, Collins, 2007

Connect22

� Show related items

� e.g. brushing

Single view

Heer & boyd, InfoVis 2005

Multiple viewCollins & Carpendale, InfoVis 2007

Page 12: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

23

“Overview first, zoom and filter,

then details-on-demand”

Shneiderman, 1996

24 pictures from www.b-eye-network.com

Page 13: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

25

CHRISTOPHER COLLINS

[email protected]

GERALD PENN

[email protected]

SHEELAGH CARPENDALE

[email protected]

Page 14: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Tools for Visualization159

Page 15: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

160

Visualization Websites

Page 16: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Many Eyes161

http://www.many-eyes.com

Page 17: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Many Eyes162

16 visualization types

Upload plain text, comma or tab delimited

Discuss and share visualizations with colleagues

2 language-specific visualizations (tag cloud and word tree)

Comparison views, e.g. change treemap

Interactive, save any state of view in threaded discussion

www.many-eyes.com

Page 18: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

163

F= 0.5 *

((NOUNS + ADJECTIVES +

PREPOSITIONS + DETERMINERS)

-(PRONOUNS + VERBS + ADVERBS +

INTERJECTIONS)

+ 100)

“If you have a look at those posts, you’ll probably notice that they aren’t really in any way more formal than Scoble’s other writing. The difference is that they tend to be more informational, i.e. have more and more condensed information crammed into to them than most entries.”

Formality in Blogging CorpBlawg, Cornelius Puschmann, 2008; ManyEyes, Wattenberg et al., 2007

Page 19: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

164 Comparison of Corporate Blogs CorpBlawg, Cornelius Puschmann, 2008; ManyEyes, Wattenberg et al., 2007

User Profile Link

Page 20: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Swivel165

www.swivel.com

Page 21: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Swivel166

Excel-type charts only

Discussion forum

Comma, tab delimited data upload

Page 22: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

167

Programming Libraries

Page 23: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

prefuse168

Prefuse.org

Jeffrey Heer

Page 24: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

prefuse169

Open source Java programming library

BSD license

Software architecture follows sense-making cycle Standard data formats supported (I/O)

Interaction out-of-the-box

Supplied collection of layouts and renderers

Active user support forums

Relatively fast prototyping

Easily link with java NLP code libraries

Our tool of choice!

Page 25: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

170 prefuse examples by Collins et al.

Page 26: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Processing171

Processing.org

Ben Fry and Casey Reas

Page 27: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Processing172

Open source programming language and IDE

Simplified graphics and interaction (2D & 3D)

Based on Java, can import Java packages

Easy to learn

Many help resources (online and print)

Very wide programmer base

mostly designers, artists, students

Page 28: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

173

Jonathan Harris, www.wefeelfine.org

Neumann et al., KeyStrokes, EuroVis 2007

linguistic examples made with Processing

Steinweber & Koller, similardiversity.net, 2008

Page 29: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

InfoVis Toolkit174

ivtk.sourceforge.net

Jean-Daniel Fekete

Page 30: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

InfoVis Toolkit175

Graphics toolkit for Java

Software architecture follows sense-making cycle

Standard data formats supported (I/O)

Supplied collection of layouts and renderers

Matrix and parallel coordinates visualizations maybe especially useful for NLP

Fast, small memory footprint

Page 31: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

176

Henry et al., 20 years of 4 HCI Conferences, Int. Journal of HCI, 2008

examples made with the InfoVis Toolkit

Page 32: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

177

Visualization Software

Page 33: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Microsoft Excel178

Can do more than you think!

... But be careful, new features can be misleading!

www.juiceanalytics.com has great tips

Page 34: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

SpotFire179

Coordinated views

Multi-dimensional data

Customized for business intelligence, but applicable to quantitative research

spotfire.tibco.com

Page 35: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

180 spotfire.tibco.com

Page 36: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Tableau181

Easily compose visualizations with “VizQL” language

Drag and drop data columns into a library of visualizations

Create “dashboards” of always-up-to-date data graphics

tableausoftware.com

Page 37: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

182

Tableau

tableausoftware.com

Page 38: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

TreeForm183

Customized software for syntax tree drawing

Open source initiative lead by Donald Derrick and Daniel Archambault

Lots of alternative packages, most of them not very good

http://www.ece.ubc.ca/~donaldd/treeform.htm

Page 39: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

184

Emerging Research

Page 40: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Collaborative Visualization185

Isenberg and Carpendale, InfoVis 2007

Page 41: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Toolkits for Visualization on the Web186

Flare Visualization Toolkit, Heer 2008

Page 42: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Upload text or tabular data

Page 43: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Choose visualization type

Page 44: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Tag clouds – alpha order, size by TF

Page 45: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Mouse over for concordance

Page 46: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Bigram tag cloud

Page 47: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Wordle – like tag clouds but arranged using energy minimization

Page 48: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Word tree – kind of like a suffix graph

Page 49: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Phrase net: * and *

Page 50: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Phrase net: * is *

Page 51: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Phrase net: * of the *

Page 52: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Now we add the statistics from all the texts

Page 53: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Bar graph – first person pronoun ratio

Page 54: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Bar graph - 2nd person pronoun ratio

Page 55: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Bar graph – hifalutin token ratio

Page 56: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Bar graph – average sentence length (tokens)

Page 57: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Bubble chart - 2nd person pronoun ratio

Page 58: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Scatter plot – sent len x hifalutin x adverbs

Page 59: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Matrix chart – almost like parallel coordinates

Page 60: Interactive Visualization for Computational Linguisticsgpenn/esslli09/day3.pdf · 2009. 7. 30. · Interactive Visualization for Computational Linguistics ESSLII 2009 2 Interaction

Tree map – genre x 1st person x 2nd person