90
Ramik Sadana, John Stasko Expanding Selection for Information Visualization Systems on Tablet Devices

Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Ramik Sadana, John Stasko

Expanding Selection for Information Visualization Systems on Tablet Devices

Page 2: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Page 3: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Page 4: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Page 5: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

⇧ ⌘ ⌥ ^{ }524,288

Graham Wills, “524,288 ways to say ‘this is interesting’”, InfoVis 1996

Page 6: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Add to Selection

Remove from Selection

Intersect with Selection

Replace Selection

Toggle Selection

Page 7: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Adobe Photoshop Finder

Page 8: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Tableau

⌘ pressed

Page 9: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 10: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 11: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Jeff Rzeszotarski, Aniket Kittur, “Kinetica: Naturalistic multi-touch data visualization”, CHI 2014

Vizable by Tableau

Page 12: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Ramik Sadana, John Stasko “Designing Multiple Coordinated Visualizaions for Tablets”, EuroVis 2016

Page 13: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

In the past …

Page 14: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Benko et al., “Precise Selection Techniques for Multi-Touch Screens”, CHI ‘06

Moscovich, “Contact Area Interaction with Sliding Widgets”, UIST ‘09

Au et al., “LinearDragger: A Linear Selector for One-finger Target Acquisition“, CHI‘14

Page 15: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Wobbrock et al., “User defined gestures for surface computing“, CHI‘14

Page 16: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Wobbrock et al., “User defined gestures for surface computing“, CHI‘14

`

Page 17: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

North et al., “Understanding multi-touch manipulation for surface computing“, INTERACT’09

Page 18: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Research Challenge

How can we provide advanced selection features within tablet-based visualization systems?

Page 19: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Driving Scenarios …

Page 20: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Year

Horror

Drama

Comedy

Action

Budget

1. Compound Query

Page 21: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Year

Budget

Horror

Drama

ComedyAction

1. Compound Query

Page 22: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Year

Budget

Horror

Drama

ComedyAction

1. Compound Query

Page 23: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Year

1. Compound QueryBudget

Horror

Drama

ComedyAction

Page 24: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

2. Brushing and linking

Page 25: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

2. Brushing and linking

Page 26: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

2. Brushing and linking

Page 27: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

2. Brushing and linking

Page 28: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

3. Imprecision of Touch

Page 29: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

3. Imprecision of Touch

Occlusion

Page 30: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Designing a Solution …

Page 31: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Gestureworks.com

Page 32: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Marking Menus

Page 33: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Touch Overloading

Page 34: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 35: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Quasimodes

⌘⇧⌥^

Existing InteractionModifier +

Page 36: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Non-dominant Hand

Page 37: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Wagner et al., “BiTouch and BiPad: Designing Bimanual Interaction for Hand-held Tablets“, CHI‘12

Li et al., “Experimental Analysis of Mode Switching Techniques in Pen-based User Interfaces“, CHI‘05

Page 38: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Control selector

Page 39: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

1 bit

Control selector

Modifier

Page 40: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 41: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Clutch

Page 42: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 43: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Mapping Clutch …

Page 44: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Clutch

Tap

Drag

Pinch

⌘ Click

Page 45: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Clutch Tap+

Page 46: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 47: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Clutch Drag+

Page 48: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 49: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 50: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Clutch Pinch+

Page 51: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 52: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

ClutchDrag

+ Pinch

+

Page 53: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 54: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Low-tension Clutch

Page 55: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 56: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Add to Selection

Remove from Selection

Intersect with Selection

Replace Selection

Toggle Selection

Generalized Selection

Page 57: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Generalized Selection

Page 58: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Profit

BudgetAvatar

Page 59: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Budget

Avatar

Director

Profit

Page 60: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Budget

Avatar

Director

Profit

Page 61: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

BudgetAvatar

Profit

Page 62: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 63: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 64: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 65: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Avatar

Page 66: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 67: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Generalized Selection

Year

Budget

Page 68: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Generalized Selection

Year

BudgetAvatar

Page 69: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Genre

Generalized Selection

Year

BudgetAvatar

Director

Rating

Page 70: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Genre

Generalized Selection

Year

BudgetAvatar

Director

Rating

Page 71: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Heer et al. “Generalized Selection via Interactive Query Relaxation.” CHI ‘08

Page 72: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Heer et al. “Generalized Selection via Interactive Query Relaxation.” CHI ‘08

Page 73: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Genre

Director

Rating

Generalized Selection

Page 74: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Genre

Director

Rating

Match by

Genre

Director

Rating

Generalized Selection

Page 75: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Genre

Director

Rating

Match by

Genre

Director

Rating

Generalized Selection

Page 76: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Genre

Director

Rating

Match by

Genre

Director

Rating

Generalized Selection

Page 77: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Genre

Director

Rating

Match by

Genre

Director

Rating

Generalized Selection

Page 78: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Genre

Director

Rating

Match by

Genre

Director

Rating

Generalized Selection

Page 79: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Genre

Director

Rating

Match by

Genre

Director

Rating

Generalized Selection

Page 80: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

G E N E R A L I Z E D S E L E C T I O N M E N U

Page 81: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 82: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch
Page 83: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Discussion …

Page 84: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Extensions

Page 85: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Extensions

Page 86: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Extensions

Page 87: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Extensions

Page 88: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Limitations

Page 89: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

Limitations

Discoverability

Change of Grip

Evaluation

Page 90: Expanding Selection for Information ... - College of Computing · Wobbrock et al., “User defined gestures for surface computing“, CHI‘14 ` North et al., “Understanding multi-touch

~thanks~

Ramik Sadana [email protected]

John Stasko [email protected]

Acknowledgements Google Faculty Research Award

NSF Award IIS-1320537