A Study of Digital Ink in Lecture Presentation

Richard J. Anderson*, Ruth Anderson*†, Crystal Hoyer*, and Steven A. Wolfman*‡

* U. Washington, † U. Virginia, ‡ U. British Columbia

Steve Wolfman presenting

http://www.cs.washington.edu/research/edtech/

Steve Wolfman A Study of Digital Ink in Lecture Presentation 2

t

Outline

• Background & Motivation

• Study

• Attentional Marks & Hand Gestures

• Ephemerality & Persistence

• Conclusions & Future Directions

Steve Wolfman A Study of Digital Ink in Lecture Presentation 3

tDistance & Large Class Studies

Presenter

Ink Study

ClassroomFeedbackSystem

Retro/ProspectiveFeedback PatternsStudent Interaction Systems

[ITiCSE ’04]

[SIGCSE ’02, ITiCSE ’02 & ’03]

[SIGCSE ’04]

[CSCL ’03]

[CHI ’03]

Research History

Steve Wolfman A Study of Digital Ink in Lecture Presentation 4

t

Expected Use of Ink

Steve Wolfman A Study of Digital Ink in Lecture Presentation 5

t

Common Use of Ink

Steve Wolfman A Study of Digital Ink in Lecture Presentation 6

t

Outline

Background & Motivation

• Study

• Attentional Marks & Hand Gestures

• Ephemerality & Persistence

• Conclusions & Future Directions

Steve Wolfman A Study of Digital Ink in Lecture Presentation 7

t

Ink Study

Interpretive analysis [Erickson] of 3 courses:– Distance courses (, A / V and ink archives)– “Slideware-style”– Experienced instructors

Lectures Time Topic

Prof A. 4 6 hrs Compilers

Prof B. 8 20 hrs AI

Prof C. 10 23 hrs Databases

Steve Wolfman A Study of Digital Ink in Lecture Presentation 8

t

Prevalence of Attentional Marks

Segmented strokes from six hours of lecture into coherent episodes and coded into four categories:

% of strokes % of episodes

B C B+C B C B+C

Attentional 49 53 51 77 74 76

Diagram 9 7 8 8 8 8

Writing 41 38 40 14 16 15

Other 1 2 1 2 2 2

Steve Wolfman A Study of Digital Ink in Lecture Presentation 9

t

Outline

Background & MotivationStudy

• Attentional Marks & Hand Gestures

• Ephemerality & Persistence

• Conclusions & Future Directions

Steve Wolfman A Study of Digital Ink in Lecture Presentation 10

t

Understanding Attentional Marks

Properties:– brief, simple markings– occur with speech– augment meaning of speech– ad hoc form

Is there a linguistic context in which to understand these marks?

Steve Wolfman A Study of Digital Ink in Lecture Presentation 11

t

Spontaneous Hand Gestures

Spontaneous Hand gestures [McNeill]:– are synchronous w/speech– are co-expressive w/speech– lack standard of form

Attentional marks share these properties.

Steve Wolfman A Study of Digital Ink in Lecture Presentation 12

t

Gesture Types: Iconic

Steve Wolfman A Study of Digital Ink in Lecture Presentation 13

t

Gesture Types: Deictic & Cohesive

Steve Wolfman A Study of Digital Ink in Lecture Presentation 14

t

Outline

Background & MotivationStudy Attentional Marks & Hand Gestures

• Ephemerality & Persistence

• Conclusions & Future Directions

Steve Wolfman A Study of Digital Ink in Lecture Presentation 15

t

Persistent Representation vs. Ephemeral Meaning

Steve Wolfman A Study of Digital Ink in Lecture Presentation 16

t

Persistent Representation vs. Ephemeral Meaning

Steve Wolfman A Study of Digital Ink in Lecture Presentation 17

t

Design Recommendations

• Separate strokes w/non-homogenous color

• Show co-occurrence/ordering w/age cues

• Show process w/incremental rendering

Steve Wolfman A Study of Digital Ink in Lecture Presentation 18

t

“Whiteboard” Effect [Prince]

Steve Wolfman A Study of Digital Ink in Lecture Presentation 19

t

Candy-Striping [Prince]

Steve Wolfman A Study of Digital Ink in Lecture Presentation 20

t

Conclusions

• Identified important ink use pattern: Attentional Marks

• Established gestural framework for understanding/analyzing Attentional Marks

• Demonstrated tension between ephemeral meaning and persistent representation

• Generated design recommendations to resolve tension

• Characterized instructors’ parsimonious use of UI features

Steve Wolfman A Study of Digital Ink in Lecture Presentation 21

t

Future Directions

• Alternate ink renderings

• Augmented transcripts– Keyframing– Deixis resolution for blind students

• Improved recognition– Auto-captioning– Link time/speech to slide locations

• Further analysis

Steve Wolfman A Study of Digital Ink in Lecture Presentation 22

t

URLs for More Info

UW CS&E Education & Ed. Tech. Group: http://www.cs.washington.edu/research/edtech/

Classroom Presenter: http://www.cs.washington.edu/education/dl/presenter/

Steve Wolfman A Study of Digital Ink in Lecture Presentation 23

tEXTRA SLIDES: NEW SURPRISING

USE

Steve Wolfman A Study of Digital Ink in Lecture Presentation 24

t

Surprising Use of Attentional Marks (1 of 3)

Steve Wolfman A Study of Digital Ink in Lecture Presentation 25

t

Surprising Use of Attentional Marks (2 of 3)

Steve Wolfman A Study of Digital Ink in Lecture Presentation 26

t

Surprising Use of Attentional Marks (3 of 3)

Steve Wolfman A Study of Digital Ink in Lecture Presentation 27

tEXTRA SLIDES:

MOTIVATING PROBLEMS

Steve Wolfman A Study of Digital Ink in Lecture Presentation 28

t

Steve Wolfman A Study of Digital Ink in Lecture Presentation 29

t

“Sticky” Colors

Steve Wolfman A Study of Digital Ink in Lecture Presentation 30

t

“Feature Recovery” Problem

Steve Wolfman A Study of Digital Ink in Lecture Presentation 31

tEXTRA SLIDES:

GESTURE TYPES

Steve Wolfman A Study of Digital Ink in Lecture Presentation 32

t

Gesture Types: Metaphoric

Steve Wolfman A Study of Digital Ink in Lecture Presentation 33

t

Gesture Types: Beats