21
Physics Pathway: A Digital Library Filled with Synthetic Interviews Presented at JCDL 2011, Ottawa, Canada June 15, 2011 Mike Christel, Scott Stevens, and Dean Zollman [email protected] Entertainment Technology Center Carnegie Mellon University

Christel jcdl2011 physics_pathway

Embed Size (px)

DESCRIPTION

Slide set used by Mike Christel in presenting paper at ACM/IEEE Joint Conference on Digital Libraries, Ottawa, Canada, June 15, 2011

Citation preview

Page 1: Christel jcdl2011 physics_pathway

Physics Pathway: A Digital Library Filled with

Synthetic Interviews

Presented at JCDL 2011, Ottawa, Canada

June 15, 2011

Mike Christel, Scott Stevens, and Dean [email protected]

Entertainment Technology Center

Carnegie Mellon University

Page 2: Christel jcdl2011 physics_pathway

Talk Outline

• What are Synthetic Interviews?

• What is Physics Pathway?

• Field use of

Physics

Pathway

• Conclusions

Page 3: Christel jcdl2011 physics_pathway

Synthetic Interviews

Interface and indexing technology that allows an

individual to have a fluent conversation with a figure as

if that person were present in real time

Page 4: Christel jcdl2011 physics_pathway

Synthetic Interviews (SIs) for Physics Teaching

• Initially, one “Master Teacher” used, but recipients

wanted broader representation of opinions

• Four in corpus: Roberta Lang, Chuck Lang, Paul

Hewitt, Leroy Salary

Page 5: Christel jcdl2011 physics_pathway

Physics Pathway: Motivation

Teachers relatively new to physics teaching find 1-on-1

interactions with a mentor extremely valuable, but

mentors have limited time. SIs provide virtual mentoring.

Page 6: Christel jcdl2011 physics_pathway

Physics Pathway: SI and Video Library

• Left panel: Synthetic

Interview interface

(focus of this work)

• Right panel: Digital video

library interface (see

www.idvl.org for more details)

Page 7: Christel jcdl2011 physics_pathway

Synthetic Interview Interface

• 450,365 question variants

mapping to 6,598 physics subject

or physics pedagogy topics,

covered by one to four master

teachers in 7,600 video answers

• SI interface components – a

quick walkthrough….

(try it yourself later at

http://physicspathway.org)

Page 8: Christel jcdl2011 physics_pathway

SI: Query Interface

Interface into library of

synthetic interviews

emphasizes “Precision at 1”

– Top-rated answer to query

is immediately played to

keep up a fluent dialog

Page 9: Christel jcdl2011 physics_pathway

SI: Related Question

Page 10: Christel jcdl2011 physics_pathway

SI: Change Teacher

Page 11: Christel jcdl2011 physics_pathway

SI: Shortcuts

Two menus provide “quick

starter” shortcuts identified

by KSU physics

pedagogical experts and

American Association of

Physics Teacher (AAPT)

workshops to topic areas

covered by the digital

library

Page 12: Christel jcdl2011 physics_pathway

SI: Query History

Page 13: Christel jcdl2011 physics_pathway

SI: Feedback

Page 14: Christel jcdl2011 physics_pathway

Synthetic Interview Interface

• 450,365 question variants

mapping to 6,598 physics subject

or physics pedagogy topics,

covered by one to four master

teachers in 7,600 video answers

• SI: video playback, related links,

choose a master teacher,

provide feedback,

show what is answered,

query area (link to ComPADRE),

related questions,

past query history,

quick questions choices

Page 15: Christel jcdl2011 physics_pathway

Fall 2010 Trial with Physics Teachers

• 19 high school physics teachers, 14-week trial period

• Feedback given on individual responses

• Survey computed once a week

• 588 visits to web site

• Excellent coverage of SI data set to teachers’ queries:

only two queries received a default “I don’t have an

answer to that” video response (both typos)

Page 16: Christel jcdl2011 physics_pathway

Lessons Learned - 1

Source of played videos during sessions: Quick

question shortcuts used less than expected

Page 17: Christel jcdl2011 physics_pathway

Lessons Learned - 2

• Response coverage overwhelmingly seen as appropriate

• Relevance good: 67% good or ideal, another 29%

appropriate but not personally useful

Page 18: Christel jcdl2011 physics_pathway

Lessons Learned - 3

Synthetic interviews validated or reinforced physics

teachers’ ideas on their course materials and delivery

Question % of Teacher-Weeks

Built lesson from ideas in Physics Pathway 4.9%

Completely changed lesson plan 2.9%

Small changes to lesson plan 12.7%

No changes, Physics Pathway reinforced plan 34.3%

Did not use ideas from Physics Pathway 38.2%

Page 19: Christel jcdl2011 physics_pathway

Access via The Physics Front (NSDL)

Physics Pathway is a Partner site accessible from The Physics Front.org: “A free service provided by the American Association of Physics Teachers in partnership with the NSF/NSDL” –www.thephysicsfront.org(part of ComPADRE Digital Library in NSDL)

Example search: momentum looking at “Partner Results” http://www.thephysicsfront.org/search/fedsearch.cfm?area=federate&FedQuery=momentum&AllSearch=1

Page 20: Christel jcdl2011 physics_pathway

Take-Home Message from Paper

• Synthetic interviews engage physics teachers in a

virtual dialog for continuing education that has been

well received in AAPT workshops and KSU-directed

field tests

• The site is available for use at both

http://physicspathway.org and via thephysicsfront.org

Page 21: Christel jcdl2011 physics_pathway

Credits

Many members of Carnegie Mellon University (CMU) and Kansas State University (KSU) contributed to this work, including:

KSU Physics Education Research Group: Dean Zollman, Brian

Adrian, Chris Nakamura, Sytil Murphy

CMU Entertainment Technology Center: Scott Stevens, Bryan

Maher, Andy Korzik, Xiaoxi Liu, Srinavin Nair

ComPADRE/NSDL Integration: Lyle Barbato, Bruce Mason

For more information: http://www.physicspathway.org/PathwayHome.html

Library of physics teaching resources accessible via thephysicsfront.org or

directly at physicspathway.org

This work supported by the National Science Foundation Teacher

Professional Continuum Program under Grants 0455772 & 0455813. A

preliminary version was supported by NSF's NSDL Program under grants

0226219 & 0226157.