33
VISUALIZING ACTIVITIES FOR SELF-REFLECTION AND AWARENESS Sten Govaerts, Katrien Verbert, Joris Klerkx, Erik Duval Katholieke Universiteit Leuven (Belgium) http://www.role-project.eu Thursday 9 December 2010

Visualizing Activities for Self-reflection and Awareness

Embed Size (px)

DESCRIPTION

the slides of my talk at ICWL 2010 in Shanghai, China.

Citation preview

Page 1: Visualizing Activities for Self-reflection and Awareness

VISUALIZING ACTIVITIES FOR SELF-REFLECTION AND

AWARENESSSten Govaerts, Katrien Verbert, Joris Klerkx, Erik Duval

Katholieke Universiteit Leuven (Belgium)

http://www.role-project.eu

Thursday 9 December 2010

Page 2: Visualizing Activities for Self-reflection and Awareness

OVERVIEW

• Problem statement

• Objectives

• Design & Implementation

• Evaluation

• Conclusion

Thursday 9 December 2010

Page 3: Visualizing Activities for Self-reflection and Awareness

PROBLEM

Thursday 9 December 2010

Page 4: Visualizing Activities for Self-reflection and Awareness

PROBLEM

Thursday 9 December 2010

Page 5: Visualizing Activities for Self-reflection and Awareness

PROBLEM

Thursday 9 December 2010

Page 6: Visualizing Activities for Self-reflection and Awareness

PROBLEM

Thursday 9 December 2010

Page 7: Visualizing Activities for Self-reflection and Awareness

OBJECTIVES

• self-monitoring for learners

• awareness for teachers

• time tracking

• learning resource recommendation

Thursday 9 December 2010

Page 8: Visualizing Activities for Self-reflection and Awareness

DEMO

http://ariadne.cs.kuleuven.be/monitorwidget-cgiar

Thursday 9 December 2010

Page 9: Visualizing Activities for Self-reflection and Awareness

STUDENT ACTIVITY MONITOR

Thursday 9 December 2010

Page 10: Visualizing Activities for Self-reflection and Awareness

STUDENT ACTIVITY MONITOR

Thursday 9 December 2010

Page 11: Visualizing Activities for Self-reflection and Awareness

STUDENT ACTIVITY MONITOR

Thursday 9 December 2010

Page 12: Visualizing Activities for Self-reflection and Awareness

STUDENT ACTIVITY MONITOR

Thursday 9 December 2010

Page 13: Visualizing Activities for Self-reflection and Awareness

DATA & DEPLOYMENTS

• Contextualized Attention Metadata (CAM) data

• deployed in:

• ROLE PLE• RWTH-Aachen engineering• tim3track3r• Moodle

Thursday 9 December 2010

Page 14: Visualizing Activities for Self-reflection and Awareness

EVALUATION DATA

• no students using a CAM controled PLE yet...

• need time tracking data

• use

Thursday 9 December 2010

Page 15: Visualizing Activities for Self-reflection and Awareness

TIM3TRACK3R

http://tim3track3r.appspot.com

Thursday 9 December 2010

Page 16: Visualizing Activities for Self-reflection and Awareness

EVALUATION

• usability and user satisfaction evaluation

• 12 CS students

• 2 evaluation sessions:

• task based interview with think aloud (after 1 week of tracking)

• user satisfaction (SUS & MSDT) (after 1 month)

Thursday 9 December 2010

Page 17: Visualizing Activities for Self-reflection and Awareness

• in general, people understand the visualizations well!

• some issues were uncovered...

LEARNABILITY, ERRORS & EFFICIENCY

Thursday 9 December 2010

Page 18: Visualizing Activities for Self-reflection and Awareness

LEARNABILITY, ERRORS & EFFICIENCY

Thursday 9 December 2010

Page 19: Visualizing Activities for Self-reflection and Awareness

LEARNABILITY, ERRORS & EFFICIENCY

Thursday 9 December 2010

Page 20: Visualizing Activities for Self-reflection and Awareness

LEARNABILITY, ERRORS & EFFICIENCY

Thursday 9 December 2010

Page 21: Visualizing Activities for Self-reflection and Awareness

LEARNABILITY, ERRORS & EFFICIENCY

Thursday 9 December 2010

Page 22: Visualizing Activities for Self-reflection and Awareness

LEARNABILITY, ERRORS & EFFICIENCY

Thursday 9 December 2010

Page 23: Visualizing Activities for Self-reflection and Awareness

LEARNABILITY, ERRORS & EFFICIENCY

Thursday 9 December 2010

Page 24: Visualizing Activities for Self-reflection and Awareness

LEARNABILITY, ERRORS & EFFICIENCY

Thursday 9 December 2010

Page 25: Visualizing Activities for Self-reflection and Awareness

LEARNABILITY, ERRORS & EFFICIENCY

Thursday 9 December 2010

Page 26: Visualizing Activities for Self-reflection and Awareness

USER SATISFACTION

• average SUS score: 73% (stdv: 9,35)

Thursday 9 December 2010

Page 27: Visualizing Activities for Self-reflection and Awareness

USER SATISFACTION

Thursday 9 December 2010

Page 28: Visualizing Activities for Self-reflection and Awareness

USER SATISFACTION

Thursday 9 December 2010

Page 29: Visualizing Activities for Self-reflection and Awareness

USER SATISFACTION

Thursday 9 December 2010

Page 30: Visualizing Activities for Self-reflection and Awareness

USER SATISFACTION

Thursday 9 December 2010

Page 31: Visualizing Activities for Self-reflection and Awareness

CONCLUSION & FUTURE WORK

• people can use and understand the tool, but we need to evaluate the usefulness

• evaluate the real usefulness of the tool with more students

• we already did a study with teachers

Thursday 9 December 2010

Page 32: Visualizing Activities for Self-reflection and Awareness

USE IT!?

• I can put your data into the tool!

• I would like to use your course for evaluation!

Thursday 9 December 2010

Page 33: Visualizing Activities for Self-reflection and Awareness

THANK YOU!QUESTIONS?

slides will appear on http://www.slideshare.net/stengovaerts

Thursday 9 December 2010