Analytics to understand learning environments

r2hoxFlickrAnalytics to understand learningenvironments

Chai Seminar, 14 April 2014

Dr Abelardo Pardo (@abelardopardo)School of Electrical and Information Engineering

slideshare.net/abelardo_pardo

Abelardo Pardo Analytics to understand learning environments 2

Records

WFlickr

Lecturer at School of EIE

Two coursesGrad/Undergrad

Active learning

Use of technology

Tech to empower individualsand communities

Behavioral analytics

User validation

dianetellFlickrPragmaticapproach

Dogfooding!

Maximize impact

VanessaOflickr.com

“Historically, humanity has made sense of the worldthrough discourse, dialogue, artifacts, myth, story,and metaphor. While those sensemaking approacheswon’t disappear, they will be augmented by data andanalytics.”

(Siemens, 2014 www.elearnspace.org/blog)

flickr.com

LearningAnalytics

Observe andCollect

View and Act

Self-motivation

Flippedclassroom

flickr.com

LearningAnalytics

Unhindered

byTalentflickr.com

Many colleges and universities have demonstratedthat analytics can help significantly advance aninstitution in such strategic areas as resourceallocation, student success, and finance

(Bichsel, 2012)

WSJ 19/07/12

How do you read?

NY Times 24/11/12

Humans are Subjective

Mind Sights: Original Visual Illusions, Ambiguities, and Other Anomalies, With a Commentary on the Play of Mind in Perception and Art, Roger N. Shepard, 1990

apasciutoflickr.com

Tools, technology,algorithms

Educational design,pedagogical strategies

Kurafire

flickr.com

Feedback as a dialogue

TanakaJuuyoh

flickr.com

Tight feedback loop

“We need better evaluationto acknowledge and esteem

excellence when it occurs,as it does.”

Bencrow

eFlickr

(Hattie, 2009)

flickr.com

LearningAnalytics

Observe andCollect

ookeFlickr.comObserve while

working oncourse

activities

A clearly identifiedenvironment within

your computer

Davies

flickr.com

(Pardo & Delgado Kloos, 2011)

InstrumentationPersonal Computer

ComputerTool 1

ComputerTool 2

ComputerTool 3

ComputerTool 4

Authenticated

Virtual Computer

ComputerTool

EventDataset

PersonalData

Encoding

Report

InstructorStudent

Varlanflickr.com

Tool usage vs academic performance

(Romero-Zaldívar et al., 2012)

Chiot’s

Flickr.com

Collect URLs Compare withcourse notes

Detect newresources

(Romero-Zaldívar et al., 2011)

Adventures

inLibrarianship

flickr.com

Detect engagementwhile writing

(Calvo et al., 2011, Liu et al., 2013)

Facial expressions

Detect emotions

(Monkaresi et al., 2012)

flickr.com

LearningAnalytics

Observe andCollect

View and Act

Learning glass

(Crespo et al. 2012, Leony et al., 2012)

Showquestion

Showcorrect

Showincorrect

Showsolutions

Transitions are recorded(Pardo et al., 2012)

Just in time teaching

Browser add-in

flickr.com

LearningAnalytics

Observe andCollect

View and Act

Self-motivation

“Transition” for patients with a chronic illness

(Calvo et al., 2013)

Self-determination theory and types ofmotivation

(Ryan and Deci, 2000)

Explore the most adequate channels to dialoguewith the patient.

(Yu Zhao, ASWEC Doctoral Consortium 2014)

Matheson

LearningC

onsflickr.com

First-year transition

KeoniC

abralflickr.com

Tech for high stakes finite time periods

flickr.com

LearningAnalytics

Observe andCollect

View and Act

Self-motivation

Flippedclassroom

Increasing use of videos

What is missing?

AnnotationHighlight areas of importanceCollaborationIntegration in learning environment

Students “comment” on video with someguidance

(OLT Project, Using video annotation software to develop student self-regulated learning)

KreativeK

ewlflickr.com

Flipped Classroomdoes not exist!

(Bergmann & Sams, 2012)

Lflickr.com

Old idea, but revived due to two reasons

Krugazorflickr.com

(Mazur, 2009)

Simple transfer of information is not optimal!

Juantan

onflickr.com

Resourceseverywhere!

Fellmannia

flickr.com

Face-to-face timeis very valuable!

-flickr.com

Remember

Understand

Analyze

Evaluate

Create

Can we do better?

-flickr.com

Remember

Understand

Analyze

Evaluate

Create

p_a_hflickr.com

A) Previous activities (Be prepared!)

Hijukalflickr.com

B) Activities face-to-face

Flyinggflickr.com

Great case for datasupported decisions!

Weekly activities

Previous andin-class activitiesfor each session

Detecting when blocks of text are visualized

Interactions with videos

Questions embedded in text

Problem Sequences

Data back to the students

Your activity with respect to the rest of the class

Eleafflickr.com

• Will students use dataabout their events?

• Will they act on what theysee?

• Will the tips have anyeffect?

(OLT Project, Radical transformation: re-imagining engineeringeducation through flipping the classroom in a global learningpartnership)

r2hoxFlickrAnalytics to understand learningenvironments

Chai Seminar, 14 April 2014

Dr Abelardo Pardo (@abelardopardo)School of Electrical and Information Engineering

slideshare.net/abelardo_pardo

References

Bichsel, J. (2012).Analytics in Higher Education Benefits, Barriers, Progress, and Recommendations.EDUCAUSE Center for Applied Research

Hattie, J. A. C. (2009).Visible learning: A synthesis of over 800 meta-analyses related to achievement.New York: Routledge.

Pardo, A., Delgado Kloos, C., 2011,Stepping out of the box. Towards analytics outside the Learning Management SystemInternational Conference on Learning Analytics and Knowledge, pp, 163-167, ACM New York, USA

Romero-Zaldívar, V.A., Pardo, A., Burgos, D., Delgado Kloos, C., 2012Monitoring Student Progress Using Virtual Appliances: A Case StudyComputer & Education, 58(4):10580–1067, 2012

Romero-Zaldívar, V.A., Crespo García, R., Burgos, D., Delgado Kloos, C., Pardo, A., 2012Automatic Discovery of Complementary Learning ResourcesEuropean Conference on Technology Enhanced Learning, 2011

References II

Liu M., Calvo, R.; Pardo, A., 2013Visualizing the effect of actions in personal informatics systemsWorkshop on Personal Informatics, CHI’13

Calvo, R., O’Rourke, S.T., Jones, J., Yacef, K., Reimann, P., 2011Collaborative Writing Support Tools on the CloudIEEE Transactions on Learning Technologies, 4(1):88–97

Monkaresi, H., Hussain, M. S., Calvo, R., 2012A dynamic approach for detecting naturalistic affective states from facial videos during HCIAustralasian Joint Conference on Artificial Intelligence, Sydney, Australia. LNAI, Springer 2012, pp.170-181

Crespo García, R.M., Pardo, A., Delgado Kloos, C., Niemann, K., Scheffel, M., Wolpers, M., 2012Peeking into the black box: visualising learning activities.International Journal on Technology Enhanced Learning, 4(1/2), 2012

Leony, D., Pardo A., De la Fuente Valentín, L., Sánchez de Castro, D., Delgado Kloos, C. 2012GLASS : A Learning Analytics Visualization ToolInternational Conference on Learning Analytics and Knowledge, pp. 162-163, ACM Press.

References III

Calvo, R. A., Pardo, A., Zhao, Y., Klineberg, E., Lam, M., and Steinbeck, K. 2013.TransitionMate: a mobile application for chronic illness transition support.In C. Röcker, M. Ziefle, A. Holzinger, K. McGee, S. Hansen, and J. Meyer (Eds.), Fifth InternationalWorkshop on Smart Healthcare and Wellness Applications (SmartHealth’13) - OzCHI 2013, Nov 25-26.Adelaide, South Australia: ACM.

Ryan, R., and Deci, E. (2000).Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.American Psychologist, 55(1), 68–78.

Bergmann, J., Sams, A., (2012)Flip Your Classroom: Reach Every Student in Every Class Every DayHawker Brownlow Education

Mazur, E., (2009)Farewell, Lecture?Science, 323, pp. 50-51.

Analytics to understand learning environments

Education

Handbook for Completing Course Outlines · 1. Understand modern data analytics in the context of typical business problems, data environments, business structures and customer contexts

CTE2017 Programming with ScratchJr a year of analytics ...ase.tufts.edu/devtech/publications/Leidl_Bers_Mihm_ScratchJrAnalyticsHongKong.pdf4.1. Google Analytics Tool To better understand

A Visual Analytics Approach for Assessing Pedestrian Friendliness of Urban Environments

Fasterclass: Using Google Analytics Custom Segments to Better Understand Your Audience

Google Analytics - Understand How to Correctly Track Your Website Visitors

Analytics for decision making in Learning Environments

DQNViz: A Visual Analytics Approach to Understand Deep Q ... · DQNViz: A Visual Analytics Approach to Understand Deep Q-Networks ... For the challenge of understanding the agent’s

Analytics: self-made or 3rd-party to understand your user-base

Understand your multi-screen users with Google Analytics

Using Real-Time Analytics to Understand Clinical Data

Social Media Analytics in Multicultural Environments

SQL-Like Big Data Environments: Case study in Clinical Trial Analytics

Promotions Analytics - dunnhumby.com€¦ · Promotions Analytics Improve promotional performance with Customer Data Science Promotions Analytics enables you to understand past promotions,

Creating Data-Informed Learning Environments Synergies for Learning Analytics & Learning Design

Learning Analytics - Unit · Multimodal learning analytics. Process data. to understand learning •Students & Teachers / Instructors •Institutions •Researchers. Stakeholders

M ODULE 5 FOUNDATIONS OF ANALYTICS. OBJECTIVES To understand the fundamentals of business analytics. To know the evolution of business analytics. To study

Databases 3 - University of Manchesterstudentnet.cs.manchester.ac.uk/.../03_Lecture-OLAP.pdf · Data analytics Common goals: understand and get to “know” and “understand”

Innovative Learning Environments Research · PDF fileInnovative Learning Environments Research Study. ... To understand an Innovative Learning ... whether and how individuals engage

Google Analytics - Understand How to Correctly Track Your Web Visitors

Operational Management Environments PDFS/6E-Adler.pdfOperational Management Environments Improved Solution Architectures for Multimodal ... Response Orchestration Advanced Analytics