Learning analytics gaining good actionable insight

  • View
    968

  • Download
    2

Embed Size (px)

Transcript

PowerPoint Presentation

Learning Analytics: Gaining good actionable insightMartin Hawksey@mhawksey

alt.ac.ukSlide #

@mhawksey2

go.alt.ac.uk/join-ALT

alt.ac.ukSlide #

@mhawksey3

alt.ac.ukSlide #

@mhawksey4

ALT Online Winter Conference 2015Week commencing 7th December2015

http://go.alt.ac.uk/ALT-Online-2015-Call(call closes 9am on Mon 2nd Nov. 2015)

alt.ac.ukSlide #

@mhawksey5#altc

alt.ac.ukSlide #

How much do you know about Learning Analytics?In small groups share what you know about Learning Analytics 4mins@mhawksey6

alt.ac.uk

alt.ac.ukSlide #

@mhawksey

7

alt.ac.uk

alt.ac.ukSlide #

@mhawksey

8

alt.ac.uk

alt.ac.ukSlide #

Patterns are left behindCourtesy Marc Smith http://www.slideshare.net/Marc_A_Smith/2013-nodexl-social-media-network-analysis9

9I can look at the tracks people have left behind in their interactions with me.alt.ac.ukSlide #

Analytics in EducationAnalytics is the process of developing actionable insights through problem definition and the application of statistical models and analysis against existing and/or simulated future data

Adam Cooper, What is Analytics? http://publications.cetis.ac.uk/wp-content/uploads/2012/11/What-is-Analytics-Vol1-No-5.pdf

@mhawksey10

alt.ac.uk

alt.ac.ukSlide #

Learning Analytics Definitionthe measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occursFirst International Conference on Learning Analytics and Knowledge (LAK11), 2011

@mhawksey11

alt.ac.uk

alt.ac.ukSlide #

DisciplinesComputer scienceStatisticsProgrammingNetwork analysisPsychology of education@mhawksey12

alt.ac.uk

alt.ac.ukSlide #

MethodsContent Analytics Context AnalyticsDiscourse AnalyticsDisposition AnalyticsSocial Network Analysis@mhawksey13Ferguson and Buckingham Shum (2012)Social Learning Analytics: Five Approaches

alt.ac.uk

Ferguson and Buckingham Shum (2012)'sSocial Learning Analytics: Five Approachesdefines five dimensions of social learning for which one could create instruments:social network analytics interpersonal relationships define social platformsdiscourse analytics language is a primary tool for knowledge negotiation and constructioncontent analytics user-generated content is one of the defining characteristics of Web 2.0disposition analytics intrinsic motivation to learn is a defining feature of online social media, and lies at the heart of engaged learning, and innovationcontext analytics mobile computing is transforming access to both people and content.

alt.ac.ukSlide #

Tools/ProductsSpreadsheets - MS Excel, Tableau, Open Refine, Google SheetsSNA NodeXL, Gephi, CytoscapeProgramming: R, Python, MATLAB VLEs - Blackboard Analytics for Learn, Desire2Learn Insights @mhawksey14

alt.ac.uk

alt.ac.ukSlide #

@mhawksey15ActionAnalyticDataQuestion

alt.ac.uk

Data whatWhat?PlatformServiceAvailabilityAccess

Analytic howHow?Social networkDiscourse ContentDispositionContextAdministration

Action = whoWho?InstitutionTutorSelfEducationalCommercial

alt.ac.ukSlide #

@mhawkseyThe Absence of Theory16

alt.ac.uk

alt.ac.ukSlide #

Amazon cares not a whit *why* people who buy german chocolate also buy cake pans as long as they get to the checkout buying both

Mike Caulfield - Short Notes on the Absence of Theory http://hapgood.us/2013/12/10/short-notes-on-the-absence-of-theory/@mhawksey17

alt.ac.uk

Association alt.ac.ukSlide #

Counts dont count much if decontextualized

Wilson, T.D. (1999). Models in information behaviour research. Journal of Documentation, 55(3), 249 270.

@mhawksey

Dragan Gasevic speaking at DiCE SeminarMoray House School of Education 9th January 2015 18

alt.ac.uk

alt.ac.ukSlide #

@mhawksey

Dragan Gasevic speaking at DiCE SeminarMoray House School of Education 9th January 2015 Analytics to account for conditions, operations, products, evaluation, and standards (COPES)Gaevi, D., Dawson, S., Siemens, G. (2015). Let's not forget: Learning analytics are about learning.TechTrends, 59(1), 64-71, https://bit.ly/techtrends1519

alt.ac.uk

alt.ac.ukSlide #

@mhawkseyData Visualization20

alt.ac.uk

alt.ac.ukSlide #

21

alt.ac.ukSlide #

@mhawksey22

Image credit: http://practicalanalytics.co/2014/06/02/cloud-based-healthcare-platform-apples-health-app-and-healthkit/

alt.ac.ukSlide #

Graphs can be a powerful way to represent relationships between data, but they are also a very abstract concept, which means that they run the danger of meaning something only to the creator of the graph Everything looks like a graph, but almost nothing should ever be drawn as one.

Ben Fryin Visualizing Data@mhawksey23

alt.ac.uk

alt.ac.ukSlide #

Exploratory visualizationData visualizations that are used by the designer for self-informative purposes to discover patterns, trends, or sub-problems in a dataset. Exploratory visualizations typically dont have an already-known story.

Explanatory visualizationData visualizations that are used to transmit information or a point of view from the designer to the reader. Explanatory visualizations typically have a specific story or information that they are intended to transmit.

Iliinsky & Steele - Designing Data Visualizations: Representing Informational Relationships@mhawksey24

alt.ac.uk

24alt.ac.ukSlide #

Visualizations can be harmfulCorrin, L., & de Barba, P. (2014). Exploring students interpretation of feedback delivered through learning analytics dashboards. In Proceedings of the ascilite 2014 conference (pp. 629-633). ascilite.

@mhawksey

Dragan Gasevic speaking at DiCE SeminarMoray House School of Education 9th January 2015 25

alt.ac.uk

alt.ac.ukSlide #

Visualizations can be usefulif embedded into and fit learning tasks@mhawksey

Dragan Gasevic speaking at DiCE SeminarMoray House School of Education 9th January 2015 26

alt.ac.uk

alt.ac.ukSlide #

@mhawkseyEthics, privacy and data sharing27

alt.ac.uk

alt.ac.ukSlide #

The worlds of privacy and analytics intersect

Downes (2014)@mhawkseynot always happily28

UnknownSource: http://crooksandliars.com/files/primary_image/14/05/inbloom-drawing.jpg

alt.ac.uk

Not surveillance and control but guidance and support alt.ac.ukSlide #

EthicsClarity Comfort and careChoice and consent Consequence and complaint@mhawksey29Legal, Risk and Ethical Aspects of Analytics in Higher Education (Kay, Korn, & Oppenheim, 2012)

alt.ac.uk

Clarity - open definition of purpose, scope and boundaries, even if that is broad and in some respects extent open-ended. Comfort and care - consideration for both the interests and the feelings of the data subject and vigilance regarding exceptional cases. Choice and consent - informed individual opportunity to opt-out or opt-in. Consequence and complaint - recognition that there may be unforeseen consequences and therefore provision of mechanisms for redress. (p. 6)

alt.ac.ukSlide #

@mhawksey30

http://www.open.ac.uk/students/charter/essential-documents/ethical-use-student-data-learning-analytics-policy

alt.ac.uk

alt.ac.ukSlide #

@mhawksey31

https://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics

alt.ac.uk

alt.ac.ukSlide #

@mhawkseyOpportunities32

alt.ac.uk

alt.ac.ukSlide #

Feedback loops between students and instructors are missing!

Hattie, J., & Timperley, H. (2007). The power of feedback. Review of education research, 77(1), 82-112.

@mhawksey33

alt.ac.uk

alt.ac.ukSlide #

At best analytics can help start a conversation. People have to be willing to take the conversation on

Roberts, G. Analytics are not relationships http://rworld2.brookesblogs.net/2014/12/12/analytics-are-not-relationships/ @mhawksey34

alt.ac.uk

alt.ac.ukSlide #

What might you use Learning Analytics for?In small groups discuss 5mins@mhawksey35

alt.ac.uk

alt.ac.ukSlide #

@mhawkseyExamples36

alt.ac.uk

alt.ac.ukSlide #

Optimal Video Length

Philip Guo, Optimal Video Length for Student Engagement@mhawksey

alt.ac.uk

edX analysis of optimum instructional video length. Data suggests maximum length of 6 minutes for best engagement.37alt.ac.ukSlide #

Misconception or mistakes in MCQs@mhawksey38

Koller, D The Online Revolution: Education at Scale (2012) http://youtu.be/ixE1YAlHnVU?t=29m16s

alt.ac.uk

Analytics at scale: Course SignalsDeveloped at Purdue University, USA39

Arnold, K. E., & Pistilli, M. (2012). Course Signals at Purdue: Using Learning Analytics To Increase Student Success. Paper presented at LAK12, Vancouver, Canada. http://www.slideshare.net/R3beccaF/scaling-up-learning-analytics

Easily accessible OU dataLearning design and analytics at the OU40

http://www.slideshare.net/R3beccaF/scaling-up-learning-analytics

Scaling up Learning Analytics41

https://www.youtube.com/watch?v=Ii4EgnOvpxA@mhawksey

alt.ac.uk

@mhawkseyWrapping up42

alt.ac.uk

alt.ac.ukSlide #

Learning activities dont happen in a single platform

Drago