View
1.099
Download
4
Embed Size (px)
Citation preview
Learning Analytics: Gaining good actionable insight
Martin Hawksey
@mhawksey
Chief Innovation, Community and Technology Officer
@mhawksey 2
go.alt.ac.uk/join-ALT
alt.ac.uk @mhawksey 3
“
alt.ac.uk
Analytics in Education
Analytics is the process of developing actionable insights through problem definition and the
application of statistical models and analysis against existing and/or simulated future data
Adam Cooper, What is Analytics? http://publications.cetis.ac.uk/wp-content/uploads/2012/11/What-is-Analytics-Vol1-No-5.pdf
@mhawksey 4
“
alt.ac.uk
Learning Analytics Definition
…the measurement, collection, analysis and
reporting of data about learners and their
contexts, for purposes of understanding and
optimising learning and the environments in
which it occurs
First International Conference on Learning Analytics and Knowledge (LAK11), 2011
@mhawksey 5
alt.ac.uk
Poll question here
@mhawksey 6
alt.ac.uk
Disciplines
◊ Computer science
◊ Statistics
◊ Programming
◊ Network analysis
◊ Psychology of education
◊ …
@mhawksey 7
alt.ac.uk
Methods
◊ Content Analytics
◊ Context Analytics
◊ Discourse Analytics
◊ Disposition Analytics
◊ Social Network Analysis
◊ …
@mhawksey 8
Ferguson and Buckingham Shum (2012) Social Learning Analytics: Five Approaches
alt.ac.uk
Tools/Products
◊ Spreadsheets - MS Excel, Tableau, Open
Refine, Google Sheets…
◊ SNA – NodeXL, Gephi, Cytoscape
◊ Programming: R, Python, MATLAB…
◊ VLEs - Blackboard Analytics for Learn,
Desire2Learn Insights …
◊ …
@mhawksey 9
alt.ac.uk
@mhawksey 10
Action
Analytic
Data
Question
alt.ac.uk @mhawksey
The Absence of Theory
11
“
alt.ac.uk
Amazon cares not a whit *why* people who buy
german chocolate also buy cake pans as long as
they get to the checkout buying both
Mike Caulfield - Short Notes on the Absence of Theory
http://hapgood.us/2013/12/10/short-notes-on-the-absence-of-theory/
@mhawksey 12
“
alt.ac.uk
Counts don’t count much if decontextualized
Wilson, T.D. (1999). Models in information behaviour research. Journal of
Documentation, 55(3), 249 – 270.
@mhawksey
Dragan Gasevic speaking at DiCE Seminar
Moray House School of Education – 9th January 2015
13
alt.ac.uk @mhawksey
Data Visualization
14
15
@mhawksey 16
Image credit: http://practicalanalytics.co/2014/06/02/cloud-based-healthcare-platform-
apples-health-app-and-healthkit/
“
alt.ac.uk
Graphs can be a powerful way to represent relationships
between data, but they are also a very abstract concept, which
means that they run the danger of meaning something only to
the creator of the graph … Everything looks like a graph, but
almost nothing should ever be drawn as one.
Ben Fry in ‘Visualizing Data’
@mhawksey 17
alt.ac.uk
Exploratory visualization
Data visualizations that are used by the
designer for self-informative purposes to
discover patterns, trends, or sub-problems in a
dataset. Exploratory visualizations typically
don’t have an already-known story.
Explanatory visualization
Data visualizations that are used to transmit
information or a point of view from the designer
to the reader. Explanatory visualizations
typically have a specific “story” or information
that they are intended to transmit.
Iliinsky & Steele - Designing
Data Visualizations:
Representing Informational
Relationships
@mhawksey 18
“
alt.ac.uk
Visualizations can be harmful
Corrin, L., & de Barba, P. (2014). Exploring students’ interpretation of feedback
delivered through learning analytics dashboards. In Proceedings of the ascilite
2014 conference (pp. 629-633). ascilite.
@mhawksey
Dragan Gasevic speaking at DiCE Seminar
Moray House School of Education – 9th January 2015
19
alt.ac.uk @mhawksey
Ethics, privacy and data sharing
20
“
alt.ac.uk
The worlds of privacy
and analytics intersect
Downes (2014)
@mhawksey
…not always happily
21
© Unknown
Source: http://crooksandliars.com/files/primary_image/14/05/inbloom-drawing.jpg
alt.ac.uk
Ethics
◊ Clarity
◊ Comfort and care
◊ Choice and consent
◊ Consequence and complaint
@mhawksey 22
Legal, Risk and Ethical Aspects of Analytics in Higher Education (Kay, Korn,
& Oppenheim, 2012)
alt.ac.uk @mhawksey 23
http://www.open.ac.uk/students/charter/essential-documents/ethical-use-student-
data-learning-analytics-policy
alt.ac.uk @mhawksey 24
https://www.jisc.ac.uk/guides/code-of-practice-for-learning-analytics
alt.ac.uk @mhawksey
Opportunities
25
“
alt.ac.uk
Feedback loops between students and instructors are missing!
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of education research, 77(1), 82-112.
@mhawksey 26
“
alt.ac.uk
At best analytics can help start a
conversation. People have to be willing
to take the conversation on
Roberts, G. Analytics are not relationships
http://rworld2.brookesblogs.net/2014/12/12/analytics-are-not-relationships/
@mhawksey 27
alt.ac.uk @mhawksey
Examples
28
alt.ac.uk
Optimal Video Length
Philip Guo, Optimal Video Length for Student Engagement
@mhawksey
alt.ac.uk
Misconception or mistakes in MCQs
@mhawksey 30
Koller, D The Online Revolution: Education at Scale (2012)
http://youtu.be/ixE1YAlHnVU?t=29m16s
Analytics at scale: Course Signals
Developed at Purdue University, USA
31 Arnold, K. E., & Pistilli, M. (2012). Course Signals at Purdue: Using Learning Analytics
To Increase Student Success. Paper presented at LAK12, Vancouver, Canada.
http://www.slides
hare.net/R3becca
F/scaling-up-
learning-analytics
Easily accessible OU data
Learning design and analytics at the OU
32
http://www.slides
hare.net/R3becca
F/scaling-up-
learning-analytics
alt.ac.uk
Scaling up Learning Analytics
33
https://www.youtube.com/watch?v=Ii4EgnOvpxA
@mhawksey
alt.ac.uk @mhawksey
Wrapping up
34
“
alt.ac.uk
Learning activities don’t happen in a
single platform
Dragon Gasevic
@mhawksey 35
“
alt.ac.uk
Not everything that can be counted counts.
Not everything that counts can be counted.
William Bruce Cameron
@mhawksey 36
“
alt.ac.uk
What kind of learners are we trying
to create?
… this should drive our analytics
Simon Buckingham Shum
@mhawksey 37
alt.ac.uk
Computers are stupid
@mhawksey 38
https://twitter.com/jackyalcine/status/615329515909156865
alt.ac.uk
Useful links
• LACE (learning analytics community exchange) :
http://www.laceproject.eu/
• SoLAR : Society for Learning Analytics Research
http://solaresearch.org/
• Jisc: http://analytics.jiscinvolve.org/wp
• Cetis Analytics Series : http://publications.cetis.ac.uk/c/analytics
• LAK16 Conference #lak16
From http://www.slideshare.net/sheilamac/intro-to-learning-analytics-universities-
scotlanddec2014smn
@mhawksey 39
alt.ac.uk
Thank you!
@mhawksey +MartinHawksey
@mhawksey 40
Association for Learning Technology
Registered charity number: 1063519
www.alt.ac.uk @A_L_T