Embed Size (px)
DESCRIPTION
For the past two academic years, the ePortfolio team at the University of Michigan has administered pre and post surveys to students that were using ePortfolios for the purpose of fostering integrative, lifelong, and lifewide learning. This session will present results from this longitudinal research, focusing on specific trends, significant findings and implications of this research for conducting integrative assessments of students' academic and co-curricular learning.
Citation preview
USE Lab • Digital Media Commons • University of Michigan
Investigating Changes in Integrative and Lifelong
Learning: Students’ Use of ePortfolios
Steven LonnResearch Specialist
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Courses
Job
Living
Extracurricu
lar
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Reflective
Integrative
Real-World
Evidence-Based
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Pre & Post Surveys
Twelve learning outcome categories:
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Pre & Post Surveys
And... activities, opinions, and perspectives about the portfolio process
And... activities, opinions, and perspectives about the portfolio process
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
1 2 3 4 5
6 7 8 9 10
11 12 13 14 15
16 17 18 19 20
21 22 23 24 25
26 27 28 29 30
31 32 33 34 35
36 37
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
1 2 3 4 5
6 7 8 9 10
11 12 13 14 15
16 17 18 19 20
21 22 23 24 25
26 27 28 29 30
31 32 33 34 35
36 37
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
12
3
4
5
6
78
9
1011
12
1314
15
16
17
18
19
20
21
2223
24
2526
27
28
2930
31
32
33
3435
36
37
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Capacity to demonstrate and apply knowledge of various sorts
11 Items
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Recognition & understanding of intercultural and collaborative situations
6 Items
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Self-awareness of learning across settings
7 Items
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Insight into the process of working with others
6 Items
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Engagement with factors that influence my perspectives and decisions
4 Items
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Developing a professional identity
3 Items
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
620 Pre-Post Surveys Over Two Years
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Factor Pre-Survey Post-Survey Gain
demonstrate and apply knowledge 3.88 4.26 0.38
intercultural & collaborative situations 4.42 4.49 0.07
self-awareness of learning 4.25 4.42 0.17
process of working with others 4.12 4.31 0.19
factors that influence my perspectives & decisions 4.30 4.45 0.15
developing a professional identity 3.49 4.09 0.60
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Portfolio ProcessPortfolio ProcessPortfolio ProcessPortfolio ProcessPortfolio ProcessPortfolio Process
0
0.25
0.5
0.75
0.1
0.20.1 0.2
0.4
0.6
0.1
0.20.2
0.3
0.70.6
MultipleSingle
intercultural & collaborative
situations
process of working with
others
factors that influence my
perspectives & decisions
self-awareness of learning
demonstrate and apply
knowledge
developing a professional
identity
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Humanities 60
Natural Sciences 108
Social Sciences 310
# of Students
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
0
0.25
0.5
0.75
0.03
0.09 0.080.12
0.29
0.57
0.160.20
0.31 0.29
0.50
0.71
0.13
0.250.28
0.35
0.46
0.58
HumanitiesNatural ScienceSocial Science
intercultural & collaborative
situations
factors that influence my
perspectives & decisions
self-awareness of learning
process of working with
others
demonstrate and apply
knowledge
developing a professional
identity
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Context Matters...
Michigan Research Community / Women in Science & Enginering
(MRC / WISE)
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Context Matters...
School of EducationCommuter Campus
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Context Matters...
Residential Housing Staff
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Context Matters...
Writing Center Program Courses
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
0 0.25 0.5 0.75 1
0.0
0.2
0.1
0.2
0.5
0.3
0.1
0.2
0.2
0.2
0.6
0.4
0.0
0.1
0.1
0.1
0.6
0.3
0.3
0.4
0.4
0.5
0.6
0.9
MRC/WISE Education Res Staff Writing
developing a professional
identity
demonstrate and apply
knowledge
self-awareness of learning
factors that influence my
perspectives & decisions
process of working with
others
intercultural & collaborative
situations
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
3
3.5
4
4.5
5
Pre-Survey
developing a professional
identity
demonstrate and apply
knowledge
process of working with
others
self-awareness of learning
factors that influence my
perspectives & decisions
intercultural & collaborative
situations
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
3
3.5
4
4.5
5
developing a professional
identity
demonstrate and apply
knowledge
process of working with
others
self-awareness of learning
factors that influence my
perspectives & decisions
intercultural & collaborative
situations
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
No Differences!(sign
ificant)
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
No Differences!(sign
ificant)
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
No Differences!(sign
ificant)
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
??
?
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Gener
ative
Inte
rview
Giving
feed
back
Shar
ing po
rtfoli
o w/o
ther
s
Receiv
ing fe
edba
ck
Putti
ng ev
eryth
ing to
geth
er
Making
conn
ectio
ns
ID va
lues, s
treng
ths, e
tc.
Docum
entin
g you
r wor
k
ID kn
owled
ge an
d skil
ls
Reflec
ting o
n wor
k1
2
3
4
5
3.223.44 3.53
3.7
4.01 4.05 4.07 4.15 4.18 4.21
Not Important
Very Important
While creating your portfolio, how important was...
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
What do you think was the purpose of creating an electronic portfolio as part of your course or program?
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Who (which groups of students) do you think would most benefit from the process of creating an electronic portfolio?
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Contexts
Measurable Outcomes
Qualitative Content
Perceptions
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Qualitative Content
Measurable Outcomes
Perceptions
Contexts
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
USE Labhttp://umich.edu/~uselab
Digital Media CommonsUniversity of Michigan
Survey PowerAnalysis at Scale
Other Ideas...
USE Lab • Digital Media Commons • University of Michigan
THANK YOU!
Steven Lonn
http://umich.edu/~uselab
