Upload
others
View
7
Download
0
Embed Size (px)
Citation preview
1
BalancingBalancing
““ePortfolioePortfolio asas TTestest”” withwith
““ePortfolioePortfolio asas SStorytory””
Dr. Helen BarrettDr. Helen Barrett
International Society forInternational Society for
Technology in Education andTechnology in Education and
University of Alaska AnchorageUniversity of Alaska Anchorage
Three Topics in thisThree Topics in this
PresentationPresentation
�� Assessment - for what purpose?Assessment - for what purpose?
�� OF or FOR Learning?OF or FOR Learning?
�� Conflicting ParadigmsConflicting Paradigms in Electronic Portfolioin Electronic Portfolio
DevelopmentDevelopment
�� Assessment Management or Assessment Management or ePortfolioePortfolio??
�� Electronic Portfolios asElectronic Portfolios as Digital StoriesDigital Stories
�� Deep Learning and Intrinsic MotivationDeep Learning and Intrinsic Motivation
A few thoughts aboutA few thoughts about
Assessment -- What Type?Assessment -- What Type?
�� Assessment OFAssessment OFLearning? orLearning? or
�� Assessment FORAssessment FORLearning?Learning?
Purposes ofPurposes of
AssessmentAssessment
�� AssessmentAssessment forfor learning learning
(formative or classroom-based(formative or classroom-based
assessment) is different fromassessment) is different from
assessmentassessment ofof learning learning
(summative assessment)(summative assessment)�� An important aspect of assessment An important aspect of assessment forfor learning is the learning is the
formativeformative use of use of summativesummative data. data.
AssessmentAssessment OFOF Learning= Learning=
SummativeSummative�� Involves judging pupils' performanceInvolves judging pupils' performance
against national standards (levelagainst national standards (leveldescriptions).descriptions).
�� Teachers often make these judgments atTeachers often make these judgments atthe end of a unit of work, year or key stage.the end of a unit of work, year or key stage.
�� Test results also describe pupilsTest results also describe pupilsperformance in terms of levels.performance in terms of levels.
�� Carried out for the purposes of gradingCarried out for the purposes of gradingand reporting (ARG, 1999).and reporting (ARG, 1999).
Time Perspective: Past -> Present
AssessmentAssessment FORFOR Learning = Learning =
FormativeFormative
�� While it is not the only purpose,While it is not the only purpose,
AssessmentAssessment forfor learning is one of thelearning is one of the
most important purposes of assessment.most important purposes of assessment.
�� While assessmentWhile assessment ofof learning has welllearning has well
established procedures, assessmentestablished procedures, assessment forfor
learning requires some theoretical ideas tolearning requires some theoretical ideas to
be put into practice if the potential benefitsbe put into practice if the potential benefits
are to be gained.are to be gained.
Time Perspective: Present -> Future
2
Principles ofPrinciples of
Assessment FOR LearningAssessment FOR Learning
�� Definition:Definition:
Assessment for Learning is theAssessment for Learning is the
process of seeking and interpretingprocess of seeking and interpreting
evidence for use by learners andevidence for use by learners and
their teachers to decide where thetheir teachers to decide where the
learners are in their learning, wherelearners are in their learning, where
they need to go and how best to getthey need to go and how best to get
there.there.
www.www.qcaqca.org..org.ukuk
ages3-14ages3-14
Assessment OF Learning*Assessment OF Learning*
�� Checks what has been learned to dateChecks what has been learned to date
�� Is designed for those not directly involved inIs designed for those not directly involved indaily learning and teachingdaily learning and teaching
�� Is presented in a formal reportIs presented in a formal report
�� Usually gathers information into easily digestibleUsually gathers information into easily digestiblenumbers, scores and gradesnumbers, scores and grades
�� Usually compares the student's learning withUsually compares the student's learning witheither other students or the 'standard' for a gradeeither other students or the 'standard' for a gradelevellevel
�� Does not need to involve the studentDoes not need to involve the student
*http://assessment-reform-group.org.uk
Assessment FOR LearningAssessment FOR Learning
�� Checks learning to decide what to do nextChecks learning to decide what to do next
�� Is designed to assist teachers and students.Is designed to assist teachers and students.
�� Is used in conversation about learningIs used in conversation about learning
�� Usually detailed, specific and descriptiveUsually detailed, specific and descriptivefeedback in words (instead of numbers, scoresfeedback in words (instead of numbers, scoresand grades)and grades)
�� Usually focused on improvement, compared withUsually focused on improvement, compared withthe student's 'previous best' and progress towardthe student's 'previous best' and progress towarda standarda standard
�� Needs to involve the student -- the person mostNeeds to involve the student -- the person mostable to improve learningable to improve learning
*http://assessment-reform-group.org.uk
10 AFL Principles - Part 110 AFL Principles - Part 1
�� AFL should be part of effective planning ofAFL should be part of effective planning of
teaching and learningteaching and learning
�� AFL should focus on how students learnAFL should focus on how students learn
�� AFL should be recognized as central toAFL should be recognized as central to
classroom practiceclassroom practice
�� AFL should be regarded as a key professionalAFL should be regarded as a key professional
skill for teachersskill for teachers
�� AFL should be sensitive and constructiveAFL should be sensitive and constructive
because any assessment has an emotionalbecause any assessment has an emotional
impactimpact
10 AFL Principles - Part 210 AFL Principles - Part 2
�� AFL should take account of the importance ofAFL should take account of the importance of(and foster) learner motivation(and foster) learner motivation
�� AFL should promote commitment to learningAFL should promote commitment to learninggoals and a shared understanding of the criteriagoals and a shared understanding of the criteriaby which they are assessedby which they are assessed
�� AFL develops learnersAFL develops learners’’ capacity for self-capacity for self-assessment so that they can become reflectiveassessment so that they can become reflectiveand self-managingand self-managing
�� AFL should recognize the full range ofAFL should recognize the full range ofachievements of all learnersachievements of all learners
�� Learners should receive constructive guidanceLearners should receive constructive guidanceabout how to improveabout how to improve
3
Overlap of Assessment Types*Overlap of Assessment Types*
Assessment
FOR
Learning
Assessment
OF
Learning
*Alberta Assessment Consortium
Portfolios that supportPortfolios that support
Assessment FOR LearningAssessment FOR Learning�� Purpose of portfolio agreed upon with learnerPurpose of portfolio agreed upon with learner
�� Artifacts selected by learner to tell the story of their learningArtifacts selected by learner to tell the story of their learning
�� Portfolio maintained on an ongoing basis throughout thePortfolio maintained on an ongoing basis throughout theclass, term or program - time flexibleclass, term or program - time flexible
�� Portfolio and artifacts reviewed with learner and used toPortfolio and artifacts reviewed with learner and used toprovide feedback to improve learningprovide feedback to improve learning
�� Portfolio organization is determined by learner or negotiatedPortfolio organization is determined by learner or negotiatedwith mentor/advisor/teacherwith mentor/advisor/teacher
�� Rarely used for high stakes decisionsRarely used for high stakes decisions
�� Formative - what are the learning needs in the future?Formative - what are the learning needs in the future?(Present to future)(Present to future)
�� Fosters Intrinsic motivation - engages the learnerFosters Intrinsic motivation - engages the learner
�� Audience: learner, family, friends - learner can chooseAudience: learner, family, friends - learner can choose
Portfolios used forPortfolios used for
Assessment OF LearningAssessment OF Learning�� Purpose of portfolio prescribed by institutionPurpose of portfolio prescribed by institution
�� Artifacts mandated by institution to determine outcomes ofArtifacts mandated by institution to determine outcomes ofinstructioninstruction
�� Portfolio usually developed at the end of a class, term orPortfolio usually developed at the end of a class, term orprogram - time limitedprogram - time limited
�� Portfolio and/or artifacts usually "scored" based on a rubricPortfolio and/or artifacts usually "scored" based on a rubricand quantitative data is collected for external audiencesand quantitative data is collected for external audiences
�� Portfolio is usually structured around a set of outcomes,Portfolio is usually structured around a set of outcomes,goals or standardsgoals or standards
�� Sometimes used to make high stakes decisionsSometimes used to make high stakes decisions
�� Summative - what has been learned to date? (Past toSummative - what has been learned to date? (Past topresent)present)
�� Requires Extrinsic motivationRequires Extrinsic motivation
�� Audience: external - little choiceAudience: external - little choice
Resources and Readings onResources and Readings on
Assessment FOR LearningAssessment FOR Learning
�� My website for articles not available online:My website for articles not available online:
http://electronicportfolios.org/afl/http://electronicportfolios.org/afl/
�� Assessment Reform GroupAssessment Reform Group
http://assessment-reform-group.org.ukhttp://assessment-reform-group.org.uk
�� Principles of Assessment for LearningPrinciples of Assessment for Learning
http://www.qca.org.uk/http://www.qca.org.uk/aflafl
Assessment SystemsAssessment Systems
and Electronic Portfolios:and Electronic Portfolios:
Balancing AccountabilityBalancing Accountability
with Learningwith Learning
©©2004, Helen C. Barrett2004, Helen C. BarrettJudy Wilkerson & William Steve LangJudy Wilkerson & William Steve Lang
Accountability SystemAccountability System(based on Assessment Triangle)(based on Assessment Triangle)
Congruent withCongruent with
ConceptualConceptual
FrameworkFramework
Tasks, RubricsTasks, Rubrics
and Record ofand Record of
AchievementAchievement
Analysis andAnalysis and
ReportingReporting
SystemSystem
Feedback LoopFeedback Loop
for Continuousfor Continuous
ImprovementImprovement
4
Congruence with ConceptualCongruence with Conceptual
FrameworkFramework
�� Create a system that is congruentCreate a system that is congruent
with your underlying learningwith your underlying learning
philosophy orphilosophy or conceptual frameworkconceptual framework
�� behaviorismbehaviorism vsvs. constructivism. constructivism
�� positivismpositivism vsvs. hermeneutics. hermeneutics
�� portfolio as portfolio as testtest vs vs..
portfolio as portfolio as storystory
Tasks, Rubric, Record ofTasks, Rubric, Record of
AchievementAchievement
�� Identify tasks or situations that allowIdentify tasks or situations that allowone to observe studentsone to observe students’’performanceperformance……
�� Create rubrics that clearly differentiateCreate rubrics that clearly differentiateperformance (3 or 4 levels only)performance (3 or 4 levels only)
�� Create a recordkeeping system to keepCreate a recordkeeping system to keeptrack of the rubric/evaluation datatrack of the rubric/evaluation data
�� based on multiple measures/methods)based on multiple measures/methods)
Reporting System andReporting System and
Feedback LoopFeedback Loop
�� Create a reporting processCreate a reporting process
�� to summarize assessment datato summarize assessment data
�� to be able to draw inferencesto be able to draw inferences
from performance evidencefrom performance evidence
�� to use for programto use for program
improvementimprovement
Which approach should you take?Which approach should you take?
�� Are you looking for anAre you looking for an
electronic portfolioelectronic portfolio……
�� Or anOr an assessmentassessment
management systemmanagement system??
�� WhatWhat’’s the difference?s the difference?
Along a ContinuumAlong a Continuum
PurposePurpose
�� ElectronicElectronicPortfolioPortfolio
�� Multiple:Multiple:�� LearningLearning
�� AssessmentAssessment
�� EmploymentEmployment
�� AssessmentAssessment
ManagementManagement
SystemSystem
�� Single:Single:
�� AssessmentAssessment
Data StructureData Structure
�� ElectronicElectronicPortfolioPortfolio
�� varies with the tools usedvaries with the tools usedto create the portfolio;to create the portfolio;most often common datamost often common dataformats (documents oftenformats (documents oftenconverted to HTML,converted to HTML,PDF)PDF)
�� AssessmentAssessment
ManagementManagement
SystemSystem
�� most often uses amost often uses a
relational database torelational database to
record, report datarecord, report data
5
Primary Type of DataPrimary Type of Data
�� ElectronicElectronicPortfolioPortfolio
�� QualitativeQualitative
�� AssessmentAssessmentManagementManagementSystemSystem
�� QuantitativeQuantitativeandandQualitativeQualitative
Data StorageData Storage
�� Electronic PortfolioElectronic Portfolio
�� multiple options:multiple options:
CD-ROM,CD-ROM,
videotape, DVD,videotape, DVD,
WWW server, LANWWW server, LAN
�� AssessmentAssessment
ManagementManagement
SystemSystem
�� LAN or secureLAN or secure
WWW serverWWW server
•Digital Divide Issues
Technology SkillsTechnology Skills
RequiredRequired
�� Electronic PortfolioElectronic Portfolio�� MediumMedium––>High>High
�� More advanced skills:More advanced skills:information designinformation designthrough hyper linking,through hyper linking,digital publishingdigital publishingstrategies, filestrategies, filemanagementmanagement
�� AssessmentAssessmentManagementManagementSystemSystem�� LowLow––>Medium>Medium
�� Minimal skills,Minimal skills,equivalent to using aequivalent to using aweb browser andweb browser andadding attachments toadding attachments toan e-mail messagean e-mail message
Technology Skills DemonstratedTechnology Skills Demonstrated
�� ElectronicElectronicPortfolioPortfolio
�� MediumMedium ––> High> High
�� depending ondepending ontools used totools used tocreate portfoliocreate portfolio
�� AssessmentAssessment
ManagementManagement
SystemSystem
�� LowLow ––> Medium> Medium
�� depending on thedepending on the
sophistication of thesophistication of the
artifacts added toartifacts added to
the portfoliothe portfolio
Control of Design & LinksControl of Design & Links
�� ElectronicElectronic
PortfolioPortfolio
�� under control ofunder control of
portfolioportfolio
developerdeveloper
�� AssessmentAssessment
ManagementManagement
SystemSystem
�� controlled bycontrolled by
databasedatabase
structurestructure
•Hyperlinking reinforces metacognition*
•Design=Individuality*Portland State University
Choice of ArtifactsChoice of Artifacts
�� ElectronicElectronic
PortfolioPortfolio
�� LearnerLearner
�� AssessmentAssessment
ManagementManagement
SystemSystem
�� InstitutionInstitution
6
Locus of ControlLocus of Control
�� ElectronicElectronic
PortfolioPortfolio
�� Student-Student-
CenteredCentered
�� AssessmentAssessment
ManagementManagement
SystemSystem
�� Institution-Institution-
CenteredCentered
Electronic Portfolio or AssessmentElectronic Portfolio or Assessment
Management System?Management System?
Cautions about Portfolio UseCautions about Portfolio Use(Lucas, 1992)(Lucas, 1992)
1.1. The weakening of effectThe weakening of effectthrough careless imitationthrough careless imitation
2.2. The failure of research toThe failure of research tovalidate the pedagogyvalidate the pedagogy
3.3. The co-option by large-scaleThe co-option by large-scaleexternal testing programsexternal testing programs
(Lucas, Catharine. 1992. Introduction: Writing Portfolios - Changes and(Lucas, Catharine. 1992. Introduction: Writing Portfolios - Changes andChallenges.Challenges. Portfolios in the Writing Classroom: An IntroductionPortfolios in the Writing Classroom: An Introduction, ed., ed.Kathleen Blake Yancey. Urbana, Illinois: NCTE: 1-11)Kathleen Blake Yancey. Urbana, Illinois: NCTE: 1-11)
LeeLee Shulman Shulman’’ss 5 dangers of5 dangers of
portfoliosportfolios
1.1. "lamination""lamination"
2.2. "heavy lifting""heavy lifting"
3.3. "trivialization""trivialization"
4.4. "perversion""perversion"
5.5. "misrepresentation""misrepresentation"Shulman, Lee (1998)
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
LeeLee Shulman Shulman’’ss 5 dangers of5 dangers of
portfoliosportfolios
1.1. "lamination""lamination"- a portfolio- a portfoliobecomes a merebecomes a mereexhibition, a self-exhibition, a self-advertisement, toadvertisement, toshow offshow off
Shulman, Lee (1998)
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
LeeLee Shulman Shulman’’ss 5 dangers of5 dangers of
portfoliosportfolios
2.2. "heavy lifting""heavy lifting" --a portfolio donea portfolio donewell is hardwell is hardwork. Is it worthwork. Is it worththe extra effort?the extra effort?
Shulman, Lee (1998)
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
7
LeeLee Shulman Shulman’’ss 5 dangers of5 dangers of
portfoliosportfolios
3.3. "trivialization""trivialization" - -documentingdocumentingstuff that isn'tstuff that isn'tworthworthreflecting uponreflecting upon
Shulman, Lee (1998)
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
LeeLee Shulman Shulman’’ss 5 dangers of5 dangers of
portfoliosportfolios4.4. "perversion""perversion" - when - when
used as a form of highused as a form of high
stakes assessment stakes assessment ““whywhy
will portfolios be morewill portfolios be more
resistant to perversionresistant to perversion
than all other forms ofthan all other forms of
assessment have been?assessment have been?””Shulman, Lee (1998)
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
LeeLee Shulman Shulman’’ss 5 dangers of5 dangers of
portfoliosportfolios
5.5. "misrepresentation""misrepresentation"
- does "best work"- does "best work"
misrepresentmisrepresent
"typical work" --"typical work" --
not a true picture ofnot a true picture of
competencycompetency
Shulman, Lee (1998)
"Teacher Portfolios: A
Theoretical Activity" in
N. Lyons (ed.) With
Portfolio in Hand. (pp.
23-37) New York:
Teachers College Press.
Contrasting Paradigms ofContrasting Paradigms of
PortfoliosPortfolios
�� PositivismPositivism
�� ConstructivismConstructivism
F. Leon Paulson & Pearl Paulson (1994)F. Leon Paulson & Pearl Paulson (1994)““Assessing Portfolios Using the Constructivist ParadigmAssessing Portfolios Using the Constructivist Paradigm””
in Fogarty, R. (ed.) (1996) in Fogarty, R. (ed.) (1996) Student PortfoliosStudent Portfolios..Palatine: IRI Skylight Training & PublishingPalatine: IRI Skylight Training & Publishing
Positivist PortfoliosPositivist Portfolios
““ The purpose of the portfolio is to assessThe purpose of the portfolio is to assesslearning outcomes and those outcomeslearning outcomes and those outcomesare, generally, defined externally.are, generally, defined externally.Positivism assumes that meaning isPositivism assumes that meaning isconstant across users, contexts, andconstant across users, contexts, andpurposespurposes…… The portfolio is a receptacleThe portfolio is a receptaclefor examples of student work used tofor examples of student work used toinfer what and how much learning hasinfer what and how much learning hasoccurred.occurred.””
F. Leon Paulson & Pearl Paulson (1994)F. Leon Paulson & Pearl Paulson (1994)““Assessing Portfolios Using the Constructivist ParadigmAssessing Portfolios Using the Constructivist Paradigm””
in Fogarty, R. (ed.) (1996)in Fogarty, R. (ed.) (1996) Student PortfoliosStudent Portfolios..Palatine: IRI Skylight Training & PublishingPalatine: IRI Skylight Training & Publishing
Constructivist PortfoliosConstructivist Portfolios
““ The portfolio is a learning environment inThe portfolio is a learning environment inwhich the learner constructs meaning. Itwhich the learner constructs meaning. Itassumes that meaning varies acrossassumes that meaning varies acrossindividuals, over time, and with purpose.individuals, over time, and with purpose.The portfolio presents process, a recordThe portfolio presents process, a recordof the processes associated withof the processes associated withlearning itself; a summation of individuallearning itself; a summation of individualportfolios would be too complex forportfolios would be too complex fornormative description.normative description.””
F. Leon Paulson & Pearl Paulson (1994)F. Leon Paulson & Pearl Paulson (1994)““Assessing Portfolios Using the Constructivist ParadigmAssessing Portfolios Using the Constructivist Paradigm””
in Fogarty, R. (ed.) (1996)in Fogarty, R. (ed.) (1996) Student PortfoliosStudent Portfolios..Palatine: IRI Skylight Training & PublishingPalatine: IRI Skylight Training & Publishing
8
Tension between twoTension between two
approachesapproaches““ The two paradigms produce portfolioThe two paradigms produce portfolio
activities that are entirely different.activities that are entirely different.””
““The positivist approach puts a premium onThe positivist approach puts a premium onthe selection of items that reflectthe selection of items that reflect outsideoutsidestandards and interestsstandards and interests..””
““The constructivist approach puts a premiumThe constructivist approach puts a premiumon the selection of items that reflect learningon the selection of items that reflect learningfrom the studentfrom the student’’s perspectives perspective..””
F. Leon Paulson & Pearl Paulson (1994)F. Leon Paulson & Pearl Paulson (1994)““Assessing Portfolios Using the Constructivist ParadigmAssessing Portfolios Using the Constructivist Paradigm””
in Fogarty, R. (ed.) (1996) in Fogarty, R. (ed.) (1996) Student PortfoliosStudent Portfolios..Palatine: IRI Skylight Training & PublishingPalatine: IRI Skylight Training & Publishing
Tension between twoTension between two
approachesapproaches
““ It is important to It is important torecognize the dangers ofrecognize the dangers ofthe portfolio process--the portfolio process--the possibilities forthe possibilities fortrivialization as well astrivialization as well asmindlessmindless
standardizationstandardization..”” (p.5)(p.5)
Lyons, Nona (1998) Lyons, Nona (1998) With Portfolio in HandWith Portfolio in Hand..Teachers College PressTeachers College Press
How do we create anHow do we create an
Institution-CenteredInstitution-Centered
Assessment andAssessment and
Accountability SystemAccountability System……
Without losing the power of theWithout losing the power of the
portfolio as a student-centeredportfolio as a student-centered
tool for lifelong learning andtool for lifelong learning and
professional development?professional development?
How do we maintainHow do we maintain
thethe authenticityauthenticity of the of the
portfolio processportfolio process……
And help our teacher candidatesAnd help our teacher candidates
develop the skills and attitudesdevelop the skills and attitudes
necessary to implement this strategynecessary to implement this strategy
with their own students once theywith their own students once they
have their own classrooms?have their own classrooms?
Modeling!Modeling!
Voice = AuthenticityVoice = Authenticity
�� multimedia expands the "voice" inmultimedia expands the "voice" in
an electronic portfolioan electronic portfolio
(both literally and rhetorically)(both literally and rhetorically)
�� personality of the author is evidentpersonality of the author is evident
�� gives the reflections a uniquenessgives the reflections a uniqueness
�� gives the feeling that the writer isgives the feeling that the writer is
talking directly to the reader/viewertalking directly to the reader/viewer
Why?Why?�� Learner Ownership andLearner Ownership and
Engagement with PortfolioEngagement with Portfolio
�� Emotional Connection to ProcessEmotional Connection to Process
�� Learner's Authentic Learner's Authentic VoiceVoice
�� Portfolio as Portfolio as StoryStory
�� Portfolio as Lifelong Learning/Portfolio as Lifelong Learning/Professional Development ToolProfessional Development Tool
�� SupportSupport deep learningdeep learning
9
Who?Who?�� Who has successfully keptWho has successfully kept
these two strategiesthese two strategiesseparate, but connected?separate, but connected?�� Baylor University College of EdBaylor University College of Ed
�� University of Denver (campus-University of Denver (campus-wide)wide)
�� Ball State University College of EdBall State University College of Ed
Baylor ExampleBaylor Example
University of DenverUniversity of Denver
http://portfolio.http://portfolio.dudu..edueduBall StateBall State
UniversityUniversity
�� Student-createdStudent-created
web-basedweb-based
portfolio PLUSportfolio PLUS
University of WashingtonUniversity of Washington
�� Catalyst PortfolioCatalyst Portfolio
http://catalyst.http://catalyst.washingtonwashington..eduedu
�� Student Learning ObjectivesStudent Learning Objectives
System (SLO)System (SLO)
http://www.http://www.washingtonwashington..eduedu//sloslo//
University of WashingtonUniversity of Washington’’s Catalysts Catalyst
PortfolioPortfolio
10
University of WashingtonUniversity of Washington’’ss
Student Learning ObjectivesStudent Learning Objectives
(SLO)(SLO)�� four web applicationsfour web applications
�� SLO EncoderSLO Encoder - faculty encode the - faculty encode the SLOsSLOs for theirfor theircoursescourses
�� SLO ReporterSLO Reporter - a tool for viewing information in - a tool for viewing information inthe databasethe database
�� MyLOMyLO - SLO Student system - to view their- SLO Student system - to view theirpersonal learning objective profilepersonal learning objective profile
�� SLO Admin SystemSLO Admin System - a non-technical tool to - a non-technical tool toperform basic system administration tasksperform basic system administration tasks
How can we address bothHow can we address both
types of portfolios?types of portfolios?
Use three different systems that areUse three different systems that aredigitally linked:digitally linked:
I.I. A digitalA digital archivearchive of a learner of a learner’’s works work
II.II. An institution-centered An institution-centered databasedatabase to tocollect faculty-generated assessmentcollect faculty-generated assessmentdata based on tasks and rubricsdata based on tasks and rubrics
III.III. A student-centered A student-centered electronicelectronicportfolioportfolio
Handout
Begin Here
Learning Experiences embedded in curriculum
I
I.Digital Archive
of LearnerArtifacts
(Working Portfolio)
Interactive Process
Evidence =+Artifacts+Reflection+Validation
11
Interactive Process
Performance
Tasks &
Rubrics for
evaluation
Reflectionon Learning
(self-selectedartifacts for self-
evaluation)Evidence =+Artifacts+Reflection+ValidationAssessor Learner
Positivist Paradigm(Evaluation and
Making Inferences)
Portfolio as Test
Assessor
EVALUATES
required
artifacts
Perf tasks
Performance
Tasks &
Rubrics for
evaluation
Data collected for
certification/
licensure
(high stakes)
and for accreditation
12
IIII.AssessmentManagementSystem
(institution-centereddata management
system)
Resulting in…
Institution-centeredaggregated dataleading tocertification/licensureand accreditation
Focus on
Limited-Term
Evaluation
External Locus of Control
• Includes prescribed artifacts
and rubrics
• Requires database to manage
information
• Focuses on faculty's formative
and summative evaluations
I
I.Digital Archive
of LearnerArtifacts
(Working Portfolio)
13
Constructivist
Paradigm(Making Meaning and
Assessment as Learning)
Portfolio as Story
Learner
COLLECTS
artifacts from
learning
experiences
Reflection
Reflectionon Learning
(self-selectedartifacts for self-
evaluation)
Learner SELECTS
artifacts and
reflections to meet
self-determined
purpose(s)
III
III.ElectronicPortfolio(s)
(presentation portfolios for multiple purposes)
Resulting in…
Student-centereddocumentation ofdeep learning,for developing self-concept andpresentation to multiple audiences(peers, employers, etc.)
14
Deep LearningDeep Learning
�� involves reflection,involves reflection,
�� is developmental,is developmental,
�� is integrative,is integrative,
�� is self-directive, andis self-directive, and
�� is lifelongis lifelong
Cambridge (2004)Cambridge (2004)
Focus on
Lifelong
Self-Directed
Learning
Internal Locus of Control
• Includes choice of artifacts
• Results in personalized
e-portfolio
• Focuses on learner's
celebration of uniqueness
BalancedAssessmentSystem
Both approaches result in a:
One final thoughtOne final thought……
�� Assessment of LearningAssessment of Learning
�� Portfolios for LearningPortfolios for Learning
�� What about Motivation?What about Motivation?
Components of PortfolioComponents of Portfolio
DevelopmentDevelopment
�� ContentContent
�� PurposePurpose
�� ProcessProcess
15
Components of PortfolioComponents of Portfolio
DevelopmentDevelopment
�� Content:Content:evidenceevidence(artifacts +(artifacts +reflections)reflections)
Components of PortfolioComponents of Portfolio
DevelopmentDevelopment
�� Purpose:Purpose:the reason for developing thethe reason for developing theportfolioportfolio –– includes audience includes audience�� Learning & professionalLearning & professional
developmentdevelopment
�� AssessmentAssessment
�� EmploymentEmployment
Components of PortfolioComponents of Portfolio
DevelopmentDevelopment
�� Process:Process:�� tools usedtools used
�� sequence of activitiessequence of activities
�� rulesrules
�� evaluation criteria (rubrics)evaluation criteria (rubrics)
�� collaboration/conversation collaboration/conversation
Developmental Levels ofDevelopmental Levels of
Portfolio ImplementationPortfolio Implementation
�� Extrinsic MotivationExtrinsic Motivation––institutional directed content, purpose &institutional directed content, purpose &processprocess –– external locus of controlexternal locus of control
�� Mixed MotivationMixed Motivation––learner ownership over one or two of thelearner ownership over one or two of thecomponentscomponents
�� Intrinsic MotivationIntrinsic Motivation——learner ownership of content, purposelearner ownership of content, purposeand processand process
Motivation
Learner Ownership and Control of Electronic Portfolio Development
Contents Contents Contents
Purpose Purpose
Process
Learner Control vs. Organizational ControlAssumption:
Greater Learner Control leads to more Intrinsic Motivation
LEARNER CONTROLORGANIZATION CONTROL
Motivation
Intrinsic
Extrinsic
DEGREE
OF
CHOICE
TheThe ePortfolioePortfolio as aas a
Story of LearningStory of Learning
Digital StorytellingDigital Storytelling
as Reflectiveas Reflective
PortfolioPortfolio
16
Linking TwoLinking Two
Dynamic ProcessesDynamic Processes
to Promote Deepto Promote Deep
LearningLearning
Portfolio DevelopmentPortfolio Development
ProcessProcess
Digital StorytellingDigital Storytelling
Constructed MeaningConstructed Meaning
"The portfolio is a laboratory"The portfolio is a laboratorywhere students constructwhere students constructmeaning from theirmeaning from theiraccumulated experience."accumulated experience."(Paulson & Paulson, 1991, p.5)(Paulson & Paulson, 1991, p.5)
Portfolio tells a StoryPortfolio tells a Story"A portfolio tells a story. It is the"A portfolio tells a story. It is thestory of knowing. Knowing aboutstory of knowing. Knowing aboutthings... Knowing oneself...things... Knowing oneself...Knowing an audience... PortfoliosKnowing an audience... Portfoliosare students' own stories of whatare students' own stories of whatthey know, why they believe theythey know, why they believe theyknow it, and why others shouldknow it, and why others shouldbe of the same opinion.be of the same opinion.””(Paulson & Paulson, 1991, p.2)(Paulson & Paulson, 1991, p.2)
Portfolios tell a StoryPortfolios tell a Story
““A portfolio is opinionA portfolio is opinionbacked by fact...backed by fact...Students prove whatStudents prove whatthey know withthey know withsamples of their work.samples of their work.””(Paulson & Paulson, 1991, p.2)(Paulson & Paulson, 1991, p.2)
Handout:Handout: ePortfolio ePortfolio asas
StorytellingStorytellingPortfolio DevelopmentPortfolio Development
ProcessProcess
17
Portfolio ProcessesPortfolio Processes
TraditionalTraditional
�� CollectingCollecting
�� SelectingSelecting
�� ReflectingReflecting
�� ProjectingProjecting
�� CelebratingCelebrating
+ Technology+ Technology
�� ArchivingArchiving
�� Linking/ThinkingLinking/Thinking
�� StorytellingStorytelling
�� CollaboratingCollaborating
�� PublishingPublishing
Reflective Questions that tie the Past to theReflective Questions that tie the Past to the
FutureFuture
Linked to…Linked toLinked to……
DigitalDigital
StorytellingStorytelling
BlogsBlogs
WikisWikis
Center for Digital StorytellingCenter for Digital Storytelling
http://www.storycenter.org
Digital Storytelling ProcessDigital Storytelling Process
�� Learners create a 2-4 minuteLearners create a 2-4 minutedigital video clipdigital video clip
�� First person narrativeFirst person narrative
�� Told in their own voiceTold in their own voice
�� Illustrated by (mostly) stillIllustrated by (mostly) stillimagesimages
�� Music track to add emotionalMusic track to add emotionaltonetone
What is Digital Storytelling?
• Go to DVD - Play Digital Storytelling
18
Why include DigitalWhy include Digital
Storytelling inStorytelling in
ePortfoliosePortfolios??
Learner MotivationLearner Motivation
and Affectand Affect
Brain ResearchBrain Research
Storytelling as ReflectionStorytelling as Reflection((SchSchöönn, 1988), 1988)
“…“…for storytelling is thefor storytelling is the
mode of description bestmode of description best
suited to transformation insuited to transformation in
new situations of action.new situations of action.””
Storytelling as ReflectionStorytelling as Reflection((SchSchöönn, 1988), 1988)
““Stories are products ofStories are products ofreflection, but we do notreflection, but we do notusually hold onto themusually hold onto themlong enough to makelong enough to makethem objects of reflectionthem objects of reflectionin their own right.in their own right.””
Storytelling as ReflectionStorytelling as Reflection((SchSchöönn, 1988), 1988)
““When we get into the habitWhen we get into the habitof recording our stories, weof recording our stories, wecan look at them again,can look at them again,attending to the meaningsattending to the meaningswe have build into them andwe have build into them andattending, as well, to ourattending, as well, to ourstrategies of narrativestrategies of narrativedescription.description.””
Examples of ReflectiveExamples of Reflective
StoriesStories
�� Go to DVD - Play Go to DVD - Play ““Full CircleFull Circle””
�� Go to DVD - Play Go to DVD - Play ““HakuinHakuin””
Constructivist Approach to Project-Based "Assessment-as-Learning"
Constructivist Approach to Project-Constructivist Approach to Project-Based "Assessment-as-Learning"Based "Assessment-as-Learning"
19
Learner Ownership andEngagement with Portfolio
Learner Ownership andLearner Ownership andEngagement with PortfolioEngagement with Portfolio
�� The tools should allow theThe tools should allow the
learner to feel in control of thelearner to feel in control of the
process, including the "lookprocess, including the "look
and feel" of the portfolio.and feel" of the portfolio.
My StoryMy Story
�� Go to DVD - Play Go to DVD - Play ““ChoicesChoices””
DonDon’’t double your learning!t double your learning!
Consider Cognitive Overload!Consider Cognitive Overload!
�� When learningWhen learning new toolsnew tools,,
useuse familiar tasksfamiliar tasks;;
�� When learningWhen learning new tasksnew tasks,,
useuse familiar toolsfamiliar tools..Barrett, 1991Barrett, 1991
My Final WishMy Final Wish……
May all yourMay all your
eelectronic portfolioslectronic portfoliosbecome dynamicbecome dynamiccelebrations ofcelebrations of
learninglearningacross the lifespan.across the lifespan.
Dr. Helen BarrettDr. Helen Barrett
�� Co-DirectorCo-Director ISTEISTE’’ssCommunity & AssessmentCommunity & Assessmentin PT3 Catalyst Grantin PT3 Catalyst Grant
�� hbarretthbarrett@@isteiste.org.org
�� http://http://electronicportfolioselectronicportfolios.org/.org/