Customizing Portfolio Tools in the rSmart Sakai CLE Hannah Reeves The rSmart Group

Customizing Portfolio Toolsin the rSmart Sakai CLE

Hannah Reeves

The rSmart Group

Background

Motivate Guide

EvaluateReport

Reflect

IntegratePortfolioOwner

Collect

Present

Open Source Portfolio A suite of ePortfolio tools classified as provisional in the Sakai 2.4 release

OSP Tools an interdependent suite of tools that allow for a variety of different activities

Representative ePortfolio Implementations

Personal Representation• Resumes• Course projects• Self presentation/artistic

Teaching and Learning• Connecting academic and real-world experiences • Identifying knowledge and skills in relation to competencies• Integrating learning across disciplines and time

Assessment and Accreditation• Demonstrating and articulating skills and competencies• Demonstrating outcomes• Illustrating learning over time

OSP Documentation

In collaboration with Charles Sturt University, rSmart has

documented these three representative portfolio

implementations Rider University Kapiolani Community College Rhode Island Department of Education (K-12)

Documents are available on Confluence http://bugs.sakaiproject.org/confluence/display/OSP/rSmart+Contributed+Docume

ntation

http://bugs.sakaiproject.org/confluence/display/OSP/rSmart+Contributed+Docume%0Dntation

http://bugs.sakaiproject.org/confluence/display/OSP/rSmart+Contributed+Docume%0Dntation

Personal Representation PortfolioRider University

• In 2005 Rider University initiated a strategic plan to use ePortfolios to guide students in selecting information recommended by career development professionals.

• The Rider ePortfolio offers three on-line resumes designed to assist students in finding a job.

Rider Resume Portfolio Components

Sample Data StructuresForms • 20 forms to collect specific data• 2 forms for collecting student reflections and faculty feedback

on wizard pages

Wizard• 1 chronological wizard -provides guidance in creating a resume

Templates• 1 portfolio template for creating a chronological resume• 1 report template to capture information on student

progress in creating forms for the resume.

Rider Resume Forms

• Activities• Certifications• Community service• Computer skills• Education• Experience• Footer• Header• Honors• Interests• Language skills

• Leadership• Memberships• Objective• Presentations/Publications• Professional Development

Activities• Relevant courses• Relevant Experience• URL (form for live URLs)• Travel

Sample Resume Form

Hierarchical Wizard with 7 Categories

• Overview– Header, Objective, and Footer

• Education– Education, Honors, Certifications, and Relevant Courses

• Experience– Relevant Experience and Experience

• Skills– Computer Skills, Language Skills, and Travel

• Professional Activities– Presentations/Publications, Membership

• Professional Development Activities– Interests, Activities, Leadership, and Community Service Supporting

Materials• Instructions for Creating a Resume Portfolio

Chronological Resume Wizard

Resume Portfolio Template

Rider’s portfolio template consists of a series of .xml files that work together to produce a resume

– An .xsl file for determining pathways for inclusion of content from forms and uploaded files

– An .xsd file that determines additional information that users will type or copy and paste into a text editor during the resume creation process

– A .css file that determines the look and feel of the portfolio.

Rider Chronological Resume Portfolio

Wizard and Portfolio Reports

Two reports for instructors or administrators– A wizard report assesses user progress in

creating forms in the wizard.– A portfolio report assesses user progress in

creating portfolios from the resume portfolio template.

Organizer Steps for Designing Resume FormsPer form:

Identify the data to be collected.

Identify the data to be collected.

Identify fields and prompts.

Identify fields and prompts.

Select preferred method of input for each field in form.

Select preferred method of input for each field in form.

Define user input require-ments

Define user input require-ments

Determine desired order for fields.

Determine desired order for fields.

Write form instructions.

Write form instructions.

Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

Create the .xsd file on which the form will be based from the supplied design.

Create the .xsd file on which the form will be based from the supplied design.

For each form needed for the wizard and/or the portfolio template:

Store the .xsd file in Resources.

Store the .xsd file in Resources.

Use the Forms tool to add the form to the CLE.

Use the Forms tool to add the form to the CLE.

Developer Steps for Creating the Forms

Organizer Steps for Designing a Resume Wizard

Identify the categories and pages needed.

Identify the categories and pages needed.

Identify all material that will be presented to wizard users.

Identify all material that will be presented to wizard users.

Identify reviewers.

Identify reviewers.

Reflection + FeedbackPoints

Reflection + FeedbackPoints

Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

Developer Steps for Creating the Wizard

Create the categories for the wizard.

Create the categories for the wizard.

Publish the matrix. Caution: After a wizard is published, it is difficult to change.

Publish the matrix. Caution: After a wizard is published, it is difficult to change.

Using the Wizards tool:

Set up the wizard pages and add forms as needed.

Set up the wizard pages and add forms as needed.

Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

Organizer Steps for Designing a Resume Portfolio Template

Identify content to include in portfolios.

Identify content to include in portfolios.

Identify needed supporting files.

Identify needed supporting files.

Design the layout for the portfolio.

Design the layout for the portfolio.

Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

Locate a passthrough.xsl file and add it to Resources.


View the source file for the portfolio.


Create the portfolio template using these steps.

Use the .xml file to create a new .xsl file.


Create a portfolio.

Create a portfolio.

Use the Portfolio Templates tool to replace the .xsl files.


Use the Portfolios tool to view revisions.


Use the Portfolio Templates tool to specify the passthrough.xsl and items to include in the template.


Create any additional files needed.


Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

Developer Steps for Creating the Portfolio Template

End User Steps forCreating a Resume Portfolio

Collect information for the resume by adding form items to page of the wizard.

Collect information for the resume by adding form items to page of the wizard.

Provide formative feedback to student.


Revise information as appropriate.

Revise information as appropriate.

Create the portfolio.

Create the portfolio.

Publish the portfolio.


Make changes as needed.

Make changes as needed.

View/comment on portfolio

View/comment on portfolio

Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

Live Demo of theChronological Resume

Coming soon to

the Sakai 2.4 Sandbox

http://demo-cle.rsmart.com/osp-portal

Teaching and Learning PortfolioKapiolani Community College

General Education Program

• Kapi‘olani Community College (KCC) leads the University of Hawaii system in the use of ePortfolios and participates in the National Coalition for Electronic Portfolio Research.

• The KCC portfolio has Title III and NSF funding.• Working with rSmart, KCC designed and developed four

portfolios.• The General Education portfolio guides students in meeting

Gen Ed requirements for graduation.• Students reflect on their achievements and showcase their

work in a teaching and learning portfolio based on their work in the matrix tool

General Education Portfolio

General Education Matrix

General Education Matrix Cell

General Education Portfolio ComponentsData StructuresForms (5)• General Education Evidence form to document student work• Reflection form for students to reflect upon their evidence • Feedback form for instructors to offer formative feedback• Evaluation form to provide a summative evaluation • Contact Information form to identify student portfoliosMatrix• 1 matrix consisting of:

– Six rows of General Education learning outcomes– Three columns of progressive steps for meeting each outcome– Eighteen cells with standards, instructions and the four forms

Templates• 1 matrix portfolio template displaying data from one column of the matrix• 1 report template used to capture information in the matrix

General Education Forms

• General Education Evidence:– Context, Dates, Description, and Self-evaluation of work

• Reflection:– Origin, Purpose, Why chosen, How fulfills standard, How

challenges growth, How contributes to lifelong learning

• Feedback:– Reviewer comments

• Evaluation:– Rating and comments

• Contact Information:– Name, Address, Phone number(s), Email address(es)

General Education Matrix

• Six rows and three columns. • Row headings link to extended explanations in an online

glossary. Each row heading specifies a learning outcome:– Written communication– Critical thinking– Information retrieval & technology– Quantitative reasoning– Oral communication– Understanding self & community

• Column headings link to extended explanations in an online glossary. Each heading specifies a level of achievement (Levels 1–3).

General Education Matrix Cells

• Each matrix cell contains a means to display guidance to students and enter or attach:– One or more completed General Education Evidence forms.– One or more multimedia files as evidence.

• Faculty members with appropriate permissions may then:– View the matrix and matrix cells of any student from a read-only

perspective.– Use one or more Feedback forms to provide formative feedback

within any cell at any time.– Upon student submission of the cell for evaluation, evaluate the cell

via the Evaluations form for the cell displayed in the Evaluations tool.

General EducationMatrix Portfolio Template

A series of .xml files work together in the KCC portfolio to produce a Matrix Portfolio Template:

• An .xsl file for determining pathways for inclusion of content from matrix cells, images, and the contact information form

• An .xsd file for inclusion of the title, subtitle, and captions for images

• A .css file that determines the look and feel of the portfolio• A .gif file for the banner• A .js file for additional script in the portfolio template

Matrix Cell Status and Evaluation Reports

2 reports for instructors or administrators

with appropriate permissions• A matrix cell status report for user progress in

completing matrix cells.• A matrix cell evaluation report for aggregating

evaluations of submitted matrix cells.

Organizer Steps for Designing the

General Education

Matrix

Identify the rows and columns you will need.

Identify the rows and columns you will need.

Determine text for rows and columns.

Determine text for rows and columns.

Identify all material that will be presented to matrix users in each cell of the matrix.

Identify all material that will be presented to matrix users in each cell of the matrix.

Identify reviewers and evaluators.

Identify reviewers and evaluators.

Identifyfeedback and evaluation points.

Identifyfeedback and evaluation points.

Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

Developer Steps for Creating the Matrix

Create the framework for the matrix.

Create the framework for the matrix.

Publish the matrix. Caution: It is difficult to revise a published matrix

Publish the matrix. Caution: It is difficult to revise a published matrix

Using the Matrices tool:

Set up the cells and add forms as needed.

Set up the cells and add forms as needed.

Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

Identify content to include in the portfolio

Identify content to include in the portfolio

Identify supporting files needed for the portfolio template.

Identify supporting files needed for the portfolio template.

Design the layout for the portfolio template.

Design the layout for the portfolio template.

Key

:Programmer

Student

Organizer

Reviewer Evaluator

Audience

Organizer Steps for Designing the

General Education

Matrix

Portfolio Template

Developer Steps for Creating

the

Matrix Portfolio

Template





Create the portfolio template using these steps.



Create a portfolio.

Create a portfolio.









Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

End User Steps for Using theGeneral Education Matrix

Access an available matrix cell, attach work, and reflect.

Access an available matrix cell, attach work, and reflect.

As each cell in the matrix becomes accessible:



Revise as appropriate.

Revise as appropriate.

Submit work for evaluation.

Submit work for evaluation.

Evaluate work.Evaluate work.Review evaluation.

Review evaluation.

Key:

Programmer activity

Student

Organizer

Reviewer Evaluator

Audience

End User Steps for Creating aGeneral Education Matrix Portfolio

As work in matrix cells is completed:

Create your own portfolio from a portfolio template.

Create your own portfolio from a portfolio template.

Select a column in the matrix to display. Add title, subtitle, contact information, images and captions for images to personalize the portfolio.

Select a column in the matrix to display. Add title, subtitle, contact information, images and captions for images to personalize the portfolio.



Make changes as desired and manage comments.

Make changes as desired and manage comments.

View portfolio and leave comments.

View portfolio and leave comments.

Instructor Steps for Assessing theGeneral Education Program using Reports

Use the Reports tool to generate reports on student learning in the CLE.

Use the Reports tool to generate reports on student learning in the CLE.

Use report results to assess the need for refinements in the learning program.

Use report results to assess the need for refinements in the learning program.

At any time after students have begun working in the matrix:

Modify the program as appropriate.

Modify the program as appropriate.

Key:

Programmer

Student

Organizer

Reviewer Evaluator

Audience

Live Demo of theGeneral Education Portfolio

Coming soon to

the Sakai 2.4 Sandbox

http://demo-cle.rsmart.com/osp-portal

Assessment & AccreditationRhode Island Electronic Portfolio System

(RIEPS)• Coordinated by The Rhode Island Network for Educational Technology

(RINET) on behalf of the RI Dept of Education• Serves 40 high schools in 18 school districts• Involves 25,000 end users• Prepares the way for a new graduation requirement in 2008• Goals:

– Use ePortfolios to assess student learning according to state standards and district expectations

– Provide reports of that learning to the state and to accrediting organizations

• For each course, teachers create assignments that map to specific state standards and district expectations for graduation.

Portfolio-Worthy Assignments

Assignments may be

•Validated at state level•Imported from other sites•Created by teacher•Created by student

Assignments Linked toState Standards and District Expectations

State and District Goal Sets

Graduation Portfolio

Graduation PortfolioSample District #2

Submitted and Rated Assignments

Students select appropriate assignments to associate with district expectations in Graduation Portfolio

RIEPS Reports

• Student reports - allow students to assess fours years of work for inclusion in a Graduation Portfolio

• Teacher reports - assist teachers in managing portfolio work in their courses

• Admin reports - district administrators aggregate data for reporting to the state

RIEPS Components

• Numerous assignments for each section of each course in each school

• Goal sets containing state standards and district expectations

• One portfolio template per school or district• Reports for students, teachers, and

administrators to assess the work

Live Demo of theRhode Island Electronic

Portfolio SystemAvailable later this summer in the

Sakai 2.4 Sandbox

For More Information• Documentation of three OSP implementations

– http://bugs.sakaiproject.org/confluence/display/OSP/rSmart+Contributed+Documentation

• Information on goal management tools– http://bugs.sakaiproject.org/confluence/display/GM/Goal

+Management+Tools

• Sakai Sandbox– http://www.sakaisandbox.com/osp-portal

• The rSmart Group– http://www.rsmart.com

http://bugs.sakaiproject.org/confluence/display/OSP/rSmart+Contributed+Documentation




http://bugs.sakaiproject.org/confluence/display/GM/Goal+Management+Tools

http://bugs.sakaiproject.org/confluence/display/GM/Goal+Management+Tools

http://www.sakaisandbox.com/osp-portal

http://www.rsmart.com/

