23
A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Embed Size (px)

Citation preview

Page 1: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

A User-Friendly Approach to Streamlining the Collection

and Analysis of SLO Evidence

Dave Karp&

Tom Vitzelio

Page 2: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Embedded Assessments

Page 3: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

What is Embedded Assessment?

Take place in a class or a group of classes 

Determines whether students are learning pre-established learning outcomes

Take advantage of pre-existing student motivation to perform well

Assess what is actually taught

Page 4: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Types of Course-Embedded Assessment Exams Research Papers and Projects Performances Field Experiences, Lab Reports and

Internships Pre/Post Comparisons Student Portfolios Capstone Evaluations

Page 5: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Advantages of Embedded Assessment

Student motivation is high because the assessment activity is part of a course activity

Costs are reduced because incentives are unnecessary

It usually does not require additional student time as it is part of the curriculum

It is faculty-driven and thus, more likely, to be used for improvement

Because it’s linked to the curriculum, it’s more likely to identify specific curricular needs/deficiencies

Feedback to faculty is usually quick

Page 6: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Disadvantages of Embedded Assessment

Faculty commitment is absolutely essential, but can be hard to get

Faculty resistance to the process may be substantial

Achieving agreement among faculty on an assessment approach across courses is a challenge

Usually there are no comparable data

Page 7: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

SLOs Assessment vs. Grades

Identified Learning Outcomes

Student 1 Student 2 Student 3 Student 4 Student 5 LearningOutcomeAverage

Spelling 3 4 1 2 3 2.6

Grammar 2 5 3 2 5 3.4

Punctuation 4 5 2 3 4 3.6

Structure 4 3 4 5 3 3.8

TOTAL 13 17 10 12 15  

Individual Student Grade: C A D C B  

Page 8: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

An “All-Purpose” Rubric Form to Streamline SLO Assessments

Page 9: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Workshop Focus Our focus is on a tool that makes it

easy to Grade a regular assignment, and Assess students’ performance on a

course level SLO The tool is an “all purpose rubric”

form developed by Chaffey’s Business department

Page 10: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Benefits of the Rubric Automates the grading process Provides a checklist Easily adjustable Can be distributed to students

before and/or after collecting the assignment

May be as simple or complex as the faculty member desires

Quickly and easily enables the SLO assessment

Page 11: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Excel Terminology Worksheet

An individual spreadsheet Workbook

A collection of worksheets combined in a file

Cell The intersection between a row and a

column in a worksheet

Page 12: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

May be Simple or Complex

Examples

Page 13: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Preparing Your Rubric Open the All Purpose file Save it with a new name

“Assignment 2 Grading and Assessment” Fill in line items Assign weighted values for each item Fill in the total points possible on the

assignment

Page 14: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

Preparing Your Rubric Make copies of the worksheet to fill

in for each student in the class Type each student’s name in the

worksheet tab The student’s name automatically

appears on the worksheet Evaluate the students’

performances

Page 15: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

The Assessment Once the grading (evaluation) is

complete, the workbook contains all the data needed to conduct an assessment

All you do is make a copy of the same rubric you used to grade the assignment

The trick is Excel’s 3D Reference function

Page 16: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

The Assessment Examples

Page 17: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

How to Do a 3D Reference Make another copy of the blank

worksheet Type “Assessment” into the

Worksheet tab click in cell O4, which is the cell

containing the score on the first item

Type =AVERAGE(

Page 18: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

How to Do a 3D Reference click on the tab for Student 1's

worksheet – Then click in cell O4 Press down on the “Shift” key and

while still holding it down, click on the tab for the last student worksheet

Page 19: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

How to Do a 3D Reference Without going to a different sheet, click

in the formula bar (the one labeled “fx” near the top of the page)

You will notice that there is a formula there that reads something like this: =AVERAGE('Student 1:Student 5'!O4

Type a “)” at the end of the formula Click on the green check to the left of

the formula bar (or press the “Enter” key)

Page 20: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

How to Do a 3D Reference Go back to the Assessment worksheet Cell O4 contains the average of all the

students’ scores for that line item! Copy the formula in cell O4 and paste

it into all of the other cells in column O that correspond to one of the rubric’s line items

Page 21: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

How to Do a 3D Reference Once done, you have a worksheet

that shows: The class performance on each line

item, and The overall average score on the

assignment

Page 22: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

The Assessment This worksheet now contains the

class assessment on this project The only extra work required on top

of the grading for the assignment was to spend a few minutes creating the Assessment worksheet

Now, all you have to do is talk about the results with your colleagues!

Page 23: A User-Friendly Approach to Streamlining the Collection and Analysis of SLO Evidence Dave Karp & Tom Vitzelio

A User-Friendly Approach to Streamlining the Collection

and Analysis of SLO Evidence

- The End -