Using REAP Principles and a Student Timeline to help Ulster staff reflect on their

Assessment & Feedback Strategy

Baseline Research & Initial Concept

Fiona DohertyInstructional Technologist

Viewpoints Project

30 April 2009

Defining the Student Timeline

Break down and define the student lifecycle based on a typical three-year undergraduate course at the University of Ulster.

Looking at the Ulster’s Academic Calendar for 2009/10 – 2011/12. Identifying important points in the student lifecycle, e.g. the first few weeks with regard

to retention. Use generic phases that should map to a majority of courses from a variety of faculties. Semester by semester approach.

0 Wk 1 Wks 2-3 Wks 4-7 Wks 8-12

Exam PeriodInduction Orientation First few weeks Mid-semester Final phase

How to prompt A&F Reflection?

Use of principles/guidelines, such as:

National University of Ulster

Re-Engineering Assessment Practices (REAP) Principles of good formative assessment and feedback.

12 formative assessment principles developed by the University of Strateclyde by the Assessment Working Group. These principles are based on recent research on assessment (Yorke, 1987: Nicol & Macfarlane-Dick 2004, 2006, in press: Boud, 2000: Knight, 2002: Knight and Yorke, 2003), the QAA guidelines on assessment of student learning (2006) and published studies of University policies and practices that are associated with high levels of student success (Kuh, Kinzie, Schuh and Whitt, 2003: Tinto, 1991).

Ulster’s Assessment Handbook (May 2007)

160 page doc – practical guide – intended to promote best practice. Covers many aspects of assessment practice – offers an intro to topics and acts as a key reference doc for policies relating to assessment.

Ulster’s Guidelines for First Year Undergraduate Teaching

Developed alongside the T&L strategy. Section 4 has four guidelines relating to Assessment & Feedback.

Chickering & Gamson’s Good Practice in Undergraduate Education

Seven principles proposed in the US by Chickering and Gamson (1991) based on their review of good undergraduate education. These principles are a starting point in trying to understand the relationship between the theory and practice of assessment.

Ulster’s STAR Guidelines for the Management of Student Transition

Guidelines for the Management of Student Transition – The STAR Project (Student Transition and Retention), Cook, Rushton, McCormick, Southall (2005).

About the REAP Project & Principles

Re-engineering Assessment Practices (REAP)

REAP Partners include University of Strathclyde, University of Glasgow and Glasgow Caledonian University

Draws on current educational research (Gibb’s & Simpson’s 11 Conditions, Knight & Yorke, Boud)

Emphasis on student responsibility with goal to develop in students the ability to monitor, manage and self-direct their own learning.

11 Principles of good assessment design (7 empower, 4 engage students)

12 Principles for effective assessment and feedback with questions & implementation techniques (David Nicols, published by QAA)

Principles of Good Assessment Design

"empower" 1. Engage students actively in identifying or formulating criteria 2. Facilitate opportunities for self-assessment and reflection 3. Deliver feedback that helps students self-correct 4. Provide opportunities for feedback dialogue (peer and tutor-

student) 5. Encourage positive motivational beliefs and self-esteem 6. Provide opportunities to apply what is learned in new tasks 7. Yield information that teachers can use to help shape teaching

Principles of Good Assessment Design (cont.)

"engage" 8. Capture sufficient study time and effort in and out of class 9. Distribute students’ effort evenly across topics and weeks. 10. Engage students in deep not just shallow learning activity 11. Communicates clear and high expectations to students.

Adapted from Nicol and Macfarlane-Dick (2006) and Gibbs and Simpson (2004)

Other Principles

Chickering& Gamson

Good Practice in Undergraduate Education4. Gives prompt feedback

Ulster’sFirst yearGuidelines

Assessment and feedback Section The assessment strategy needs to be co-ordinated across modules. There should be greater emphasis on formative feedback early in the semester. Marking criteria should be made explicit to students. Feedback should be timely and designed to enhance student progress; feedback

should be forward looking rather than dwelling on past mistakes.

STARGuidelines

Curriculum Development Section Students should receive regular, formative evaluations of their work early in their

course or course component.

How to reuse the REAP Principles?

1. Clarify good performance 7. Develop self-assessment and reflection

2. Encourage time and effort on tasks 8. Provide students with choice

3. Deliver high quality feedback 9. Involve students when developing criteria

4. Provide opportunities to act on feedback 10. Develop learning communities

5. Have a positive impact on learning 11. Motivate students

6. Encourage interaction and dialogue 12. Inform and shape your teaching

A&F Mapping to a Student Timeline

Wks 0 1 2-3 4-7 8-12 13-16

Induction Orientation First few weeks Coursework Exams

RP 11- Motivate 8 – Choice11- Motivate1 - Clarify

expectations

3- Quality feedback to self-correct

4- feed forward1 - Clarify expectations5 – Constructive alignment7 – reflection & self-

assessment10- learning communities11. motivate

7 – reflection & self-assessment

2 – deep learning6 – discussion10 – learning communities12 – inform teaching4 – feed forward

1 - Clarify expectations5 – Constructive

alignment8- choice4 – feed forward3 – quality feedback7 – reflection9 – involve in process

1 - Clarify expectations

5 – Constructive alignment

9 – involve in process

8- choice

CG Gives prompt feedback Emphasises time on tasks

Emphasises time on tasks

UG There should be greater emphasis on formative feedback early in the semester.

Feedback should be timely and designed to enhance student progress; feedback should be forward looking rather than dwelling on past mistakes.

SG Students should receive regular, formative evaluations of their work early in the course or course components.

Semester Timeline

Does your assessment

and feedback…

Clarify expectations

Encourage deep learning

Provide quality feedback

Allow feedback to feed-forward

Constructively align to the

teaching

Allow for feedback

discussion

Facilitate reflection and

self-assessment

Provide students with

choice

Involve students in

process

Support learning

communities

Activate motivation in

students

Processes inform teaching

0 Wk 1 Wks 2-3 Wks 4-7 Wks 8-12Examination

PeriodInduction Orientation First few weeks Mid-semester Final phase

Clarify expectations

Clarify expectations

Activate motivation in

students

Provide quality feedback to self-

correct Allow feedback to

feed-forwardClarify expectationsActivate motivation

in studentsConstructively align

to the teaching

Encourage Deep Learning

Allow feedback to feed-forward

Facilitate reflection and self-assessment

Provide quality feedback to self-

correctConstructively align

to the teachingProcesses inform

teaching

Clarify expectations

Constructively align to the teachingAllow for feedback

discussionFacilitate

reflection and self-assessment

Activate motivation in

students

Clarify expectations

Constructively align to the teaching

Activate motivation in

students

Provide students with choice

Support learning communities

Allow for feedback discussion

Provide students with choice

Involve students in process

Allow for feedback discussion

Support learning communities

Provide students with choice

Involve students in process

Activate motivation in students

Provide students with choice

Involve students in processAllow for feedback

discussion

Provide students with

choiceAllow for feedback

discussionAllow feedback to feed-forward

Criteria

Essential

Desired

Initial concept of a reflective A&F Tool

Individual Task

Reflective task using REAP Principles and the Student Timeline

Please take five minutes to complete the Reflective Task in your handout.

Group Discussion

Did you find this task useful?

Did the task help you reflect on Assessment & Feedback in your teaching practice?

Initial Feedback on Tool Concept – Ulster Staff

A&F Reflective Task & Questionnaire

Sent to 21 academic staff from a variety of disciplines on 23 April 2009

Feedback so far (based on five responses) – Found task quite easy and useful Found the principles easy to understand

and comprehensive Helped them reflect on their A&F strategy

Initial Feedback on Tool Concept – Ulster staff (cont.)

“Allowed me time to think through the assessment processes and my expectations at each stage.”

“It allowed me to consider the student experience of assessment and what assessment should be achieved in the development of the

student.”

“It was very useful reflecting on what the student will be exposed to from initiation to the module right through to assessment.”

“It helped me consider how reflection on assessment could be configured in various stages throughout the module.”

Development of the A&F Tool

Deliver focus groups & workshops with Ulster staff

Develop from concept to working tool (based on feedback)

Consider – usability, outputs, purpose & audience

Identify benefits for: Users Learners Institution