Synthesis Report on Assessment & Feedback with Technology Enhancement (SRAFTE)

HEA Funded Project with Lester Gilbert and Veronica Gale from University of Southampton

Denise Whitelock

IET

d.m.whitelock@open.ac.ukDMW_24 May 2011

Project Overview

• Elicit which evidence based references on e-assessment feedback with technology enhancement are most useful to practitioners

• Synthesise main issues• Signpost original documents• 142 references obtained, 124

accessible• 67.7% peer reviewed• 28.2% quantitative data• Majority student tutor reaction

DMW_24 May 2011

Key Findings• Effective regular testing improves test

performance (JISC 2008) effect size 0.34-0.46 (Black, 2003)

• Prepare students for assessment by practicing with technology (Shepherd et al, 2006)

• Use reports to check validity and reliability of questions (McKenzie & Bull, 2000)

• More advanced question types evident (Whitelock & Watt, 2008)

• Automated marking more reliable than human marking (Lee & Weerakoon, 2001)

• Assessment for Learning achieved with constructive feedback (Beaumont et al, 2008)

• Principles audio feedback (Middleton & Nortcliffe, 2010)

DMW_24 May 2011

Impact & Implications• Resource that facilitates

answers to key questions– What can I do?– How can I do it?– What evidence can I use to

convince stakeholders?• Feedback can improve

assessment for learning• Offer ways to improve NSS

Benchmark on Feedback• Lack of well designed

evaluations

DMW_24 May 2011