Synthesis Report on Assessment & Feedback with Technology Enhancement (SRAFTE)
HEA Funded Project with Lester Gilbert and Veronica Gale from University of Southampton
Denise Whitelock
IET
[email protected]_24 May 2011
Project Overview
• Elicit which evidence based references on e-assessment feedback with technology enhancement are most useful to practitioners
• Synthesise main issues• Signpost original documents• 142 references obtained, 124
accessible• 67.7% peer reviewed• 28.2% quantitative data• Majority student tutor reaction
DMW_24 May 2011
Key Findings• Effective regular testing improves test
performance (JISC 2008) effect size 0.34-0.46 (Black, 2003)
• Prepare students for assessment by practicing with technology (Shepherd et al, 2006)
• Use reports to check validity and reliability of questions (McKenzie & Bull, 2000)
• More advanced question types evident (Whitelock & Watt, 2008)
• Automated marking more reliable than human marking (Lee & Weerakoon, 2001)
• Assessment for Learning achieved with constructive feedback (Beaumont et al, 2008)
• Principles audio feedback (Middleton & Nortcliffe, 2010)
DMW_24 May 2011
Impact & Implications• Resource that facilitates
answers to key questions– What can I do?– How can I do it?– What evidence can I use to
convince stakeholders?• Feedback can improve
assessment for learning• Offer ways to improve NSS
Benchmark on Feedback• Lack of well designed
evaluations
DMW_24 May 2011