Midlands Conference 2013 - assessing students the online way

Sunday, April 9, 2023 1Sarah Seeley

Assessing Students The On-line way

Summative e-assessment at the University of Nottingham

04/09/23 Sarah Seeley 2

Scope of Session • Outline the strategies employed at the University of Nottingham

to support innovative assessment practice • Focus of session = support for On-line summative examinations• Highlight practical challenges of using a multimedia environment• Speculate on what examinations of the future may look like how

can we ensure we are ready and able to deliver high quality service in an ever changing landscape.


Learning Outcomes • Be able to identify the particular support requirements of online

assessment.• Understand how these have been met at the University of

Nottingham.• Identify potential areas of development in the area of e-

assessment.

Sunday, April 9, 2023 Sarah Seeley 4

Background • The System

– Locally developed Rogo system delivers exam environment– In use since 2002– Multiple question types and levels of use – Opportunity to use multimedia to enhance experience– Used predominantly in sciences especially in the Medical and Veterinary Schools but use is expanding into Arts

subjects– Deployed for high stakes summative exams – Fully secure– Benefits include electronic marking and detailed individual feedback for large cohorts


Background

• Support Structure – Since 2011 Operations coordinated by the on-line exam team (FTE

2) who operate as part of the examinations Office Team located within Academic Services Department.

– Operation supported by a multiplicity of teams and roles within teams across the university

– Whole year operation


Scale of Operation • Unique students 6,393 (almost doubled in 2 years) • Papers 20,459 (2012/13 not including resits)• 82% of Medical Education Unit summative assessment • Largest cohort 394 • Runs at overseas campus• Majority of examinations have multiple locations • Examinations run throughout the year • 14 suitable venues largest 90 seats• Display configurable at a student level


Organisation• Complex logistics• Many teams involved• Front ended workload• Communication key • Students need to be prepared


Key Issues • Co-ordination• Roles and responsibilities• Facilities • Difficulties breaking new ground • Standardisation • Communication• Student engagement• Flexibility• Impact analysis• Invigilation


Skills set• Creative thinking• Change management• Risk management• Negotiation• Conflict resolution• Project management


Current Initiatives • Policy and procedure review• Joining up the dots• Awareness raising, selling the service• Bespoke support for academics/support staff• Managing change• Publicising risk management strategy• Long essay type exams


Do traditional exams have a future?• What is the next big thing?

• Remote proctoring• MOOCs• Bring your own devices• Automated essay marking• Instant feedback• Open access exams• Sit when ready• No exams at all?


How prepared are we?


Any Questions