Upload
rm-results
View
142
Download
0
Embed Size (px)
Citation preview
RM Resul ts and BTLAn Integrated e-Assessment Solut ion
Steve Harrington: RM Results
Innovations in assessment
Innovation:- the action of introducing something new- the act of starting something for the first time- the act of making a change or new arrangement, a new idea or method
05/01/2023 4
Innovation and Partnership.
05/01/2023 5
▪ A little bit about RM & BTL▪ Some trends in assessment▪ An integrated RM / BTL solution▪ Solving some of the assessment challenges
of today (and perhaps tomorrow?)
The next 45 minutes…
05/01/2023 6
Steve Harrington Strategic Account Manager
Ian Castledine Solution Architect
Some Introductions
Dave Dixon Senior Solutions Architect
Tim Burnett Head of Marketing
05/01/2023 7
05/01/2023 8
“The use of technology to manage, deliver and mark
assessments.”
Defining e-Assessment
05/01/2023 9
.
Trends in e-AssessmentRemote
team working
Data drivenitem
banking
Largescale
scanning
Alertsand
updates
Rich media
content
Multi method delivery
Work-flow
controls
Responsive question display
Advanced question
types
Script based
marking
Onscreenhuman
marking
Itembased
marking
Secure exam
distribution
Secure onscreen delivery
Roles basedaccess
05/01/2023 10
The existing options
• Expensive• Time consuming• Heavy on maintenance
Build your own system
• It will never be a perfect fitBuy a ‘one size fits
all’ solution or service
• Heavy on maintenance• Complex to maintain and use
License or buy components and integrate yourself
The Existing Options
Build your own system
• It will never be a perfect fitBuy a ‘one size fits
all’ solution or service
• Heavy on maintenance• Complex to maintain and use
License or buy components and integrate yourself
05/01/2023 11
What’s the risk?
“You’ll get what you want today, but you’ll be stuck with it tomorrow.”
The Challenge
.
Delivering an Integrated Assessment Platform
Discrete systems, integrated with the Awarding Body
+ Best of breed components+ Automated transfer of candidate data
- Awarding Body responsible for data integration (e.g. translation between different data formats)
E-Testing E-Marking
Awarding Body
.
Delivering an Integrated Assessment platform
Integrated Assessment system
Best of breed componentsAutomated transfer of candidate dataProviders responsible for data integrationAwarding Body interfaces with a single systemFlexible approach, enabling other systems to be integrated later
E-Testing
E-Marking
Awarding Body
Integration Engine
05/01/2023 14
.
▪ User experience of an integrated solution
Authoring and delivery of on-screen testing
On-screen marking
RM Assessor is RM Results’ flagship product: used in 2015 to e-mark 160+ million exam pages in 100+ countries.
It is used to mark paper, CBT and coursework for high stakes exams.
05/01/2023 16
.
RM Assessor e-Marking Tool
RM Assessor Marking Tool
Consistent, high quality marking
Continuous monitoring
Team Management
Management of re-marking
Marker training and support
Management reporting
Integrated Assessment Solution
05/01/2023 18
Examinations, Test Schedule
Mark schemesMeta-dataPaper based image zonesStatus info
Computer based testsAnswer keys
ExamCentresCandidates Marks
New CandidatesStatus
MarksExposure
Test ResponsesAuto-marksImages
ExaminationsCentres, CandidatesMarkers
Examinations, Marks, Awards
Item performance
Status info
MarksAwarding boundarie
sStatus info
Marks
Delivery Systems
Authoring System
Awarding Body Systems
Results Analysis
Marking System
(RM Assessor)
Awarding Body
Systems
05/01/2023 19
.Awarding Body Systems
Digital Assessment Integration Engine
Data handling Scheduling Security
ResultsAnalysis
Candidate Registration
Examiner Recruitment
BTL SurpassTest Authoring
BTL Surpass Test Delivery
RM Assessor Marking
Awarding Body Systems
Digital Assessment Integration Engine
Data handling Scheduling Security
05/01/2023 20
.
Delivering an Integrated Assessment Platform
▪ Enables operational best practices▪ Single source of data▪ Secure managed data
transfer▪ Automated data
transformation and business processes
▪ Innovations in Assessment▪ Facilitates joining up of
discrete systems from different vendors
▪ Provides single customer interface to multiple vendor systems
• Enables translation between different data structures
E-Testing E-Marking
Awarding Body
Integration Engine
05/01/2023 21
.
SummaryHow is this innovative?▪ Introducing a new way of leading suppliers working
together▪ Connecting two systems on a technical and
business level for the first time▪ Doing this without significant change to existing
tools and interfaces, all the benefits, no negative impact
05/01/2023 22
Thank you
▪ Steve Harrington [email protected]▪ Ian Castledine [email protected]▪ Tim Burnett [email protected]▪ Dave Dixon [email protected]
@BTLGroup @RM_Results