16

Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Embed Size (px)

Citation preview

Page 1: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification
Page 2: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

MatthewMatthew McCullaghMcCullagh

Quality Manager

Making the most of VerificationMaking the most of Verification

Page 3: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

VerificationVerificationVerificationVerification

Verification is the process by which Verification is the process by which SQA assures that national standards SQA assures that national standards are maintained in assessments are maintained in assessments carried out by centrescarried out by centres

Partnership approach between SQA Partnership approach between SQA and approved centresand approved centres

Page 4: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Internal VerificationInternal VerificationInternal VerificationInternal Verification

An on-going quality assurance and An on-going quality assurance and improvement procedureimprovement procedure

Ensures that all assessment decisions Ensures that all assessment decisions are valid and consistent throughout the are valid and consistent throughout the entire assessment processentire assessment process

A 3 stage, rolling programme of A 3 stage, rolling programme of beforebefore, , duringduring and and afterafter assessment activitiesassessment activities

Page 5: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Stage 1 - BeforeStage 1 - Before key features key features Stage 1 - BeforeStage 1 - Before key features key features

PlanningPlanning

Design and developmentDesign and development

Validity and reliabilityValidity and reliability

Discussion and agreementDiscussion and agreement

Page 6: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Records of Stage 1Records of Stage 1Records of Stage 1Records of Stage 1

Minutes of team / partnership Minutes of team / partnership meetingsmeetings

Internal Verification planInternal Verification plan Pre-delivery checklistPre-delivery checklist Endorsed Unit master fileEndorsed Unit master file

Page 7: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Roles and Responsibilities – Stage 1Roles and Responsibilities – Stage 1Roles and Responsibilities – Stage 1Roles and Responsibilities – Stage 1

Assessor

• Get familiar with Get familiar with standardsstandards

• Get familiar with Get familiar with conditionsconditions

• Propose assessment Propose assessment instrument(s)instrument(s)

• Prepare candidatesPrepare candidates

Internal Verifier

• Support assessorSupport assessor

• Confirm conditionsConfirm conditions

• Confirm assessment Confirm assessment methodsmethods

• Confirm guidanceConfirm guidance

Page 8: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Stage 2 - DuringStage 2 - During key featureskey featuresStage 2 - DuringStage 2 - During key featureskey features

SupportSupport ConsistencyConsistency SamplingSampling FeedbackFeedback

Page 9: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Records of Stage 2Records of Stage 2 Records of Stage 2Records of Stage 2

Records of sampling and feedback Records of sampling and feedback Minutes of team / partnership Minutes of team / partnership

meetingsmeetings Countersigned assessment recordsCountersigned assessment records

Page 10: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Roles and Responsibilities – Stage 2Roles and Responsibilities – Stage 2Roles and Responsibilities – Stage 2Roles and Responsibilities – Stage 2

Assessor

• Assess candidatesAssess candidates

• Make assessment Make assessment judgementsjudgements

• Feedback to candidatesFeedback to candidates

Internal Verifier

• Support assessorSupport assessor

• Confirm assessment Confirm assessment judgementsjudgements

• Feedback to assessorFeedback to assessor

Page 11: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Stage 3 - AfterStage 3 - After key features key features Stage 3 - AfterStage 3 - After key features key features

Review and evaluationReview and evaluation External verificationExternal verification DiscussionDiscussion ConsensusConsensus

Page 12: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Records of Stage 3Records of Stage 3Records of Stage 3Records of Stage 3

Minutes of team / partnership Minutes of team / partnership meetingsmeetings

Action plansAction plans

Page 13: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Roles and Responsibilities – Stage 3Roles and Responsibilities – Stage 3Roles and Responsibilities – Stage 3Roles and Responsibilities – Stage 3

Assessor

• Reflect on:Reflect on:

- assessment instrumentassessment instrument

- support to candidatessupport to candidates

- assessment judgementsassessment judgements

- feedback to candidatesfeedback to candidates

• Agree Action PlanAgree Action Plan

Internal Verifier

• Support assessorSupport assessor

• Confirm reflectionsConfirm reflections

• Feedback to assessorFeedback to assessor

• Agree Action PlanAgree Action Plan

Page 14: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

Key pointsKey pointsKey pointsKey points

Internal Verification isInternal Verification is not not a a re-marking exercisere-marking exercise

Stage 2 IV is a Stage 2 IV is a samplingsampling process process

IV IV recordsrecords are important – especially are important – especially when used as feedback when used as feedback

Internal Verification should be Internal Verification should be supportivesupportive

Page 15: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification

External verificationExternal verification – IP UnitExternal verificationExternal verification – IP Unit

Quality ForumsQuality Forums Small groups of centresSmall groups of centres IP EVs and Quality Enhancement IP EVs and Quality Enhancement

ManagersManagers Discussion and agreementDiscussion and agreement SupportiveSupportive

Page 16: Matthew McCullagh Quality Manager Making the most of Verification Making the most of Verification