Work Place Based Assessment:
A deeper understanding of competency assessmentJohn Kedward, Associate DeanWork Place Based AssessmentTo support new and existing supervisors achieve quicker, smarter, high quality Educational Supervisions, with a focus on the competency assessment .- Agreeing interpretation of Excellent, Competent, NFD (above, at, below expectations)How to evidence in a specific, appropriate way,Supporting trainee improve their own assessment and evidence collectionYour Educational Supervision issues?Competency scoringDiscussion in groups:How do we make decisions on scoring as:ExcellentCompetent for LicensingNeeds Further Development Above ExpectationsNeeds Further Development Meets ExpectationsNeeds Further Development Below ExpectationsFor each of the 13 competencies?What guidance can we use?How does the stage of training affect how we score trainees?
Evidence for competency assessmentDiscussion: What type of evidence would we like trainees to provide to support competency assessment?Evidence that is helpfulEvidence that is less helpfulIssues for panelsScenario 1: Understanding meaning of competency ratingsST3 final ESR what are the options for scoring if the trainee has not achieved competency?
Issues for panelsScenario 2: ST1 self rating trainee scores Excellent or competent in all areas. Evidence does not support this (not yet done GP post, not had any observed consultations). How do you handle this?Issues for panelsScenario 3: Lack of evidence.Trainee statements in self assessments do not link to any significant evidence. Supervisor also does not link much additional evidence to support ratings given. RCGP ESR FEEDBACKAcceptable Needs Further Development Judgements are generally referenced to a range of relevant evidence selected by trainees and/or ES* Judgements appear to be justifiable and include a description of how the evidence supports the ESs decision Suggestions for trainee development are routinely made by the ES and appear to be appropriate 1. The Educational Supervisor (ES) has not based their judgement on appropriate evidence selected by trainee and/or the ES 2. When making their judgement, the ES has not explained how the evidence supports their decision 3. The ES has not provided appropriate action plans for future trainee development, including in the final review of GP Training TIPS FOR EDUCATIONAL SUPERVISORSGold Guide description of the ESR
is a synthesis of the evidence in the trainees learning portfolio which summarises the trainees workplace assessments, experience and additional activities which contribute to the training process. The report and the discussion which should ensue following its compilation must be evidence based, timely, open and honest. [Gold Guide, fourth edition, paragraph 7.35]
TIPS FOR EDUCATIONAL SUPERVISORSRecognise the time and effort involved in the process of completing an ESR.Ensure your practice/ partners are also aware of the time commitment and give you the time
TIPS FOR EDUCATIONAL SUPERVISORSMake use of the descriptions in the Word pictures for the competencies. In many supervisions these are ignored, and only an element of the competency has actually been considered. Get a deeper understanding of the competencies e.g. Amar Rughani, Becoming a GPTIPS FOR EDUCATIONAL SUPERVISORSUse multiple internet browser tabs. Most internet browsers allow you to have multiple web pages open at the same time, which can make it much easier to switch quickly between different pieces of information, and copy and paste. Just use one tab for writing.TIPS FOR EDUCATIONAL SUPERVISORSDo the work on a continual basis you should engage with the trainees ePortfolio all year round, and not just toward the end of the review period. This should include: a. Removing inappropriate links between a log entry and curriculum heading (you can do this anytime). b. Linking log entries to the professional competences (you can do this at any time). help clarify your reasons for making the link, both for yourself in future, and for your trainee, you may wish to add an explanatory comment to the log entry. c. Commenting on log entries (this can be done at any time). Commenting on a log entry can be a good way to increase its prominence. TIPS FOR EDUCATIONAL SUPERVISORSTo see only the log entries that have been commented on (by the trainee/yourself/other trainers), in the learning log, click Has Comment on the far right column in order to display only the entries with comments. TIPS FOR EDUCATIONAL SUPERVISORSUse the trainees competence self-rating. Encourage your trainee to flag in their competence self-rating any particular pieces of evidence which they believe illustrate progress in the competence in question. The more specific they are, the more likely you are to be able to find and consider the evidence easily.Make sure you reference a range of ePortfolio evidence in your comments, and provide interpretation of the evidence, even if the trainee does not. Encourage your trainee to complete their self-ratings in a timely fashion, to make sure you have their ratings to consider as evidence when writing your report. TIPS FOR EDUCATIONAL SUPERVISORSUse the competence table. This is displayed for you when you click the Competence Areas Ed Sup section of the review, or is accessible through Competence Areas in the left-hand navigation menu. This table is a summary of the evidence that has been linked to the competences to date, either automatically or by you.The trainee cannot link evidence to the competences. Keeping this resource up to date on a continual basis means you will not have to trawl through the entire learning log for pertinent entries when you come to write the ESR. TIPS FOR EDUCATIONAL SUPERVISORSYou can see a list of all the evidence that has been linked to a competence by clicking on the number in the table. You can then read each particular piece of evidence (except for MSFs) by clicking on the hyperlink. You may wish to have one tab open containing the competence rating you are in the process of writing, and another tab contain the competence summary table, to be able to refer to this more easilyUsing two screens can also make it much easier to visualise. TIPS FOR EDUCATIONAL SUPERVISORSUse your last ESR. Being familiar with your last ESR may make it easier to gauge your trainees progress. There is also a question in the curriculum section of the ESR that asks specifically about progress made since the last review. You may wish to open your last ESR in a separate internet browser tab. You may wish to download or print your last ESR, by selecting it from the Download section of the left-hand navigation menu.