Exams Workshop of the Council for European Specialist Medical Assessments Appraisals ...€¦ · · 2016-12-08Exams Workshop of the Council for European Specialist Medical Assessments

UEMS-CESMA Meeting – December 2nd-3rd, 2016 UEMS Domus Medica Europaea

Exams Workshop of the Council for European Specialist Medical Assessments

Appraisals of European examinations: How to conduct them and how to prepare for them?

Prof. dr. Danny G.P. Mathysen (MSc, PhD)

EBOD Assessment & Executive Officer Antwerp University Hospital (UZA), Department Ophthalmology

University of Antwerp (UAntwerpen), Faculty of Medicine and Health Sciences Institute for Medical Specialty Education (IZO), Education Coordinator

Wilrijkstraat 10, B-2650 Edegem (Antwerp), Belgium [email protected]


UEMS-CESMA Appraisal procedure



• Applications for UEMS-CESMA appraisal procedures are to be directed to: Lise Carratala, UEMS, Rue de l’Industrie 24, 1040 Brussels, [email protected]

• Applications for UEMS-CESMA appraisal procedures are forwarded to the UEMS-CESMA appraisal liaison officer of the UEMS-CESMA Executives, who will:

– be in touch with the applicants concerning practical details

– select two UEMS-CESMA visitors to perform the UEMS-CESMA appraisal

• UEMS-CESMA visitors select on-site one or two co-visitors (examiners independent from the applicants) for the UEMS-CESMA appraisal procedure and write a draft report which is submitted to the applicants for review (to avoid any possible misunderstandings or errors)



• Upon approval of the draft report by the applicants, the UEMS-CESMA visitors send this report to the UEMS-CESMA appraisal liaison officer of the UEMS-CESMA Executives, who will:

– review the draft report

– in case of positive evaluation submit the report to the UEMS-CESMA Executives for final approval

• UEMS-CESMA will send the invoice and certificate (upon payment)

• Validity of the certificate will be 5 years


UEMS-CESMA Appraisal procedures (2013-2017) 1. European Diploma in Transplant Surgery (EDTS) examination

(September 7th, 2013) (Vienna, Austria) (Zeev Goldik – Danny Mathysen)

2. European Board of Ophthalmology Diploma (EBOD) examination (May 9th-10th, 2014) (Paris, France) (Zeev Goldik – John Boorman)

3. European Board of Hand Surgery (EBHS) examination (June 16th-17th, 2014) (Paris, France) (Owen Sparrow – Danny Mathysen)

4. European Society of Surgical Oncology (ESSO) examination (September 5th-6th, 2014) (Brussels, Belgium) (Zeev Goldik – Danny Mathysen)

5. European Board of Radiology (EDiR) examination (March 5th-6th, 2015) (Vienna, Austria) (Klaus Albegger – Danny Mathysen)

6. European Board of Plastic and Reconstructive Surgery (EBOPRAS) examination (April 24th-25th, 2015) (Brussels, Belgium) (Artur Felice – Danny Mathysen)

7. European Society of Anaesthesiology (EDAIC) examination (October 30th-31st, 2015) (Athens, Greece) (Owen Sparrow – Danny Mathysen)


UEMS-CESMA Appraisal procedures (2013-2017) 8. European Diploma in General Surgery (EBSQ) examination

(May 11th-12th, 2016) (Belfast, Northern Ireland) (Marco Maggiorini – Danny Mathysen)

9. European Board of Neurology (EBN) examination (May 27th, 2016) (Copenhagen, Denmark) (Arthur Felice – Danny Mathysen)

10. European Diploma in Intensive Care Medicine (EDIC) examination (October 3rd, 2016) (Milan, Italy) (Part 1: written) (November 23rd-24th, 2016) (Zurich, Switzerland) (Part 2: oral) (Gian Battista Parigi – Julie-Lyn Noel – Danny Mathysen)

11. European Board of Interventional Radiology (EBIR) examination (March 1st-2nd, 2017) (Vienna, Austria) (Arthur Felice – Klaus Albegger)


UEMS-CESMA Appraisal procedures (Interested) 1. European Diploma in General Paediatrics examination

(Mercier Jean-Christophe)

2. European Board of Paediatric Surgery examination (Parrigi Gian Battista)

3. European Board of Surgery (EBSQ) examination in endocrine surgery (Durkan Maeve)

4. European Board and College of Obstetrics and Gynaecology (EBCOG) examination (Kirschner Rolf)


UEMS-CESMA Appraisal procedures (2013-2017) UEMS-CESMA Observers (11 appraisal procedures) No. of times participated

MATHYSEN Danny (UEMS-CESMA Appraisals Liaison Officer) 9

FELICE Arthur 3

GOLDIK Zeev (UEMS-CESMA Chairman) 3

ALBEGGER Klaus 2

SPARROW Owen (UEMS-CESMA General Secretary) 2

BOORMAN John 1

MAGGIORINI Marco 1

NOËL Julie-Lyn 1

PARIGI Gian Battista (UEMS-CESMA Treasurer) 1

DURKAN Maeve

MERCIER Jean-Christophe


UEMS-CESMA Appraisal procedures (future) • Involvement of more UEMS-CESMA observers would be helpful

– to increase transparency about the UEMS-CESMA appraisal procedures “UEMS-CESMA appraisals by UEMS-CESMA members for UEMS-CESMA members”

– to reduce costs involved for the examination organisers (travel expenses)

• UEMS-CESMA appraisal procedures will help UEMS-CESMA in increasing the quality of the guidelines issues on organising European Board/Society medical (sub)specialty examinations


A man while flying in a hot air balloon suddenly realizes he is lost. He looks down, spots another man running and shouts:

“Excuse me, can you help me please? I had promised my friend to meet him half an hour ago, but I do not know where I am.”


The man on the ground replies: “Yes, of course I can help you. You’re in a hot air balloon and floating about 10 meters above the ground. Your location details are: between 40° and 41° north latitude, and between 59° and 60° western longitude.”


“You are definitely a quality officer”, said the man in the balloon.

“Indeed”, said the other man, “but how do you know?”

“Well”, said the man in the balloon, “everything you told me may technically be correct, but the information you provide is of no use to me, and all in all I’m still lost.”


The man on the floor replied: “And you’re for sure a manager?”.

“That’s right”, said the man in the balloon, “but how do you know?”.

“Easy! You have no idea where you are, and you don’t know at all where you are going. You have made a promise while you have no clue how to live up to that promise and you expect me to solve your problem. You’re still in the same position as before we met, but in some way it seems now to be my fault.”


UEMS-CESMA Appraisal procedures • Try to avoid prejudices

“It pays to keep an open mind, but not so open that your brains fall out” (Carl Sagan, 1934-1996 – American astronomer, cosmologist, astrophysicist, astrobiologist, author, science popularizer, and science communicator in astronomy and other natural sciences)

• Make use of your communication skills (explain well, be polite, ...)

• Be critical when needed (formulate an advise on how to improve quality)

Receiver


UEMS-CESMA Appraisal procedures • Be pleased to receive constructive feedback


UEMS-CESMA Guidelines

– Quality control on behalf of UEMS-CESMA of European postgraduate medical assessments (adopted by the Granada UEMS Council meeting in October, 2014) http://www.uems.eu/__data/assets/pdf_file/0006/25296/UEMS-CESMA-Guideline-for-quality-control-on-behalf-of-UEMS-CESMA-of-European-postgraduate-medical-assessments-.pdf

http://www.uems.eu/__data/assets/pdf_file/0006/25296/UEMS-CESMA-Guideline-for-quality-control-on-behalf-of-UEMS-CESMA-of-European-postgraduate-medical-assessments-.pdf


































UEMS-CESMA



– A guide to successfully writing MCQs http://www.uems.eu/__data/assets/pdf_file/0017/24911/UEMS-2015.15-UEMS-CESMA-A-guide-to-successfully-writing-MCQs-final.pdf

– Organisation of European postgraduate medical assessments http://www.uems.eu/__data/assets/pdf_file/0018/24912/UEMS-2015.16-UEMS-CESMA-Guideline-for-the-organisation-of-European-postgraduate-medical-assessments-Final.pdf

http://www.uems.eu/__data/assets/pdf_file/0017/24911/UEMS-2015.15-UEMS-CESMA-A-guide-to-successfully-writing-MCQs-final.pdf





















http://www.uems.eu/__data/assets/pdf_file/0018/24912/UEMS-2015.16-UEMS-CESMA-Guideline-for-the-organisation-of-European-postgraduate-medical-assessments-Final.pdf




























UEMS-CESMA


UEMS-CESMA



– Examiner selection for European postgraduate medical assessments http://www.uems.eu/__data/assets/pdf_file/0019/24913/UEMS-2015.17-UEMS-CESMA-Guideline-on-examiner-selection-for-European-postgraduate-medical-assessments-final.pdf

http://www.uems.eu/__data/assets/pdf_file/0019/24913/UEMS-2015.17-UEMS-CESMA-Guideline-on-examiner-selection-for-European-postgraduate-medical-assessments-final.pdf




























UEMS-CESMA


How to prepare for UEMS-CESMA appraisals?


Evaluation of examination venue

• Evaluation of the examination venue taking into account: – How easy is it for candidates to find and reach the examination venue?

– Is the venue suitable to organise an examination (space, supervision, etc.)?

– ...


• Evaluation of the examination methods taking into account: – Procedures for written examination: guidelines versus reality

– Procedures for oral examination: guidelines versus reality

– Fairness of examination methods

– ...

Evaluation of examination methods


• Evaluation of the examination methods taking into account: – Interview with candidates who took the examination

– Interview with examiners who were involved in the examination but not in the organisation

– ...

Evaluation of examination methods


Observations during UEMS-CESMA appraisals

• Assessment standards observed are high the remarks formulated in the UEMS-CESMA appraisal reports are to be considered as suggestions

• Nevertheless, some observations are made in all examinations:

– Human interaction issues (language issues, body language, ...) between examiners and candidates

– Use of precious assessment time for teaching of the candidate

– Time pressure

– Inability to comply to the guidelines provided to examiners

• Differences observed between anonymous assessment, partially anonymous assessment (either candidates or examiners) and non-anonymous assessment...


Faleminderit shumë (Albanian) Shterakravetsun (Armenian) Eskerrik asko (Basque) Mnogo blagodarya (Bulgarian) Dzãkujã (Cassubian) Moltes gràcies (Catalan) Merastawhy (Cornish)

À ringraziavvi (Corsican) Hvala lijepa (Croatian) Dĕkuji (Czech) Mange tak (Danish) Dank u wel (Dutch) Thank you (English) Ic sæcge eow Þancas (English, old) Dankon al vi (Esperanto) Aitäh (Estonian)

Paljon kiitoksia (Finnish) Merci beaucoup (French) Tanke wol (Frisian) Graciis (Friulian) Grazas (Galician) Mèrczi (Gallo) Merci (Gascon) Besten dank (German) Merci villmahl (German: Zurich Switzerland) Ευχαριστώ (Greek) Toda raba (Hebrew) Nagyon köszönöm (Hungarian) Takk fyrir (Icelandic)

Gratias (Interlingua) Qujanaq (Inuttut) Go raibh mile maith agaibh (Irish Gaelic) Gratias tibi ago (Latin) Liels paldies (Latvian) Mouchou gratzia (Lingua Franca) Labai achiu (Lithuanian) Merci (Luxembourgish)

Grazzi hafna (Maltese) Gura mie mooar ayd (Manx) Merçì (Monegasque) Gràzzie (Napulitano) Dziękuję (Polish) Obrigado (Portuguese) Mercé plan (Provencal) Nais tuke (Romani: gypsy)

Oven saste (Romani) Mulţumesc (Romanian) Grazia fitgun (Romantsch) Спасибо (Russian) Giitus eanat (Saami Lappish) Moran taing (Scottish Gaelic) Grazzii (Sicilian) Dakujem vám (Slovak) Hvala lepa (Slovenian) Dz’akujo so (Sorbian) Muchas gracias (Spanish) Dankeschee (Swabian)

Tackar så mycket (Swedish) Çok tesekkür ederim (Turkish) Moltes gracies (Valencian) Merci (Walloon) Diolch yn fawr iawn (Welsh) A dank aych (Yiddish)

Thank you …

Documents

Exams Workshop of the Council for European Specialist Medical Assessments Appraisals ...€¦ · · 2016-12-08Exams Workshop of the Council for European Specialist Medical Assessments