Nelson - 2020 Winter Meeting ABAI Updated(PDs) FINAL [Read ... Documents... · • Michael Swarzman, MBA* (Public Member) ... • Completion of 24 curriculum months in >36 total months

1

ABAI Update

Michael R. Nelson, MD, PhD

President, ABAI

Disclosures

•No financial disclosures

•ABMS

•WRNMMC & DoD

2

Outline

• 2020 Board Initiatives

• Program Director Responsibilities

• Certification Update

• Continuing Certification Update

American Board of Allergy and Immunology

• Directors• Leonard Bacharier, MD (Chair)

• Mariana Castells MD, PhD

• Luz Fonacier, MD (Vice Chair)

• Theodore Freeman, MD (Outgoing Chair)

• Ramsey Fuleihan, MD

• Mitchell Grayson, MD (Treasurer)

• Corinne Keet, MD, MS, PhD

• Mitchell Lester, MD

• Aidan Long, MD

• Kathleen May, MD

• Giselle Mosnaim, MD, MS

• Anna Nowak-Wegrzyn, MD, PhD (Vice Chair Elect)

• Princess Ogbogu, MD

• Wanda Phipatanakul, MD, MS (Secretary)

• S. Romi Saini, MD

• Jeffrey Stokes, MD

• Michael Swarzman, MBA* (Public Member)

• Liaisons• ABMS- Theodore Freeman, MD (MBER)

• ABIM- John Oppenheimer, MD

• ABP- Mary Beth Fasano, MD, MSPH

• Completed term in 2019• Larry Borish, MD

• Jay Portnoy, MD

• Completing term in 2020• Theodore Freeman, MD

• Kathleen May, MD

• Incoming 2021• Jay Lieberman, MD

• Dana Wallace, MD

3

American Board of Allergy and Immunology

• External writing committee

• Prescott Atkinson, MD

• Stuart Abramson, MD

• Mark Corbett, MD

• Mary Beth Fasano, MD

• John James, MD

• John Oppenheimer, MD

• Stokes Peebles, MD

• Scott Sicherer, MD

• Staff

• Michael Nelson, MD, PhD (President)

• Larry Vapniarek, MBA (Chief Operating Officer)*

• Chelsey Williams (Director of Operations)

• Anthony Brewer (CC/MOC Specialist)

• Gina Capozzoli (Credentialing Specialist)

• Rayne Harrison (CC/MOC Manager)

• Cecilia MacCormack (Website & Database Administrator)

• William Thompson, MS (Dir. Examination Development)

• Brianna Wilkins (CC/MOC Assessment Devevlopment. Spec.)

*Retiring spring 2020

ABAI Board of Directors 2020 Initiatives

• Strategic plan

• Bylaws and policy review

• CAP analysis, feedback, progress meter & ABMS update

• Certification Exam Blueprint review

• Ambassador Program

• External Writing Committee

• Staff transitions & restructuring

4

Outline





Program Director Responsibilities

• Evaluations

• Clinical competency every 6 months

• Procedural skills assessment

• Final evaluation (practice competently w/o direct supervision)

• Portal e-signatures signify accuracy and review by the fellow

• Retain copies for stakeholders (ABAI does not release)

• Remediation plan for 2 consecutive (or final) unsatisfactory rating

• Inform graduates of 7yr board eligibility limit & MOC/CAP

5

Program Director Exception Requests

• >2 mo absence from training

• Completion of 24 curriculum months in >36 total months

• Off-cycle exam date window near misses

Outline





6

ABAI Certifications

Time Unlimited Certificates 3,040 (37%)

Time Limited Certificates 5,117 (63%)

Total 8,157

Currently in practice: 76%

Currently participating in CC/MOC: 55%

Improve the quality of medical care by the

development and utilization of professional

and educational standards for the initial

certification and Maintenance of Certification

of physician specialists in allergy/immunology

Initial Certification

• Requirements• ABP or ABIM certification

• ACGME accredited AI Fellowship

• PD Evaluations

• Letters of recommendation

• Unrestricted license

• Pass ABAI certification exam

• Initial certification window• 7 years following graduation

• Meet all requirements

• Unlimited cert. exam attempts

• Regaining eligibility pathway (NEW)• 1 year fellowship equiv. retraining

• ABAI training plan pre-approval

• Supervisor attestation

• Meet all requirements

• 3 cert. exam attempts• ITE & 50 CME required for additional

attempts

7

2020 Certification Examination

• Exam Registration• Opened Jan 1st

• Closes Apr 30th (late fee thru May 31st)

• Cancellation Deadline Aug 31th

• Test Center Registration • Opens Aug 3rd

• Pearson Vue Testing Centers

• Exam Administration Dates• Oct 5th – 9th

• Exam Results• Tentative release date Dec 1st

Items 225

Time 7hrs (2 sessions)

Location Pearson Vue Test Center

Method computer-based

Passing Score absolute minimum

Basic Science* 35%

Clinical Science* 65%

Certification Examination Outcomes

2014 2015 2016 2017 2018 2019

Total # Candidates 170 168 153 180 178 171

% Pass – All Candidates 86% 87.5% 88% 82% 77% 83%

% Pass - First Time 94% 93% 91% 85% 83% 86%

% Pass - Repeaters 44% 39% 67% 64% 53% 71%

8

Outline





• 9 Guiding principles

• 14 RecommendationsContinuing certification must integrate professionalism, assessment, lifelong learning and advancing practice to determine the continuing certification status of a diplomate (Foundational Recommendation)

• Implementation: ABMS task forces and individual boards

9

Continuing Certification: ABAI at Leading Edge

The cycles will be February 15th through July 15th and August 15th through January 15th.

NEW- CAP Block Date Changes

• End of 2019 Transition• Block 2 2019 opened July 1, 2019 – closes January 15, 2020

• New block anniversary dates beginning in 2020• Block 1 opens Feb 15th, closes Jul 15th

• Block 2 opens Aug 15th, closes Jan 15th

• Rationale• Deconflict holidays• Interval feedback review and rescoring

10

CAP Progress Meter

Accessible from two places

CAP- The first three blocks

Block 18-1 Block 18-2 Block 19-1

Total participants 2,835 3,066 3,237

Scoring

Mean 92 94 94

% ≥80% 93% 96% 97%

# Rekeyed 12 8 14

Avg Time core quest (s) 94 107 60

Avg Time artic quest (s) 80 62 63

11

CAP 2019 Block 1

• 3237 participants

• Mean score 93% (9.7 STD)

• Post-block item analysis

• Feedback & psychometrics

• 2 dropped (all got credit)

• 12 accept additional answers

• 10 article, 2 core

• 57 answered <32 of 40 questions

REMINDER:

Although scoring 80% or

greater each block

ensures 5 year cycle

success, individual

blocks are not pass/fail

12

0.86%

3.99%

58.21%

36.87%

Strongly disagree

Disagree

Agree

Strongly Agree

Content Relevant Average =3.31

2019 Diplomate Survey: CAP Feedback

1.46%

11.57%

61.67%

25.24%

Strongly disagree

Disagree

Agree

Strongly agree

Helped identify gaps Average = 3.11


13

2.09%

30.44%

53.93%

13.47%

Strongly disagree

Disagree

Agree

Strongly agree

Plan to make change Avg = 2.79


THANK YOU!

14


Suggestions from diplomates:

• Decrease # articles/questions (26%; 7% respondents)

• Eliminate or increase time limits (6.7%; 2% respondents)

• More CME (6%; 1.6% respondents)

• Access to all articles after block (5.2%; 1.4% respondents)

• Allow feedback after answer provided (4.4%; 1.2% respondents)

Part IV Alternative:Service to the Profession & Academic Activities

• Development and Transmission of Knowledge• Grant recipient of at least 3 years

• Publication of QI article in a recognized peer reviewed journal

• Publication of clinical trial in a recognized peer reviewed journal

• Publications of scholarly work that advances the field (at least 3 articles in a 5 year period)

• Editor, Associate Editor, Assistant Editor, editorial board member or reviewer for Annals, Allergy, Asthma and Immunology, JACI, JACI in Practice or JCI or other recognized peer reviewed journal pertinent to the specialty of Allergy and Immunology

• Reviewer of articles for Annals, Allergy Asthma and Immunology, JACI, JACI in Practice or other recognized peer reviewed journals (minimum 5 reviews in a 2 year period)

• Service as ACGME accredited Allergy & Immunology training program director, training program key faculty or as a member of Training Program Clinical Evaluation Committee.

• Service for Self-Improvement• Academic advancement (i.e. Assistant Professor,

Associate Professor)

• Participation in a program designed to prevent or ameliorate symptoms of professional burn-out

• Successful completion of a leadership program conducted by a recognized provider such as a national professional society (i.e. AAAAI, ACAAI, CIS, AAP, AMA), AAMC or academic institution.

15

Continuing Certification: ABAI at Leading Edge

• Ahead of the pack for implementing Vision Commission recommendation

• Diplomate & society feedback

• External writing committee

• Articles & question writing guidelines

• Resource for ABMS & other boards

• Diplomate centric CAP scoring

1st 5-Month Block

Choose 10 Articles to Read, and

Answer 3 Questions per Article =

30 Questions

Answer 10 Core/General Knowledge

Questions

40 Questions Total

80

Questions

Annually

Continuous Assessment Program (CAP)Article + Core Knowledge Based Assessments

2nd 5-Month Block

Choose 10 Articles to Read, and

Answer 3 Questions per Article =

30 Questions

Answer 10 Core/General Knowledge

Questions

40 Questions Total

16

Summative Evaluation Criterion

5-Year Cycle

Year 2 Question

s

Year 3

Question

s

Year 4 Question

s

Year 5 Questions

Year 1

Question

s

• 5 year summative assessment

• Successful candidate• Aggregate score of ≥80% from top 8 blocks

• Unsuccessful candidate• <80% correct for all questions in top 8 blocks

• Not participating (0 each block)

• Directed to a re-entry pathway

• Self-remediation & grace period• Drop two lowest scoring or missed 6-month

blocks within the 5-year summative cycle to

allow for major life events, professional

commitments, lower performing blocks, etc.

• Feedback on missed questions

Summative Score% correct of 320 questions

from top 8 blocks

40 40

Drop up to two 6-month

blocks with lowest scores

40 40

40 40

40 40

40 40

Additional CAP Information

• Every 5 months• February 15th – July 15th

• August 15th – January 15th

• Open book

• Use of personal device

• Compatible with most common browsers (Google Chrome, Firefox, Safari & Internet Explorer)

• 10 minutes to answer each question

• Immediate feedback

• 6 CME Credits per block

17

CAP Core Item Subset Analysis

• <85% correct (> 1 item)

• A.2 Dermatologic

• A.3 Lung

• A.4 Food & Drug Allergy

• A.5 Anaphylaxis

• B.1 Immune Hypersensitivity