The Competencies Working Group Update: The Performance Framework

Rosalyn Scott, VATimothy Willet, SIM-one

Valerie Smothers, MedBiquitous

Novice

Intermediate

Mastery

Thank You!

MedBiquitous Competencies Working Group

How competent?Level 1 

(eg Novice)Level 5

(eg Mastery)Level 2 Level 3 Level 4

Which competency? Competency framework

Performance framework

How competent?Level 1 

(eg Novice)Level 5

(eg Mastery)Level 2 Level 3 Level 4

Which competency? Competency framework

Performance framework

Educational Achievement

Benefits

• Standardization of measurement across a discipline or specialty

• Implementation in assessment systems• Compilation of performance data across courses/units/systems

• Exporting for benchmarking and educational research

Example 1: Internal Medicine

http://www.acgme.org/acgmeweb/Portals/0/PDFs/Milestones/InternalMedicineMilestones.pdf 

Metadata

Performance Scale

Component

ie 1 to 5, 5 being most competent

Component

Component

Component

References a competency and defines levels of performance using behavioral indicators

Components can be nested to reflect instances where complex competencies are broken down into component parts for evaluation

Title, effective date, authors, supporting information

Component

Competency (reference to a Competency Object)

Performance Level

Least competent Most competent

1 5Performance Scale

Least competent Most competentPerformance Scale

1 52 3 4Score

1 5Performance Scale

Least competent Most competentScores

1 52 3 4

1 5Performance Scale

Least competent Most competentIndicators

http://www.utsystem.edu/initiatives/time/

Example 2: Transformation in Medical Education (TIME)

Thresholds

Performance levels

Competency

Example: An Advanced Practice NursingProgram

MedBiquitous Process• Approves new standards 

projects

• Meets via telco, in person• Develops specifications

• Consensus body• Votes

• Final approval

Working groups

Standards committee

ANSI

Executive committee

Standards Committee

Standards Committee review (30 days)

Public Review (45 days)

Ballot (6 weeks)

More information

• Specification and Schemahttp://medbiq.org/std_specs/specifications/index.html#performance_framework

• Contact Valerie Smothersvsmothers@jhmi.edu