Board Member Training 2006

Session 1: Continuing CompetenceSession 2: Impact of Technology

Steven K. Bryant, PhD and William D. Hogan, MEApplied Measurement

Professionals, Inc.

2006 Annual Conference

Alexandria, Virginia

Council on Licensure, Enforcement and Regulation

Expect the Unexpected: Are We Clearly Prepared?

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

About Us…….

Steven K. Bryant, PhDFounder and President, AMP (1982-2002)CEO, Nat’l Board for Respiratory Care (1974-

2002)

William D. Hogan, MEVice President, Marketing and Business ProductsAMP, 1993-Present

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

NBRC and State Regulation

• Use of Entry Level Exam by States• State Licensure Liaison Group• National RC Disciplinary Database• Mandatory Continuing Competency

Program, 2002

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

AMP and Technology

• Examination Development/Research

• Real Estate Program• National Network of AMP

Assessment Centers

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Consistent with…….

• CLEAR Guidelines, Modules 4 & 6• NOCA/NCCA Standards

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing Competence

“Luck is where preparation meets opportunity.”

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing Competence

Complete Situational Exercises

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

CLEAR Definition…..

Success on licensure exams =

Minimally competent at the time of testing

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing Competence…..

What about the future after licensure?

What are our responsibilities?

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing competency programs…

• Attempt to address future• Various options:

Re-examination (same/different)Self-assessmentPortfolio review

Continuing educationOthers

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Re-Examination

• Not professionally/politically OK• May not be valid for current job• “Makes money” for agencies• Extra development expense

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Self-Assessment

• Difficult to supervise• Not secure• Who really did it?• May not be job-related

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Portfolio Reviews

• Similar problems to self-assessment

• References are all good• May not be job-related

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing Education

• Readily available• Acceptable• Lesser of other evils• Professional associations love it

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing Competence

Continuing education has become the face of continued competence—are they really the same?

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing Competence

Probably not!!

• Validity evidence lacking• Exams can measure job performance

• CE most preferred anyway

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

NOCA/NCCA Standards

….a process that documents or “contributes to” the continued competence of the certified occupation…..

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Respiratory care…….

48 states regulate the profession---all provide for completion of CE to satisfy continuing competency requirements

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

NBRC Mandatory CCP

• Re-examination• Pass higher level exam• Complete CE compatible with

states

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Difficulties with imposing CCP

• Post-voluntary credentialing• Post-licensure

Two different worlds!

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing Competence

What Board Members really need to know:

• CC is difficult to document• Most often method used is CE• CE Programs offered by many• Administrative pitfalls to avoid

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Administrative Pitfalls……

• Approval of CE Programs• Using what exists• Lead time required• Verification of completion

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing Competence

The controversy continues!!

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Continuing Competence

Review Situational Exercises

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Speaker Contact Information

Thank You!Steven K. Bryant, PhD and William D. Hogan, ME

Applied Measurement Professionals, Inc.8310 Nieman Rd.Lenexa, KS 66214

913-541-0400www.goAMP.com

sbryant or whogan@goAMP.com

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

CLEAR Board Training --Session Two

The Impact of Technology on Board Meetings, Examination

Development and Administration

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Impact of Technology

“Technology is a wonderful thing----when it works!!”

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Impact of Technology

Technology Assisted Meetings

• Focused Displays• Agendas/Background Info

• Virtual Meetings

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Sample of NBRC Board Book

• AGENDA• Board of Trustees

• National Board for Respiratory Care, Inc.• Saturday, May 6, 2006

• 9:00 am – 3:00 pm• Merrick I & II

• The Colonnade Hotel• Coral Gables, FL

1. Call to Order/Secretary’s Roll Call2. Introduction/Welcome of New Board Members and Guests3. Approval of MinutesMinutes of November 12, 2005 Meeting4. Officer Reports (optional – except President)

a. Presidentb. Vice Presidentc. Secretaryd. Treasurer

5. Public Advisor’s Report 6. Executive Committee Report7. Examination Committee Reports

(A single resolution to accept all Examination Committee Reports is requested after all have been presented.) a Examination Committee Chairmen b. Entry Level CRT Examination Committee c. Therapist Written Examination Committee d. Clinical Simulation Examination Committee e. Pulmonary Function Technology Examination Committee f. Neonatal/Pediatric Respiratory Care Examination Committee

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Use of Technology During Meetings

• Laptops for note taking• Power Point and other aids• Internet Connections• Demonstrations• Video Contacts

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Virtual Meetings

• Phone and computer may be needed

• Individual review of materials• Committee meetings• Board meetings

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Sample item

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

Steps in Examination Development

Job analysis/test specsItem development/test assembly

Minimum passing levelValidation/pre-testing

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

Job Analysis/Role Delineation

Survey-basedCommittee-basedContent set by law

Transportability

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

Test Specifications

More Important Job DutiesTasks/KSAs

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

Test Development

Items linked to tasks/KSAsSeries of structured reviews

Cueing

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

Setting the MPL

Angoff, Nedelsky, OthersPanel of Experts

State vs. National

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

Validation/Pre-testing

ContentPredictive

Pre-test Item StatsNot Mentioned in CLEAR Guidelines

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

Costs of Testing

Test for 1 vs. 10,000Administration Using CBT

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

• Job analysis research• Test development/items reviews• Final test reviews• Post-test statistics

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

Computer-based testing simply replaces a test booklet and answer sheet with a computer---

Real Impact of TechnologyInstant Results/Quick Re-tests

Enhanced Security

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Technology and Examinations

High-Stakes Testing vs. Web-tests/self assessments

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Some CBT Pitfalls

• Need Integrated System• Reliance on ATG’s• False Sense of “Security”• Human Intervention Important• Proctor Training• Examination Storage

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Impact of Technology

“Technology is a wonderful thing----when it works!!”

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Impact of Technology

Review Technology-Related Situational Exercises

Presented at the 2006 CLEAR Annual ConferenceSeptember 14-16 Alexandria, Virginia

Speaker Contact Information

Thank You!Steven K. Bryant, PhD and William D. Hogan, ME

Applied Measurement Professionals, Inc.8310 Nieman Rd.Lenexa, KS 66214

913-541-0400www.goAMP.com

sbryant or whogan@goAMP.com