AMERICAN BOARD OF INTERNAL MEDICINE

TITLE: EXAM DEVELOPER LEVEL: E5/E6

DEPARTMENT: TEST DEVELOPMENT (02) REPORTS TO: VICE PRESIDENT TEST DEVELOPMENT POSITION SUMMARY: The Exam Developer is a full-time salaried staff member who is the Test Development team leader for the development, construction, and production of specific ABIM examination programs. The Exam Developer serves as staff administrator to test committees of physicians who are content experts in their field. Periodic travel is required for meetings. The Exam Developer reports to the Vice President for Test Development. ABIM MISSION: The American Board of Internal Medicine is a not-for-profit organization whose mission is to enhance the quality of health care through certifying physicians who demonstrate the knowledge, skills and attitudes essential for excellent patient care. EQUAL EMPLOYMENT OPPORTUNITY: The American Board of Internal Medicine (ABIM) provides equal employment opportunities to all qualified individuals without regard to race, creed, color, religion, national origin, age, sex, marital status, sexual preference, or non-disqualifying physical or mental handicap or disability in each aspect of the human resources function. AMERICAN WITH DISABILITIES ACT: Applicants as well as employees who are or become disabled must be able to perform the essential job functions either unaided or with reasonable accommodation. The organization shall determine reasonable accommodation on a case-by-case basis in accordance with applicable law. ORGANIZATIONAL COMPETENCIES: • Demonstrates support of and commitment to the mission and values of the organization. • Develops and maintains positive relationships with co-workers and other organizational stakeholders • Contributes to creating a learning environment that values, empowers, enriches and supports employees • Contributes to the culture by supporting and contributing to process and quality improvement • Demonstrates a commitment to and complies with the organization’s policies and procedures ESSENTIAL FUNCTIONS: The primary responsibility of the Exam Developer is to manage the activities related to developing ABIM cognitive assessment products (secure examinations and self-assessments) working directly with subject-matter expert committees in constructing reliable and valid assessments. This responsibility requires the Exam Developer to demonstrate the following competencies: • expertise in implementing question writing and test construction principles • understanding of measurement principles; • skills in editing, writing, and logical expression; • understanding of medical concepts and terminology; • skills in managing processes, projects, and meetings; • ability to communicate with and guide diverse groups of subject matter experts towards the implementation of

ABIM best practices • knowledge of (and ability to communicate with others) the Board environment, its role in health care, the

structure of graduate medical education, and ABIM structure, policy, and processes. The Exam Developer is responsible for performing or overseeing specific examination development and maintenance tasks, including: • scheduling meetings and formulating agendas and work assignments with test committees; • summarizing results of exam development meetings; • formulating question-writing and review assignments based on blueprint and item pool analysis; • leading the editorial and production team for each assigned exam and medical knowledge self-assessment

products (SEPs);

AMERICAN BOARD OF INTERNAL MEDICINE

TITLE: EXAM DEVELOPER LEVEL: E5/E6

DEPARTMENT: TEST DEVELOPMENT (02) REPORTS TO: VICE PRESIDENT TEST DEVELOPMENT • using the electronic database (or item bank) and associated system and process tools and milestones that

support exam development projects. • managing and meeting the development, production, and psychometric deadlines for each exam and SEP; • providing Psychometrics staff with needed information at key process checkpoints; • collaborating with Psychometrics staff during test committee meetings and on critical shared functions,

including pool analysis and maintenance, automated test assembly, and blueprinting The Exam Developer also serves as staff administrator to the test committees by guiding and supporting their discussion and development of policy related to certification in the given discipline. This function may require acting as a liaison between committees and other Board staff, preparing policy agendas and reports, and summarizing policy discussions. OTHER FUNCTIONS: The Exam Developer may also be asked to acquire new expertise and/or participate in special projects as needed. These activities may include, but are not limited to, the following: • assisting in the development of new assessment instruments or formats; • participating in the training of new Test Development staff members when appropriate; • participating in projects requiring expertise in new technologies (e.g., exam fidelity enhancements, innovative

item types, simulation, new competency assessments; • representing Test Development for projects requiring expertise from different sections within ABIM (e.g.,

blueprint surveys, policy revisions) KNOWLEDGE, SKILLS & ABILITIES / EDUCATIONAL REQUIREMENTS: • Expertise in question and test construction – ability to uphold ABIM assessment standards and actively

participate in exam development decisions with physician content-matter experts. • Communication/writing skills – ability to edit and to write clearly and concisely; familiarity with medical

terminology is desirable. • Professional attitude and performance – excellent interpersonal and communication skills; ability to work well

without close supervision and to accept full responsibility for quality of work; willingness to travel, to work extra hours and on weekends when necessary, and to assist other Test Development staff members as necessary.

• Organizational/Process Management skills – ability to pay meticulous attention to detail; ability to assess priorities, to understand workflow processes and desired outcomes, to adjust work schedules appropriately, and to meet deadlines; ability to manage multiple tasks for assigned exams that are concurrently in different stages of development or production.

• Trustworthiness – commitment to maintain confidentiality of examination material and to act at all times with personal integrity in support of the ABIM Mission.

• Undergraduate degree is required; graduate degree in a related field, particularly measurement or educational psychology is highly desirable.

• Experience in professional or educational testing programs is strongly preferred, as is experience in working closely with subject-matter experts; experience with PC-/Windows-based computer systems and database applications is required.

If you are interested in applying for this position, please contact Chris Brod in the Human Resources department, forward your information to resumehr@abim.org, or confidentially fax your resume to 215 446 3516.