1 Maximizing Your Educational Potential Educational Innovation and Scholarship: Constance Baldwin, Ph.D., University of Rochester Medical Center Latha Chandran, MD, MPH, MBBS, SUNY/Stonybrook 2 What we will do today Definition of scholarship and its assessment Use of Educator Portfolios in academic institutions Discussion of Good teaching Scholarly teaching Educational scholarship 3 Boyers Expanded Definition of Scholarship Discovery: original research to acquire new knowledge, clarify how things work E.g.: How do residents acquire problem solving skills in clinical situations? Does faculty use of a direct observ/feedback checklist improve residents H&Ps? Integration: seeking connections between disciplines, bridging creatively across research findings E.g.: Does use of a computerized residency management program result in increased faculty feedback to residents? 4 Boyers Expanded Definition of Scholarship Application: building bridges between theory and practice, using knowledge for practical purposes E.g.: Does the use of an educator portfolio increase chances of promotion among clinician educators? Teaching: communicating knowledge, making new discoveries accessible and meaningful outside a specialized domain E.g.: Does a curriculum in communication skills enhance patient satisfaction? 5 Glassicks Six Criteria for Excellence in Scholarship 1.Clear goals: stated purpose, realistic objectives, important questions 2.Adequate preparation: understanding of literature, appropriate skills, needed resources 3.Appropriate methods: methods match goals, effective use and flexible application of methods 6 Glassicks Six Criteria for Excellence in Scholarship 4.Significant results: goals are achieved, results are important, field is advanced 5.Effective presentation: presentation well organized, forums appropriate, message clear 6.Reflective critique: work critically evaluated, supported with good evidence, evaluation used to improve future studies 7 Why is this important? 315% increase in clinician educators in last twenty years JHU- Clinician Educators were 69% less likely to hold a higher rank than basic scientists Promotions committees unfamiliar with educational scholarship No standardized way to assess scholarship in EPs 8 The Educator Portfolio Key components: Teaching andLearner Assessment Curriculum Development Advising/Mentoring Educational Leadership and Administration Other information: Awards, Journal reviewer Key indicators of excellence: Quality Impact Developmental and Promotional EPs 9 CV vs EP CV mainly documents educational quantity: if format is modified to report educational activities systematically EP shows quantity, quality and impact: creativity, innovation, evidence-based approach, strong learner outcomes, adoption of models by other programs 10 What we will do today Definition of scholarship and its assessment Use of Educator Portfolios in academic institutions Discussion of Good teaching Scholarly teaching Educational scholarship 11 How is excellent teaching documented? What makes teaching excellent? 12 How is Excellent Teaching Defined? Quantity: Variety, volume, effort Content: Authenticity Variety, Richness, and Depth Quality: Use of best practices and sound planning Demonstrated excellence through Direct observation (peers or experts) Teaching evaluations by learners Assessments of learners Longterm outcomes of learners Outcomes of patients 13 Sound Educational Methods: Authenticity As adult learners, residents want and need: Real world learning opportunities Learning with immediate applicability Chances to apply theory to practice Skills for life-long learning In world of competency-based education, experiential learning in the practice setting is key to enhancing performance 14 Sound Educational Methods: Variety Create a balance of experiences to suit different learning styles and to use a variety of faculty teaching styles Match methods to content : Didactic : complex sets of facts and concepts Interactive : more depth from multiple perspectives Experiential : skills practiced in authentic settings 15 Sound Educational Methods: Richness and Depth As adult learners, students and residents thrive on: Self-directed learning with choices Active learning in practical settings Interactive enrichment Flexible learning experiences that are adaptable to individual learner needs Novelty: new approaches, new types of patients, new settings 16 Sound Educational Methods: Good Planning Learning activities and evaluations based on written goals and specific objectives Efficient use of learners time with flexible alternatives Good use of faculty teaching strengths Variety of learning settings Faculty orientation and development Integration of new experience with program as a whole 17 EP: Documenting EP: Documenting Teaching and Learner Assessment Teaching: Scope and impact Creativity and innovation Evidence-based approach Quality of Teaching: Direct observations by peers or experts Evaluations by learners Objectives-based assessments of learners Long-term learner outcomes Patient outcomes 18 Small Group Exercise I Use Teaching Activities Grid from the EP Template Enter data into Teaching Activities Grid for a variety of activities Review example of an ESP Scholars Teaching Activities Grid Report of one key learning point 19 What is a scholarly approach to education? How will a promotions committee know it when they see it? 20 What is a scholarly approach to teaching? Application of sound principles and systematic planning Use of best practices from literature or recognized experts Self-analysis (reflective practice) to improve teaching or educational development 21 Ex. of Scholarly Approach: Learner Assessment Going beyond the conventions of ones institution Assessing learner needs before teaching Evaluating attainment of learning objectives after teaching Using authoritative sources for new methods 22 Millers Triangle: Quality of Learner Assessments [Miller, GE. Acad Med, 65(supp); Sept 1990] Multiple choice exams Case presentations, low fidelity simulations High fidelity simulations, OSCEs Chart audit, portfolio, direct observ, pt outcomes Millers Triangle Knows how Shows how Does 23 Ex. of Scholarly Approach: Curriculum Development Structured planning (e.g, use of GNOME model) Evaluation using best practices (e.g., Kirkpatrick model for program evaluation) Examples demonstrating innovation and educational quality 24 The GNOME: A Linear Model of Curriculum Development G G = Goals N N = Needs O O = Objectives M M = Methods E E = Evaluation 25 Kirkpatricks Model of Educational Program Evaluation Evaluation of results Real world outcomes impact on society Evaluation of behavior Transfer of knowledge, skills, attitudes to workplace Evaluation of learning Acquisition of knowledge, skills, attitudes Evaluation of reaction Learner satisfaction, usefulness, motivation 26 Small Group Exercise II Review Curriculum Development section from a sample EP Discuss how to improve the documentation How would you advise the scholar to use a more scholarly approach in the future? Report on one key learning point 27 What is educational scholarship How is it done? How is it demonstrated? 28 What is educational scholarship? Scholarship goes beyond good teaching and a scholarly approach It is educational evaluation or research that fulfills the 3 Ps criteria : Publication Publication Peer review Peer review platform Providing a platform for others to build upon 29 Comparison of Educational Evaluation and Research Comparison of Educational Evaluation and Research Educational evaluation Looks within a program Studies the effects of educational intervention Purpose: improve program, report to stakeholders Educational research Looks beyond a particular program Asks a question with broader relevance Purpose: generalize findings about educational interventions to other programs Can be quantitative or qualitative 30 Educator Portfolio: Key Content Teaching and Learner Assessment Curriculum Development Mentoring and Advising Educational Leadership and Administration Countable products Scholarship in all sections: Countable products 31 EP: Documentation of Scholarship Scholarly Productivity: Peer rev publications (print or electronic) Peer rev/Invited presentations and workshops Non-peer-rev publications/presentations Books Educational Products Grants: PI or Co-PI Number and $$$ Geographic impact (national > local) 32 Examples of Scholarship: Curriculum Development Peer reviewed presentations- local, regional, national Peer reviewed publications or product approved by MedEdPORTAL Evidence of impact: e.g., geographic dissemination, positive learner outcomes 33 Strategies for Enhancing Your Educational Efforts 1.Expand your educational vision beyond precepting: Boyers model 2.Conduct educational activities systematically and critically: Glassicks Six Criteria 3.Plan ways to demonstrate educational excellence: evaluations, products, models, presentations, publications 4.Participate in the community of educators (meetings, editorial reviews, workshops, presentations, publications) 34 Summary of Requirements for Educ Career Advancement Documentation of educational productivity (~quantity) Documentation of educational quality (teaching, scholarly approach) Peer review of products and reports Dissemination and adoption of educational products Evidence of national reputation (via presentations, publications, collaborations) 35 How to make educational scholarship a part of your career 1. Always ask questions, and seek answers to the best ones 2.Seek mentors/experts to help guide your scholarly work 3.Build productive collaborations : e.g., look across disciplines at your institution for people in similar roles, or look at other institutions for people in same role; take advantage of ready- made networks in professional organizations 4.Find out what others have done (read the literature, go to meetings, attend workshops,colleagues with questions) 36 How to make educational scholarship a part of your career 5.Develop scholarship around your other responsibilities multi-purpose your academic effort 6.Plan new teaching activities around current educational program structures to avoid political/scheduling challenges 7.Seek stakeholders to support your effort (look up, down and across) 8. Be the solution, not the problem find opportunities in challenges faced by your institution 37 9. Pass it forward : share your knowledge and expertise among your peer educators locally and nationally 10. Build your workand actively document itaround the 3 hallmarks of scholarship : P ublic dissemination P eer review Providing a P latform for others to build on How to make educational scholarship a part of your career