23
Principles Underlying Evaluation Training Programs at Claremont Graduate University Tiffany Berry, PhD Research Associate Professor Associate Director, Claremont Evaluation Center June 30, 2015 1

Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

PrinciplesUnderlyingEvaluationTrainingProgramsatClaremontGraduateUniversity

Tiffany Berry, PhDResearch Associate Professor

Associate Director, Claremont Evaluation Center

June 30, 20151

Page 2: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

Pressingproblems

2

Page 3: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

HOWDOWESOLVE THESEPRESSINGPROBLEMS?

3

Page 4: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

Evaluation Training Programs

Professional Development Workshops

Certificate of Advanced Study of Evaluation

MA & PhD Programs

4

Page 5: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

#1: Professional Development Workshops

Targeted at novice and experienced 

evaluators

International audience

Diverse workshopsmethods, statistics, 

logic models, culture, eval tools

Occurs every AugustAugust 20‐24th 2015

5

Page 6: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

2015

 Presenters

6

Page 7: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

#2 Certificate of Advanced Study of Evaluation

Distance‐Based Evaluation Courses

Professional Development in Evaluation

Attendance at the American Evaluation Association Conference

Competency‐Based Exam 7

Page 8: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

#3 In Residence MA & PhD Programs

Evaluation Specific 

Coursework

Practical Experience

Content Expertise and Methodology

8

Page 9: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

AlignmenttoEssentialCompetencies

9

Professional practice

Project Management

Reflective Practice

Situational Analysis

Systematic Inquiry

Interpersonal Competencies

Page 10: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

10

Page 11: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

ContentExpertiseandMethodology

Evaluation Specific 

Coursework

Practical Experience

Content Expertise and Methodology

Co‐ConcentrationPrograms

Positive Developmental Psychology

Health Psychology

Organizational Behavior

Applied Social Psychology

Applied CognitivePsychology

Educational Evaluation

Public Policy Methodology

Research Methods

Year Long Statistics Sequence

11

Page 12: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

Evaluation‐SpecificCoursework

Foundations

Evaluation Theory

Evaluation Procedures

Evaluation Practicum

12

Page 13: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

DifferencesBetweenProgramsMA Co‐concentration Program Requirements

• 48 units• 12 Statistics/Methods• 12 Evaluation• 12 Content• 12 Electives

• Research not required

PhD Program Requirements

• 72 units• 20 units statistics/methodology

• 12 units evaluation• 32 units elective• 4 field or teaching experience

• 4 units T course

• Portfolio• Research required

13

Page 14: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

PracticalExperience

14

Page 15: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

Students and faculty collaborate on multiple projects:• Improving educational outcomes for at‐risk students• Improving STEM education• Decreasing teen pregnancy• Promoting new methods for real‐world evaluations 

15

Page 16: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

AdditionalCECInitiatives

Faster Forward Fund

AEA GEDI Program

E‐Learning Initiatives

Fellows Program 16

Page 17: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

17

Page 18: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

Whathasour

evaluationtrainingproduced?

18

Page 19: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

190 10 20 30 40 50 60 70

2004‐2005

2005‐2006

2006‐2007

2007‐2008

2008‐2009

2009‐2010

2010‐2011

2011‐2012

2012‐2013

2013‐2014

Doctorate Master's

Number of Graduates in Psychology

Graduates Ready to Confront Today’s Challenges

Page 20: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

Evaluation Scholars• LaVelle, John (3/10/2014): An Examination of Evaluation Education Programs and Evaluator Skills Across the World

• Fleischer, Dreolin (9/27/2013): Personal Factor as it Relates to Instrumental Evaluation Use

• Collins, Krista (3/7/2013): Using a Program Evaluation Framework to Identify Developmental Outcomes of Youth Empowerment

• Fierro, Leslie (10/3/2013): Clarifying the Connections: Evaluation Capacity and Intended Outcomes

• Harnar, Michael (4/24/2012): A Theory and practice‐informed model of Transformative Participatory Evaluation

20

Page 21: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

Practicing Evaluators

• Director of Strategy and Innovation, Girls and Boys Club

• Youth Development Scientist, Child Trends• Evaluation Associate, Educational Alliance at Brown University

• Assistant Director of Evaluation, Hathaway‐Sycamores

• President of Consulting Firm, KidsInsights21

Page 22: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

Lessons learned

The importance of practical experience during school

Interpersonal competencies are critical and hard to train

The difficulties, yet importance, of group work

The importance of scaffolded opportunities for project management, situational analysis, and reflective practice 22

Page 23: Principles Underlying Evaluation Training Programs at ... · Evaluation Specific Coursework ... Year Long Statistics Sequence 11. Evaluation‐Specific Coursework Foundations

[email protected]; 909.607.1540