A L

D4

A L

L

Program EvaluationIn addition to the school and district data the team routinely collected throughout the year, we also collected some project-wide…• Implementation,• continuous improvement, and • evidence of effectiveness… data along the way.

1

A L

D4

A L

L

Program Evaluation• Implementation: The project was successfully

implemented because it did more than it said it would do.

• Continuous Improvement: The project continuously evolved and adapted to take advantage of new knowledge and opportunities.

• Evidence of Effectiveness: The project demonstrated its value by the lasting changes it spearheaded and/or helped to bring about.

2

A L

D4

A L

L

9

Program EvaluationSystem-wide Indicator Assessment Results from Inquiry Process

• School-by-School to get a sense of how good schools distribute effort, focus, and resources

• Process included open-coding and axial sorting techniques

A L

D4

A L

L

9

Program Evaluation

Program-wide indicator assessment of all included schools

System-wide Indicator Assessment Results from Inquiry Process

Professional Learning Content1. Content was relevant…2. The content was organized and meaningful…3. Content will be helpful to me in my role as an educator of diverse

students…4. The content will help me to improve how I teach or work with diverse

students and families…5. I will be able use the content to raise the my level of activity,

advocacy, understanding, or quality of performance in the service of diverse students.

Professional Learning Process6. Facilitator(s) used engaging activities, strategies, or methods...7. Facilitator(s) ensured that I was a participant in the process…8. Good use of materials, visuals, and/or artifacts….

A L

D4

A L

L

9

Program Evaluation

A L

D4

A L

L

9

Program Evaluation

Q1 Q2 Q3 Q4 Q5 Q6 Q7 Q80

1

2

3

4

5

6

7

8

9

10

Professional Learning feedback results for 2014 – 2016

Note. N=144. Started gathering data using feedback forms in 2014. Generally highly positive feedback rate, but what else does it mean?

Teacher Self-Assessment Scales (TSAS)• Online and paper

questionnaire• Based on NMTEACH

(four domains) and Teacher Efficacy

• Schools receive a personalized report

• Provides results based on highs and lows for each element

A L

D4

A L

L

9

Program Evaluation

TSAS program-wide results for 2014 - 2016

A L

D4

A L

L

9

Program Evaluation

TSAS program-wide results for 2014 - 2016

A L

D4

A L

L

9

Program Evaluation

Fall 2014 Spring 2015 Fall 2015 Spring 201670

75

80

85

90

95

ALD4ALL schools versus non-ALD4ALL TSAS dataset

TSAS program-wide results for 2014 - 2016

A L

D4

A L

L

9

Program Evaluation

1A. 1B. 1C. 1D. 1E. 1F.80

82

84

86

88

90

92

Example of trend lines using Domain 1

TSAS program-wide results for 2014 - 2016

A L

D4

A L

L

9

Program Evaluation

Example of trend lines combining Spring and Fall 2015, using Domain 3 as an example.

3A. 3B. 3C. 3D. 3E.70

75

80

85

90

95

TSAS program-wide PD-Related TSAS results for 2014 - 2016

A L

D4

A L

L

9

Program Evaluation

Teacher Efficacy differences by participation inALD4ALL Professional Learning activities.

1 2 3 4 5 674

76

78

80

82

84

86

88

90

TSAS program-wide results for 2014 - 2016

A L

D4

A L

L

9

Program Evaluation

Just another view: Teacher Efficacy differences by participation in ALD4ALL Professional Learning activities.

1 2 3 4 5 674

76

78

80

82

84

86

88

90

30

ALD4ALL.org Website