May 3, 2006WV Department of Education aadavis@access.k12.wv.us Annual Measurable Objectives for...

Preview:

Citation preview

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Annual Measurable Objectives for Improving the Achievement of LEP Students

Title III AMAOs

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

September 2003 Submission to US Department of Education

Timeline Proposed Plan Status

Mar-04 West Virginia’s ELP assessment (WESTELL) will be administered to all LEP students

  Census-field test completed

  Delayed until Summer 2005  Current status complete

Winter 2005

Original AMAO targets implemented, districts notified

  Completed

Summer 2004

Standard Setting on new assessment

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Annual Objectives

• AMAO 1 specifies annual increases in the number or percentage of students making progress in learning English as demonstrated by WESTELL.

• AMAO 2 specifies annual increases in the number or percentage of children attaining English proficiency as demonstrated by WESTELL.

• AMAO 3 specifies annual increases in the number or percentage of children making AYP as determined by the statewide assessment.

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Guiding Principles for Development

• The AMAOs must accurately measure the progress LEAs have made in increasing the proficiency of English learners

• The AMAOs should define rigorous yet achievable objectives

• Reliable and valid data should be used in the definition of the AMAOs

• The accountability system should be kept as simple as possible and be understandable to teachers, students, and parents.

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Background

• 2004 WESTELL field test administration – 569 students (grades 3-12) participated– Reports included no student ID#

• 2005 WESTELL operational administration– 734 students (grades 3-12) participated– Reports included Student ID#s – K-2 Field tested

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Data Limitations

• Limited by small number of matching scores (274 matching scores)

• Current data includes 2004 Field test data

• Does not include K-2 testing

• Does not include 3 data points

• Student records are not linked by Student ID#s (susceptible to human error)

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Prerequisite Definitions for setting AMAO 1 targets

1. Determine “cohort”

2. Define expected annual growth

3. Define English Language Proficiency

• Define starting points and

targets (AMAOs) for making progress

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Definitions and Targets

AMAO 1

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 1- Making Progress

Definition of “cohort”

Original definition was based on “length of time in program” (September 2003 Consolidated State Application)

Recommended Cohort = All LEP students, K-12, who have two years of WESTELL data

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 1 Making Progress

Definition of “expected annual progress”• Gaining one proficiency level annually for students

who were below Level 3 the prior year• Gaining one proficiency level every two years for

students who the prior year were at Level 3 (requires 3 data points)

• Maintaining the current level of proficiency for students who are at Levels 4 or 5 and have no sub-skill below Level 3

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 1- Making Progress

Definition of “proficient”

Original definition was “Level 5” (September 2003 Consolidated State Application)

Recommended Proficient = Level 4 Composite with all sub-skills at Level 3 or above

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Prerequisite Definitions for setting AMAO 1 targets

1. Determine “cohort”

2. Define expected annual growth

3. Define English Language Proficiency

• Define starting points and

targets (AMAOs) for making progress

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Table 4Distribution of Data by GradeWESTELL 2005 - 2004 Data

2005

Grade Met Goal* NI** Total % Met3 0 3 3 0.00%4 28 6 34 82.35%5 47 5 52 90.38%6 26 7 33 78.79%7 26 5 31 83.87%8 34 1 35 97.14%9 24 4 28 85.71%10 16 4 20 80.00%11 19 2 21 90.48%12 15 2 17 88.24%State Total 235 39 274 85.77%

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Table 3 - Sorted

Distribution of Data by County

ELDA 2005 - 2004 Data

2005

County Met Goal* NI** Total % Met

County A 1 1 2 50.00%County B 3 1 4 75.00%County C 12 4 16 75.00%County D 4 1 5 80.00%County E 8 2 10 80.00%County F 52 13 65 80.00%County G 26 5 31 83.87%County H 32 5 37 86.49%County I 49 6 55 89.09%County J 10 1 11 90.91%County K 1 0 1 100.00%County L 1 0 1 100.00%County M 1 0 1 100.00%County N 1 0 1 100.00%County O 2 0 2 100.00%County P 3 0 3 100.00%County Q 4 0 4 100.00%County R 4 0 4 100.00%County S 5 0 5 100.00%County T 16 0 16 100.00%State Total 235 39 274 85.77%

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 1 Targets

• Starting Point = 75%

• Ending Point =89%

• Targets = 1.7% increase per year

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 1 Targets 2006-2014

65

70

75

80

85

90

95

Pe

rce

nt

of

Stu

de

nts

Me

eti

ng

An

nu

al

Gro

wth

Ob

jec

tiv

es

Series1

Series1 75 76.7 78.4 80.1 81.8 83.5 85.2 86.9 89

2005-06

2006-07

2007-08

2008-09

2009-10

2010-11

2011-12

2012-13

2013-14

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Definitions and Targets

AMAO 2

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Prerequisite Definitions for setting AMAO 2 targets

1. Define English Language Proficiency

2. Determine “cohort”

3. Define expected annual growth

• Define starting points and

targets (AMAOs) for becoming proficient

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 2- Becoming Proficient

Definition of “proficient”

Original definition was “Level 5” (September 2003 Consolidated State Application)

Recommended Proficient = Level 4 Composite with all sub-skills at Level 3 or above

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 2 Becoming Proficient

Definition of “cohort”

LEP students who:

Have been in U.S. schools for 4 or more years

Who have two years of WESTELL data AND

Are at Level 3 or above or who did not reach English proficiency the prior year OR

Were below Level 3 the prior year who met the English proficient level the second year

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 2 Define expected annual growth

• 68 total students in cohort – 2004 were at Level 3 – 2004 were not at Levels 4 or 5– 2004 were at Levels 1 or 2 and were at Levels 4 or 5 above in 2005

• *Could not analyze by length of time in US schools (4 years minimum)

• 5 total students became proficient (2005 were at Level 4 or above)

• 7.35% of cohort became proficient• No County met the “N” size for AMAO 2 Accountability

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 2 Targets

• Starting Point = 6%

• Ending Point =10%

• Targets = .5% increase per year

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

AMAO 2 Targets 2006-2014

0

2

4

6

8

10

12

Pe

rce

nt

of

Stu

de

nts

Be

co

min

g

Pro

fic

ien

t

Series1

Series1 6 6.5 7 7.5 8 8.5 9 9.5 10

2005-06

2006-07

2007-08

2008-09

2009-10

2010-11

2011-12

2012-13

2013-14

May 3, 2006 WV Department of Education aadavis@access.k12.wv.us

Final Recommendations

• Inadequate Data

• Current AMAOs evaluated in Impact Study

• Conclusions Fall 2007

• Submitted in amendment request to WV’s Consolidated State Application (March 06)

• Pending approval from USDE

Recommended