20

Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

  • Upload
    others

  • View
    5

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses
Page 2: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Lo isiana’s Val e AddedLouisiana’s Value Added Assessment Initiative

• George Noell, PhD, BCBAGeorge Noell, PhD, BCBA

Page 3: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

What does value added assessment look like in education?

Use achievement history and key factors toUse achievement history and key factors to predict each student’s achievement

Assess actual academic achievement

Compare actual achievement to 

predicted achievement

3

Provide the information to responsible educators and leadership

Page 4: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

What score would you expect for this youngster this year?y g y

400

Two Student's Test Data

350

400

300

350

cores

250

Sc

200

3rd 4th 5th 6th3rd 4th 5th 6th

Grade

Page 5: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

The pattern should come from the trajectory

Two Student's Data

350

400

300

Scores

250

S

200

3rd 4th 5th 6th ‐predictedpredicted

Grade

Page 6: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Which student made more progress in 6th grade?

Two Student's Data

350

400

300

350

Scores

200

250

S

200

3rd 4th 5th 6th ‐predicted

6th actualpredicted

Grade

Page 7: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

So what does this look like for a class?

350

Part of one class' outcomes350

300

t Scores

Test

250

Predicted ActualPredicted Actual

Test Outcomes

Page 8: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Stages in the VAA Process

1 Check with teachers to make sure rosters are1. Check with teachers to make sure rosters are correct

2. Compare how students did on state d h i jassessments compared to their trajectory

3. Share results with teachers, principals, and superintendentsp

Page 9: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

CVR:  Verifying Rosters

Page 10: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Which students does Louisiana’s VAA include?

Students are included in the  Students are excluded from the assessment if……

Prior achievement data are available

assessment if……

NO Prior achievement data is available Prior achievement data are available

Attended school for a full year Moved during the school year

Take the regular state assessment

Enrolled in 4‐9 grade levels

Take an alternative state assessment

Enrolled in K‐3 or 10‐12 grade levels

If their teacher agrees that theytaught that student

10

Page 11: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

What information is used to predict achievement?achievement?

Variables that went into the model:

Prior achievement on state assessments (ELA, reading, mathematics, science, social studies)

Gifted Status

Section 504 Status

Free Lunch Status

Note:  VAA is based on a mathematical model that determines how much each factor contributes to estimating expected student achievement By far Free Lunch Status 

Reduced Lunch Status

Student attendance

estimating expected student achievement. By far the strongest predictor is prior achievement.

Disability status   (emotionally disturbed, speech and language, mild mental retardation, specific learning disability, other health impaired, other)

Discipline Record (count of suspensions and/or expulsions) Discipline Record (count of suspensions and/or expulsions)

Page 12: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

An Illustration of Value Added Assessment

T h St d t A hi t O tActual 

Teacher‐Student Achievement Outcome Achievement

315

Mathematics 300 M th ti

Predicted Outcome Above AverageOutcome

Prior Year Scores

Mathematics   300ELA                     285Science              305Social Studies   310

Mathematics

300Average

Outcome300

Below AverageOutcome

This is an example of outcomes for a student, not actual data.

285

Page 13: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

How and to whom are results reported?

TeachersTeachers

On CVR Only his/her results

Principals

On CVR All teachers in school

Superintendents

On CVR All schools/teachers in districtOn CVR All schools/teachers in district

Page 14: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

CVR users can view results by subgroups

Achievement GGroups

Overall Results

Students with Disabilities

Free/Reduced Paid Lunch Status Results

Limited English 

Proficient

*Each category will be broken downEach category will be broken down by content (ELA, reading, mathematics, science, social studies)

Page 15: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Sample Teacher Results Report

Page 16: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Sample Teacher Results Report

Page 17: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Sample Teacher Results Report

Page 18: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Sample Teacher Results ReportPrincipal’s View of All Teachers

Page 19: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Value Added Assessment:Uses and limitationsUses and limitations

Strengths Limitationsg

• Can be used to identify strengths and weaknesses 

• We will only know about the grades and subjects we 

based on student outcomes

assess

• In the beginning data will• Can be used to organize resources to improve outcomes

In the beginning, data will be limited to global measures

outcomes

• Can guide the use of resources to strengthen

• The data may suggest areas of concern, but not why we are strugglingresources to strengthen 

areas of concern (PD)why we are struggling there

Page 20: Lo isiana’s Val e AddedLouisiana’s Value Added Assessment ... · Value Added Assessment: Uses and limitations Strengths Limitations •Can be used to identify strengths and weaknesses

Timeline for Deploying Value Added Assessment up to 2012 2013

• 2009 2010 (2008 2009 data)

Value Added Assessment up to 2012‐2013

Current 24 Pilot Schools

• 2009‐2010 (2008‐2009 data)• Develop tools & gather stakeholder input

• 2010‐2011 (2009‐2010 data)• Develop communication & PD tools

20 DistrictsDevelop communication & PD tools

• Gather feedback and revise our tools

Statewide

• 2011‐2012 (2010‐2011 data)• Statewide deployment:  communication focus• Gather feedback and revise our tools• Gather feedback and revise our tools