May 16, 2007May 16, 2007

New Jersey New Jersey Alternate Proficiency AssessmentAlternate Proficiency Assessment

2

Main Topics

• History of APA process• Description of current APA• Positives and Concerns• Future Direction

3

IDEA Legislation

• IDEA 97 requirement to include all students with disabilities in statewide and local assessments

• Publicly report progress of students with disabilities• Most participate in general assessment with or without

accommodations• Law allowed for alternate assessment for student with the most

severe cognitive disabilities.

4

NCLB Legislation

• NCLB required the performance of students with disabilities to be included in the accountability system for schools and districts. A change in New Jersey.

• NCLB required students to be assessed in relation to the state standards

• NCLB allowed for a small percentage of students to be accountable under alternate achievement standards. (1% of total tested population)

5

Who are the APA Students?

•Is the nature of the student’s cognitive disability severe?

•Is the student’s cognitive disability so severe that the student is not receiving instruction in any of the knowledge and skills measured by the general statewide assessment?

•Is the student’s cognitive disability so severe that the student cannot complete any of the types of questions on the assessment in the content area, even with accommodations and modifications?

•Is the student’s Individualized Education Program (IEP) aligned to grade level New Jersey Core Curriculum Content Standards through modified expectations and/or access skills that promote social interaction, independence, self-determination, and generalization.

6

• Tim is a 9 year old student with significant disabilities.

• He uses a walker and an augmentative communication device for expressive communication but often needs reminders to do so.

• He needs picture symbols to supplement verbal information.

Student Vignette: TIM

7

• He can repeat single words verbally.

• He is supposed to wear glasses, but generally will not leave them on without frequent reminders and supervision.

Student Vignette: TIM (cont.)

8

• Vicki is a 14 year old student with significant disabilities.

• She uses a wheelchair and smiles to indicate “yes” and rounds her mouth to indicate “no.”

• Sometimes it takes several seconds for her to give a “yes/no” response.

• While Vicki has very limited use of her arms and legs, she can activate a pressure switch with her cheek by turning her head slightly to the left.

Student Vignette: VICKI

9

• Since Vicki’s eyesight is somewhat impaired, objects/photos/symbols must be held approximately 12 inches in front of her.

Student Vignette: VICKI (cont.)

10

Historical Perspective• Alternate assessment had to be aligned to state standards but

the achievement standards could be modified• NJ organized advisory group to develop the goals and

framework of the assessment• Goals of assessment (same as for all students)

• Evaluate student achievement relative to the state standards• Allow for inclusion in the accountability system• Inform and improve instruction by teaching to the standards even if

mastery is not near grade level• Evaluate programs

11

Initial Test Design Determinations

• Determinations of the advisory group:• Paper and pencil test inappropriate• Portfolio assessment appropriate• Each one individualized to assess progress at level of

instruction• Individual selection of the standards and indicators to be

assessed• The assessment would be a collection of the work being

done in the classroom not a one day test (unreliable)

12

Initial Test Design Determinations (cont.)

• Critical issues for instruction of students with severe cognitive disabilities (from teachers, administrators, etc.)

• Generalization of skills• Level of support - independence• Socialization• Self determination

• Could not evaluate programs solely on academic progress of students with severe cognitive disabilities –need to look at other critical dimensions in relation to the standards

• Therefore scores based on progress and the other dimensions

13

What Grades Are Assessed?

• Students in grades 3 - 8 and 11 are assessed.• APA in grades 4, 8, and 11 contain language

arts literacy, mathematics, and science.• APA in grades 3, 5, 6, and 7 contain language

arts literacy and mathematics.

14

How Many Skills are Assessed?

• In language arts literacy two skills are assessed.• In mathematics two skills are assessed.• In science three skills are assessed.

15

How are the Skills Selected?

• The child’s teacher in conjunction with the IEP team selects the skills they want to assess.

• As per federal and state guidelines, the skills must be academic in nature, and linked to the NJ Core Curriculum Content Standards.

• Teacher selects content standard, cumulative progress indicator, and skill on which to assess the student.

16

Who Decides How Well the Child Should Perform the Skill?

• The teacher and the IEP team determine what the progress goal is for the student.

• The teacher reviews how well the student is doing on the skill in October and determines how well the student should do in February.

APA

What does a portfolio entry look like?

17

18

Test Design for LAL and Math

• Select two skills per subject• For each skill, collect 4 pieces of evidence which

includes 3 different activities.• Collected over a four month time frame.• Collect data on performance of skill, settings,

supports, social interactions, connection to standards, and self-evaluation.

Mathematics EntrySample

Michael

Entry Cover Sheet

1Student Work Sample – Evidence Label

1aStudent Work Sample

2Self-Check Sheet

3Peer Note

1/5/05

Michael and I followed the pancake recipe that Michael doubled by adding fractions in Home Ec. class to make pancakes for the class.

Susan

Peer

4

Student Work Sample – Evidence Label

4aStudent Work Sample

5Student Work Sample – Evidence Label

5aStudent Work Sample

Mike completed this homework on his own. He did not need help from his dad or I.

Mrs. H 2-17-05

Date Oct. 24,’05 Nov. 22, ‘05 Jan. 5, ‘06 Feb. 17, ‘06

Progress 45% with 1 verbal prompt

65 % independent

100 %

independent

100 %

independent

Setting Special Education

Class

Special Education

Class

Home Economics

Class

Home

Activity Addition of fractions using manipulatives

Addition of fractions on computer

Addition of fractions using recipe

Addition of fractions worksheet

Name: Mike H. Datasheet for Addition of Fractions

Targeted skill: Add fractions with like denominators

6

Language Arts LiteracySample

Eddie

Entry Cover Sheet

Performance Data

Student Work Sample – Evidence Label

2

Student Work Sample 2a

Planning, Monitoring, and Self-Evaluation Name:________________________ Date:___________________ PLANNING: MONITORING: Today while reading, I need to work on: I worked on these: (Circle the items you are going to work on today) Looking at pictures to help me understand YES NO Looking at all of the letters before saying word YES NO Making the sound that goes with each letter YES NO EVALUATION: Overall, I think I did a ____________________ job reading today.

GREAT GOOD O.K. NOT SO GOOD

Next time, I need to work harder on: Looking at pictures to help me understand

Looking at all the letters before saying the word

Making the sound that goes with each letter

12/8/04

EXTENDING PERFORMANCE:

Planning, Monitoring, and Evaluation Sheet 3

Student Work Sample 4

Eddie worked with a peer in the third grade regular education class to complete this assignment. The peer read the directions and helped Eddie read the sentences. Eddie cut out, matched and pasted pictures to the correct sentences.

New Jersey Alternate Proficiency Assessment – Evidence Documentation

Student’s Name: Eddie Date: 2/5/05

Standard #: 3.3 3.3.8A2 Page #: 5a Description of Activity: Eddie goes to general education 3class to study Healthy Lifestyles. Students had to

answer questions on factors that contribute to a healthy life. Eddie answered questions related to behavioral factors by reading his vocabulary words and adding the factors to his chart.

Setting: General Education Class (3rd grade)

Supports: picture symbols

Social Interaction: General Education 3rd grade peers who also worked on charting factors that contribute to a healthy lifestyle.

5Student Work Sample – Evidence Label

5aStudent Work Sample

Eddie completed this in my 3rd grade class.

Mr. P.

(General Education Teacher)

exerciseexercise eat fruiteat fruit

drink milkdrink milk

Do not swim Do not swim alone.alone.

39Student Work Sample – Evidence Label

6

Student Work Sample 6a

41

APA Scoring Rubric

• Six Scoring Dimensions

• Student Progress

• Connection to Standards

• Social Interaction

• Independence

• Self-Determination

• Generalization

42

Score Reports• Reports include information defining a student’s progress

level and program level for each content area assessed.• Proficiency level is a result of the combination of the

student progress level and program level for the subject.• Proficiency levels are parallel with other state assessments

and APA results will be combined with the other state assessment results for federal and state reporting.

43

Positives

• We are meeting the federal requirement to include all students in assessment system

• Teachers are looking at the standards and some say they are teaching material they never would have before

• Some are stressing the critical issues of socialization, independence and generalization

• Parents expressed satisfaction with having some assessment of the instruction of their children and concrete examples of progress

44

Concerns• USDE has determined that the APA is not sufficiently focused on

academic proficiency in language arts and math. They are requiring that we eliminate scoring based on the areas of self-determination, socialization, etc.

• Many concerns raised by the field• Takes too long - costs too much• In some schools it is a staged occurrence not related to actual instruction• Teachers cannot relate what they are doing to the standards• Do not see the assessment as relative to the kinds of instruction they are

providing• Belief that functional life skills should be taught and directly assessed.

USED specifically does not allow that for purpose of NCLB.

45

Future Actions

• The DOE will work with advisory committee to revise the assessment for the 2007 - 2008 administration to:

• Meet the federal requirements• Address concerns of the field