NAEPNational Assessment of Educational Progress

Alaska

What is NAEP?

• NAEP is the only nationally representative and continuing assessment of what America’s students know and can do in various subject areas. It is the most comprehensive national measure of student’s learning outcomes at critical junctures in their school experience.

Who heads NAEP?

• NAEP is an assessment conducted by the National Center for Education Statistics (NCES) for the United States Department of Education.

• Governed by the National Assessment Governing Board (NAGB)

2003 NAEP

• The No Child Left Behind Act mandates that any state wishing to receive a Title 1 grant must include an assurance beginning in 2002-2003 the state will participate in the biennial state-level NAEP in reading and math at grades 4 and 8. – Federal government will pay for administration– The state gives permission for NCES to release results and

data– State participation in other NAEP assessments are voluntary– There will be not rewards or sanctions to states or LEAs on

state NAEP results– Participation is not a substitute for the state’s own

assessment

NAEP Provides

• State and National performance results

• National student results

• Trends in national student performance for the last 30 years

• Comparisons in student performance based on such factors as race/ethnicity, gender, public and private schools, level of parental education, prior course taking, and classroom and school conditions and practices.

Available NAEP Information

• National and State report cards on student performance

• Sample test questions, sample student answers, and scoring rubrics

• Assessment subject-area frameworks

• On-line data tool that allows users to analyze and download data from NAEP assessments

National average geography scale score results grades 4,8,12

National geography achievement level results

* Significant change

How does NAEP plan to obtain data for both subjects and grades?

• Assessing an equal sample size for each state’s public schools

• About 100 schools for each grade (4 and 8) and subject (math and reading 2003)

• About 2,500 to 3,000 assessed students for each grade and subject

• Administering background questions to students, teachers, and principals in order to examine the relationship between performance on the assessment and a variety of important demographic, instructional, and school variables

• Alaska has 289 schools selected

• 64 students will be randomly selected from each school.

• The assessment will be administered between January 27th and February 28th.

NAEP 2003

MySchool

School Registration Procedure

This document illustrates how Dr. Rosalee Smith, of the fictitious Hamilton

Elementary/Middle school registers for her school’s MySchool web site. First, she goes to the MyNAEP

login screen using the URL www.mynaep.com.

My NAEP Login Screen

Dr. Smith knows from the letter she received from her NAEP state coordinator that her User

Name is her NAEP school ID and the password is “guest”. So, she enters 2410170 (the NAEP ID printed

in her letter) in the User Name field and the password, which is displayed as a series of asterisks for

security reasons.

Hamilton Elementary/Middle555 School RdHamilton TS 99222

After clicking on the Login button, she is asked to verify her school information:

School Confirmation ScreenTo ensure that the correct ID was entered, the screen displays the school name and address matching the NAEP ID number that Dr. Smith entered. If she selects “No”, she will be taken back to the MyNAEP log in screen so she can enter the correct school ID.

If she selects “Yes”, she is taken to a screen with the registration form.

Registration FormHere, Dr. Smith enters her name, title, phone number, a password that she has created, and her email address. The user is asked to enter the email address twice to be sure that it is entered correctly. If the same email information is not

entered in the confirmation field, when the user clicks the Continue button, he/she receives this notice. Clicking on the OK button returns the user to the form so that the correct the conformation can be entered.

Dr. Smith clicks on the Continue button (with her email address entered correctly), and she is asked to confirm all of her entries in the next screen.

Confirm Information ScreenIf she notices a mistake, she can return to the registration screen to correct it by selecting “Modify your information”.

If everything is OK, she selects the Submit button and is shown her new User Name and reminded of her password.

“Registration Complete” screen.The text on this screen directs her to write down her new User Name and her password for future reference and to click on the “MyNAEP Login page” hyperlink to go to the MyNAEP login screen.

Logging In With Personal Information

After selecting the login page hyperlink, Dr. Smith enters her User Name and Password to go to her school’s MySchool site.

MySchool Step 1 ScreenThe Log Off button is available in the upper right corner of the screen at all times.

For: Alyeska Central School

You are here

Agree to Participate

Send NAEP Your List of Students

NAEP Representative Conducts the Preassessment Call with the School Coordinator

NAEP Staff Conducts the Assessment

After the Assessment

Principal agrees to participate and assigns a school coordinator to work with the NAEP staff on assessment arrangements.

Schools generate a list of students in the selected grade according to the "NAEP Instructions for Preparing Student Lists." The student list is either mailed, faxed, or sent via E-File to NAEP.

Your NAEP representative selects a sample of students to be assessed. The list of students, along with other assessment information, is sent to the school coordinator at least 2 weeks before the assessment.

The preassessment package will be sent to the school coordinator at least 2 weeks before the assessment. The NAEP representative will contact the school coordinator soon after the package has been received to do the following:

Confirm the receipt of the preassessment packet;

Review the contents of the preassessment packet and finalize assessment arrangements; and

Answer any questions the school coordinator may have about the preassessment materials on the assessment day.

The NAEP staff will bring assessment materials to your school, conduct the assessment, complete the paperwork, and pick up all questionnaires not completed online.

After the assessment, the NAEP representative will conduct a short interview with the school coordinator to get any comments about NAEP in his/her school.

At the end of the school year, you should destroy the materials in your NAEP Storage Envelope and mail the postcard to NAEP confirming that you have destroyed the sampled students' names.**** INSERT NOSCRIPT SECTION HERE!! ****

Once you register for MySchool you will be able to access everything you will need to understand the NAEP process receive technical assistance.

A typical assessment dayBefore the Assessment

• AA arrives one hour before assessment.• AC retrieves NAEP storage envelope from

school coordinator• AC assigns any accommodation booklets if

necessary• AA receives materials needed for sessions• AA prepares bundles by affixing removable

student ID labels • AA and AC prepares room and sets out

materials for session• AA checks role and advise AC and school

coordinator of missing students• AC assists school coordinator with getting

missing students to sessions

AC =Assessment Coordinator

AA =Assessment Administrator

A typical assessment dayDuring the session

• AA follows the script to distribute materials

• AA monitors session, using classroom management strategies

• AA follows guidelines for assessing SD and LEP

• AA collects materials accounting for all of them

• AA dismisses students according to school’s preference

• AC monitors the sessions and assists AA with any problems

AA = Assessment Administrator

AC = Assessment Coordinator

A typical assessment day Activities after the assessment

• NAEP staff determine reasons for absences

• NAEP staff record Administration codes on schedule

• NAEP staff completes summary information on schedule

• NAEP staff prepares materials to be left at school

• AC collects questionnaires from school coordinator

• AC schedules makeup session if necessary

• AC conducts debriefing interview

AA =Assessment Administrator

AC =Assessment Coordinator

Background QuestionnairesStudent, Teacher, Principal

Teachers• Years of teaching• Type of certificate• Undergraduate and

Graduate work• Professional

Development• Classroom Organization

Students• Ethnic background• Newspaper at home• Magazines at home• Books at home• Computer at home• Pages read a day• Watching TV• Days absent• Parent’s education level

Questions Tool

Type of Question

Relate a Fraction to 1

Identify Instruments of Measurement

Write an Expression Using N

Use Data from a Pictograph

Choose Number Sentence

Count Cubes in Solid

“Solve Word Problem Involving Division & Remainder”

Relate Perimeter to Side Length

Determine a Probability

Compare Two Geometric Shapes

Compare Geometric Shapes

“USING AN INQUIRY OF MATHEMATICS IN THE FOURTH GRADE”

7. 

Ms. Hernandez formed teams of 8 students each from the 34 students in her class. She formed as many teams as possible, and the students left over were substitutes. How many students were substitutes? 

  Answer:____________________ 

 Question 

Performance Data

 Content Classification

 Scoring Guide/Key

 Student Responses

 More Data

 

 Description:Solve Word Problem Involving Division & Remainder

Question 7 of 117

Subject: MathGrade: 4

Block: 1996-4M9

No.: 07

1996 National Performance Results

Note: •These results are for public and nonpublic school students. •Percentage may not add to 100 due to rounding.

Score Percentage of Students

Correct

Incorrect

Omitted Item

Off Task

                                                         

    39%

    53%

    8%

    0%

Subject: Math

Grade: 4

No.: 07

 Mathematical Content Area

Number sense, properties, and operations

This question measures number sense, properties, and operations. This content area focuses on students' understanding of numbers (whole numbers, fractions, decimals, integers, real numbers, and complex numbers), operations, estimation, and applications to real-world situations. Students are expected to demonstrate an understanding of numerical relationships as expressed in ratios, proportions, and percents. Students are also expected to understand properties of numbers and operations, generalize from numerical patterns, and verify results. Number sense includes questions that address a student's understanding of relative size, equivalent forms of numbers, and use of numbers to represent attributes of real-world objects and quantities.

This question also focuses on the subtopic of using computation and estimation in applications.

 Mathematical Ability

Problem solving

This question measures students' problem solving ability. Students demonstrate problem solving in mathematics when they recognize and formulate problems; determine the consistency of data; use strategies, data, models; generate, extend, and modify procedures; use reasoning in new settings; and judge the reasonableness and correctness of solutions. Problem solving situations require students to connect all of their mathematical knowledge of concepts, procedures, reasoning, and communication skills to solve problems.

NAEP Data Tool

• SUBJECT Math• GRADE 4th• STATE/JURISDICTION Alaska• CATEGORY

– MAJOR REPORTING GROUPS– STUDENT FACTORS– FACTORS BEYOND SCHOOL– INSTRUCTIONAL CONTENT AND PRACTICE– TEACHER FACTORS– SCHOOL FACTORS– COMMUNITY FACTORS– GOVERNMENT FACTORS

Student Factors

All can do well in math if they try

Below, at, or above age of most students in grade

Days of school missed

Difficulty of this math test

Effort on this math test

Gender

Good at math

Hispanic background

Importance of success on this math test

Language other than English spoken in home

Length of time lived in United States

Like math

Math is mostly memorization

Math is useful for everyday problems

Number of grades attended in this state

Only one correct way to solve math problems

Questions correct on this math test

Race/ethnicity used for NAEP reporting

Alaska/Mathematics Composite/Accommodations Not Permitted/Grade 4/1996How much do you agree with the statement? Everyone can do well in mathematics if they try. (student-reported) [M811110]Average Scale Score and Row Percentage (with Standard Errors in Parentheses)

OVERALL

    Agree Undecided Disagree

 N

Avg. Score ( S.E. )

RowPct. ( S.E. )

Avg. Score ( S.E. )

RowPct. ( S.E. )

Avg. Score ( S.E. )

RowPct. ( S.E. )

Total   2181   226 (  1.2)   87% (  1.0)   225 (  3.9)   9% (  0.8)   209 (  7.9)   4% (  0.5)

NAEP Data Tools

Alaska 1996

NAEP Reading Framework

Reading Framework

To Gain Information To Perform a Task For Literacy

To enlarge on experienceOf Human Events

AdventureScience Fiction

Folktales

Applying information orDirection to complete task

Classified AdsDirections to complete

Tax Forms

Focus on specific information

Primary and Secondary articlesSections of textbook chapters

Essays and speeches

Math Framework

Number Sense,Properties, and

Operations

Measurement

Geometry andSpatial Sense

Data Analysis,Statistics, and

Probability

AlgebraAnd

Functions

State Department WebsiteNATIONAL ASSSESSMENT   OF EDUCATIONAL PROGRESS (NAEP)

• Data Collection Forms •Instructions for Preparing a List of 4th Grade Students    •Instructions for Preparing a List of 8th Grade Students    •School Data Collection Form   

• Resources •NAEP Homepage •NCES Homepage •Question Tools for Teachers •School Responsibilities for NAEP •NAEP State Assessment Information

• Especially for Parents •Parent Notification Letter    •Parent Notification Letter (Spanish)    •Parent Information for School Newsletter   

• Especially for Principals •Letter to Principals   

• Personnel/Questions

Websites that will help explain NAEP

NAEP Homepage

• http://nces.ed.gov/nationsreportcard/Kids Quiz page w/NAEP questions

• http://nces.ed.gov.nceskids/kidsquiz/index.asp?flash=trueNCES Homepage

• http://nces.ed.gov/nationsreportcard/sitemap.asp Questions tool for Teachers

• http://nces.ed.gov/nationsreportcard/itmlrs/NAEP State assessment information

• http://nces.ed.gov/nationsreportcard/about/state.asp

School responsibilities for NAEP

• http://nces.ed.gov/nationsreportcard/about/stateactivities.asp

  National Assessment of Educational Progress (NAEP)

Form NumberForm Name Date Due

05-03-020

Instructions for Preparing a List of 8th Grade Students     

05-03-021

Instructions for Preparing a List of 4th Grade Students     

Nov. 15

05-03-022

School Data Collection Form     

Nov. 15

Nov. 15

State Department Assessment Website “Forms and Grants”