Assessment Services, SDUSD 2013 STAR Nuts & Bolts Grades 2-8 Traditional Calendar

Assessment Services, SDUSDAssessment Services, SDUSD

2013 STAR Nuts & Bolts

Grades 2-8

2013 STAR Nuts & Bolts

Grades 2-8

Traditional Calendar

Traditional Calendar

2

AgendaAgendaNew for 2013New for 2013

Test Security Test Security

Before TestingBefore Testing

During TestingDuring Testing

After TestingAfter Testing

3

What’s New for 2013?What’s New for 2013?

• Emphasis on heightened securityheightened security

–New security affidavit

–No unauthorized electronic devices

• New and updated videosvideos at http://www.startest.org/training/index.html

• Quick return of resultsresults (2-3 weeks after receipt of scorables)

4

What’s New for 2013?What’s New for 2013?

• Answer Document Answer Document Changes: – No CBEDS (section 14),

collected in CALPADS– No ASAM– No SEID (statewide educator ID)– English-learner program

participation (section 17) definitions changes

– CAPA Section A1 added

Assessment Services, SDUSD 5

SecuritySecurity• Security Audits

• Security Agreements

• Security Affidavits

• All materials must be kept in a LOCKED, SECURE area

In RED Envelope

BLM

NEW

Assessment Services, SDUSD 6

SecuritySecurity

BLM

7

• At randomly selected schools and district offices • Auditors will check that materials are securesecure, accounted for, and locked up in a centralcentral location when not in use• Auditors will check that correct administrative procedures are being followed

•Instructional materials have been removed or covered.•Students are not being coached through the exams.•Only appropriate accommodations and/or modifications are being provided.•No unauthorized electronic devices are being used.

Security AuditsSecurity Audits

8

Security Audits ContinuedSecurity Audits Continued

• Possible visit from ETS/Global Compliance Service – BeforeBefore testing (pages 62-6362-63 in manual)

– DuringDuring testing (pages 63-6463-64 in manual)

– AfterAfter testing (pages 64-6964-69 in manual)

– Ask for “official” letter from the representative when he/she comes to your school

9

Before TestingBefore TestingIdentifying Students to Test?Identifying Students to Test?

Accommodations & ModificationsAccommodations & Modifications

Receiving & Ordering MaterialsReceiving & Ordering Materials

Preparing Materials & LocationsPreparing Materials & Locations

Providing Training for StaffProviding Training for Staff

10

Who should participate in the STAR Program?

Who should participate in the STAR Program?

ALLALL students in grades 2-11 except those exempt by parent or guardian

Parent Exemption Request form in BLM

Students participate in STAR by taking either the CSTs, CMA, or CAPA

11

2013 STAR: Identifying Students2013 STAR: Identifying Students

• California Standards Tests (CSTs) = grades 2-11; most students take CSTs

• California Modified Assessment (CMA)= grades 3-11; must meet SBE eligibility criteria; must be in IEP

• California Alternate Performance Assessment (CAPA) = grades 2-11; students with severe cognitive disabilities; must be in IEP

STAR Item & Estimated Time Charts, pages 105-110 in manual

Page 74 in manual for CMA criteria

See CMA & CAPA rosters

12

Identifying Tests for Non-CAPA Students: Required CST and CMA Tests at Each

Grade

Identifying Tests for Non-CAPA Students: Required CST and CMA Tests at Each

GradeGrade 2 Grade 3 Grade 4 Grade 5

Grade Level ELA

CST CST or CMA CST or CMA CST or CMA

Grade Level Math

CST CST or CMA CST or CMA CST or CMA

Grade Level Science

CST or CMA

See Handout


13

Required Tests for CST/CMARequired Tests for CST/CMATests (non-CAPA students)Tests (non-CAPA students)Required Tests for CST/CMARequired Tests for CST/CMATests (non-CAPA students)Tests (non-CAPA students)

Grade 6 Grade 7 Grade 8

Grade Level ELA

CST or CMA CST or CMA CST or CMA

Grade Level Math

CST or CMA CST or CMA(not enrolled in

Algebra)

Grade Level Science

CST or CMA

Grade Level History-SS

CST

Content-Specific Math

Algebra I CSTor

Algebra I CMA

CST (Gen Math, Alg I, Geom, etc)

orAlgebra I CMAGeometry CMA

See Handout


14

Identifying Students for the Standards-based Tests in Spanish (STS)

Identifying Students for the Standards-based Tests in Spanish (STS)

Eligibility Criteria1. Spanish-speaking EL

students enrolled less than 12 months in a US school

2. Spanish-speaking EL students receiving instruction in Spanish regardless of months enrolled

see rosters and directions

– Reading & Lang. Arts (Grades 2-11)

– Grade Level Math (Grades 2-7)

– Algebra 1 STS (Grades 7-11)

– Geometry STS (Grades 8-11)

Eligible students take the STS in addition to the

CST and/or CMA(CAPA students do NOT take STS)

15

Special Education, 504 Students, and English LearnersSpecial Education, 504 Students, and English Learners

1. Identify CAPA & CMA test-takers

2. Review IEP and 504 Plans for accommodations & modifications that must be made available to students

3. Plan for any variations that EL students will use during testing

4. Identify English Learners who must take the STS

16

Accommodation vs. ModificationAccommodation vs. Modification• AccommodationsAccommodations

– Change conditions for testing, but do not change what is being measured

– Count as-is; have no impact on API & AYP

• ModificationsModifications

– Change testing conditions and what is being measured

– Reported “as is” on the Student Report

– Count as far below basic (200) for API

– Do not count as proficient or as a participant for AYP

17

Modifications are NOT ALLOWED on the CMA

Modifications are NOT ALLOWED on the CMA

See Attachment D of Administrative

Circular # 59

Modifications are only allowed on CST & STS (if in 504 or IEP)

Page 86 in manual

See Handout

18

Receiving MaterialsReceiving Materials

SECURE ALL

MATERIALS

SECURE ALL

MATERIALS

ORDER ADDITIONAL MATERIALS

ORDER ADDITIONAL MATERIALS

INVENTORY UPONRECEIPT

INVENTORY UPONRECEIPT

Verify Quantity

Note missing materials; contact

Denise ASAP if there are

discrepancies

Fax FormReseal Boxes

Store in a SECURE,

LOCKED areaBLM

SAVE BOXES

Count each booklet; packs of 20 don’t always contain 20

19

Identifying and Training StaffIdentifying and Training Staff

• CST ExaminerCST Examiner = employee of SDUSD who has been trained and has signed a STAR Security Affidavit

• CMA ExaminerCMA Examiner = employee of SDUSD who has been trained and has signed a STAR Security Affidavit

• CAPA ExaminerCAPA Examiner = certificated employee of SDUSD who has received CAPA examiner training and has signed a STAR Security Affidavit

• STS ExaminerSTS Examiner = employee of SDUSD who has been trained, has signed a STAR Security Affidavit, and is bilingual in English and Spanish

• ProctorProctor = employee of SDUSD who has been trained and has signed a STAR Security Affidavit.

See page 10 in manual

20

Required Training for StaffRequired Training for Staff• Ensure Consistency

Directions For Administration (DFA) must be read verbatim

• Ensure Test SecurityMonitor students; actively superviseCollect test booklets and answer

documents before dismissing studentsEnsure there is enough time to

complete a part before beginning the part

Do not send unsupervised student(s) with test materials to alternate location

Report all irregularities/incidents ASAP

See Handout

Examiner Training

PowerPoint on Website

21

Required Training for StaffRequired Training for Staff• Test Examiners CANNOTCANNOT:

Review test questions before, during, or after testing

Leave instructional materials up in the classroom

Check students’ answers Advise students of a wrong answer

or advise student to check an answer

Withhold answer docs until students demonstrate they have the right answers

Divulge the contents of the test(s) to anyone

Ensure that all examiners READ & UNDERSTAND the AFFIDAVIT

22

Required Training for StaffRequired Training for Staff

Examiners MUST monitormonitor students throughout testing to make sure students are:

– On correct part – Not going on to other parts or back to a

previously completed part– Not skipping a question on their answer

document (so that they are off by one or more)

– Not using unauthorized electronic devices during testing session

23

Prepare Testing LocationsPrepare Testing Locations• Create an ideal testing environment- free from

noise with good lighting & ventilation

• Remove or cover all instructional materials visible to students related to the content of the test

• Make arrangements for students w/IEPs & 504s (i.e. read aloud)

• Prepare a separate room(s) for CMA test-takers

• Set up a quiet room where students who need more time to test can be escorted by an adult

• Arrange an activity and separate room for students not tested (exempt by parent)

24

Preparing & Distributing MaterialsPreparing & Distributing Materials• Materials provided by school:

– No. 2 pencils with erasers– “Testing- Do Not Disturb” signs– Scratch paper for math & science tests– Highlighters may be used (caution to grades 2 & 3)

• Make arrangements for students w/IEPs & 504s (i.e. Braille version, large-print, calculator, same version test for students with ”read aloud”, etc.)

Page 6

5 in

man

ual

• Check materials out and in DAILYDAILY– see Inventory Control form; excel version on our website at http://www.sandi.net/page/1545

BLM

BLM

25

During TestingDuring Testing

Directions For AdministrationDirections For Administration

Required Fields on Answer Docs.Required Fields on Answer Docs.

Managing Emergency SituationsManaging Emergency Situations

Test Booklet VersionsTest Booklet Versions

26

CST, CMA, & STS Test Booklets- Multiple VersionsCST, CMA, & STS Test Booklets- Multiple Versions

• Each grade level has multiple versions of the test

• Schools will receive only one version at grade 2

• Schools will receive multiple versions for grades 3-11

• For students who are eligible for the “read aloud” accommodation/modification, make sure you test with the same version when administering to a small group

Students MUST hand-grid the version number used on the answer document

Students MUST receive the same test version for the entire duration of the test

CRITICAL

27

Directions For Administration (DFA)Directions For Administration (DFA)

• Grade 2 CST DFA is SECURE and cannot be distributed to teachers BEFORE testing; the nonsecure version may be used for training

• Additional DFAs may be downloaded at:

• “SAY” boxes must be read exactly as written• “T” in “SAY” boxes indicates that everything in the box

may be orally translated for EL students if regularly done in the classroom; can translate “SAY” boxes only and may not assist students with test questions

http://www.startest.org/dfa.html

28

Managing Emergency Situations Managing Emergency Situations and Testing Incidentsand Testing Incidents

Managing Emergency Situations Managing Emergency Situations and Testing Incidentsand Testing Incidents

Test administration incidentTest administration incident = any situation that occurs before, during, or after testing that does not conform to the instructions stated in the DFA or the coordinator’s manual

• Disruption in testing (fire alarm, power outage, evacuation)

• Test administration error (randomly distributing Pre-ID’d answer documents)

• Student cheating (mark A2, Special Conditions) Complete a Test Administration Incident Report form Make copy of report form for your files; send original

in REDRED envelope to Assessment Services

BLM

Pages 64 and 81 in manual

See Handout

29

Testing IrregularitiesTesting IrregularitiesTesting IrregularitiesTesting Irregularities

Testing irregularities Testing irregularities = circumstances that may compromise the reliability and validity of test results; could negatively impact API and AYP

• Coaching students, leaving instructional material up during testing, allowing students to use additional materials not specified in the IEP/504, etc.

• Inappropriate test preparation• Breach in security (i.e. copying tests)Contact Erin Gordon ASAP

Pages 79-80 in manual

See Handout

30

Answer DocumentsAnswer Documents Answer DocumentsAnswer Documents

• Pre-ID answer documents Pre-ID answer documents = for students enrolled before 2/05/132/05/13; will be included in your will be included in your initial shipment initial shipment

• Pre-ID labels Pre-ID labels = for students enrolled between 2/05/132/05/13 and 3/28/133/28/13; pick up from Annex 10 after they arrive in the district (week of 4/15/134/15/13)

• Hand-gridHand-grid blank answer documents blank answer documents = students enrolled after 3/28/133/28/13 until the first day of testingfirst day of testing; demo guides will be provided for students enrolled between 4/08/134/08/13 and 4/12/134/12/13

31

Answer DocumentsAnswer Documents ContinuedAnswer DocumentsAnswer Documents Continued• There are separateseparate answer booklets/documents

for CMA and CST at grades 3 and grades 8-11• If there have been changeschanges since the pre-id file

submission, a blank answer document must be hand-gridhand-grid

• There are minimal fieldsfields requiredrequired to match CMA and CST for students (grades 3 & 8-11) with one Pre-ID’d answer document who will be taking both a CST and CMA:

1. Name (last, first, and middle initial)2. Birth date3. Gender4. Statewide Student Identifier (SSID)

32

CST/CMA Answer Docs

- FRONT

CST/CMA Answer Docs

- FRONT

= Must Be Completed by HAND

= Included in Pre-ID

Students must use the correct answer document; check barcode label

Sample answer document on page 123 in manual

= Hand-grid ONLY if applicable

Bar

cod

e L

abel

ID

33

CST/CMA Answer Documents- FRONTCST/CMA Answer Documents- FRONT

Box 7c = hand-grid for students taking the CMA

= Must Be Completed by HAND

Box 1 = completed by the student


34

CST/CMA Answer Documents INSIDECST/CMA Answer Documents INSIDE

CMACST

CMA section has:

1. Different subject icons from CST

2. Alternate row shading for the response bubbles

3. Three answer choices

4. Fewer number of questions

Grades 4-7 = one answer document containing both CST and CMA

35

CST/CMA Answer Docs- INSIDECST/CMA Answer Docs- INSIDEFor Grade 7 Grade 7 Math or Algebra 1, test taken MUST be hand-grid; Version # must be hand-grid if student is taking the Algebra 1 CST or CMA

For Grade 8 Version # for math booklet and math test taken MUST be completed

Version # must be hand-grid; student uses same version throughout testing window

36

Answer DocumentsAnswer Documents Grade 7 CMA MathGrade 7 CMA Math

Answer DocumentsAnswer Documents Grade 7 CMA MathGrade 7 CMA Math

Grade 7 Math and Algebra I CMA have different numbers of questions

37

= Hand-grid ONLY if used by student


CST/CMA Answer

Documents- BACK

CST/CMA Answer

Documents- BACK

= Included in Pre-ID

38


CST/CMA Answer

Documents- BACK

CST/CMA Answer

Documents- BACK

Box A2: Special Condition codes on page 117-118 in manual(i.e. absent, parent exempt, cheated, refused to test)

Box A1: only complete if directed by Erin (testing irregularities)

39

CST/CMAAnswer

Documents- BACK

CST/CMAAnswer

Documents- BACK

= Hand-grid ONLY if used by student

Box A3b: Box A3b: hand-grid only if used by student; no modifications allowed on the CMA; codes on pages 118- 119 in manual

Box A4: Box A4: hand-grid only if used by student; no glossary use allowed on ELA; codes on page 119 in manual


Box A3aBox A3a: must be completed for ALL students who have an IEP or 504

40

After TestingAfter TestingAfter TestingAfter Testing

Prepare Answer DocumentsPrepare Answer Documents

Complete Required FormsComplete Required Forms

Pack Materials ProperlyPack Materials Properly

Return Materials to Annex 10Return Materials to Annex 10

Account for ALL MaterialsAccount for ALL Materials

41

Prepare SCORABLE Answer DocumentsPrepare SCORABLE Answer DocumentsPrepare SCORABLE Answer DocumentsPrepare SCORABLE Answer Documents

1. Check that the demographic information is complete & correct – get demo guidesdemo guides

2. Hand-grid A2A2, A3A3, & A4A4 if applicable3. Check that version #sversion #s and math/science testmath/science test

takentaken has been completed (grades 7-11)4. Check for tears, stray marks, pen marks5. Check for paper clips, science reference sheets,

scratch paper6. Transcribe answers to clean answer document if original is damaged

An answer document must be submitted for every student (grades 2-11) enrolled on the 1st day of testing

Ensure that you and your staff 1. Do NOTNOT erase anything in the response circles

2. Do NOTNOT darken any marks in the response circles

Do NOT erase “process of elimination” marks made

by students in grades 2 & 3

42

Preparing Answer Documents Preparing Answer Documents

Any “cleanup” of test booklets must be done under the direct supervision direct supervision of the test site coordinator and/or the principal- see Appendix D of DFA

43

Grade 4 CST/CMA

Grade 4CAPA

Grade 4STS

Prepare SCORABLE Answer DocumentsPrepare SCORABLE Answer Documents Continued ContinuedPrepare SCORABLE Answer DocumentsPrepare SCORABLE Answer Documents Continued Continued

1. Separate all answer documents by GRADEGRADE

2. Within each grade, separate by TEST TYPETEST TYPE (CST/CMA, CAPA, STS)

3. Within each test type separate documents for students who were EXEMPTEXEMPT by parent (P on A2) and who were ABSENTABSENT (A on A2) for the entire test window

= ABSENT

= EXEMPT

44

Apportionment FormApportionment Form

•Complete one grade level at a time

•Indicate your school’s first day of testing

•Sign and have principal sign

•Return in RED envelope

45

Principal’s CertificationPrincipal’s

Certification

Principal’s signature

Return in RED envelope

46

School & Grade Identification (SGID)- side 1School & Grade Identification (SGID)- side 1

Complete 1 SGID per grade grade level and test test typetype: 1) CST/CMA; 2) CAPA; and 3) STS

Hand-grid appropriate test

Hand-grid grade level; leave blank for CAPA

Number of answer docs. under this SGID

Pages 25 & 92

in manual

First day of testing

When was STS given? If no STS, leave blank

47

School & Grade Identification (SGID)- side 2School & Grade Identification (SGID)- side 2

Complete top ONLY for grades 2-8

Pages 98-104 in manual for

coding instructional

materials

Teacher Reports are no longer available, so don’t complete bottom portion

48

Master File SheetMaster File Sheet

Submit with SCORABLE SCORABLE materials- Box 1

For CAPA =

all grades and levels are stacked together under 1 SGID

Page 94 in manual

Totals

The Master File Sheet should be the first thing we see when we open Box #1 of your scorablesscorables

49

50

Packing Scorable Materials

Packing Scorable Materials

Master File Sheet on Top

SGID on top of each stack of answer docs

SCORABLESCORABLE materials returned in ORANGEORANGE labeled boxes

Packing Order =1. CAPA2. CST/CMA (lowest grade level on top)

3. STS (lowest grade level on top)

See pages 64-68 in manual

51

Preparing Non-Scorable MaterialsPreparing Non-Scorable Materials

Damag

ed-

trans

crib

ed

VOID answer documents if:

•Student transferred to a different school before your first day of testing

•Demographic information on PreID was incorrect & blank document was used

•Original answer document was damaged and transcribed to new answer document

VOIDED answer documents go in NON-SCORABLES

52

Packing NON-Scorable Materials

Packing NON-Scorable Materials

NON-SCORABLE Materials Return

in GREEN labeled boxesUnused Freight Kit Materials

USED Scratch Paper (return or securely destroy)

CAPA•Unused CAPA Answer Docs

•VOIDED Answer Documents

•Examiner’s Manuals & Tests

CSTs/CMA (by grade level)•DFAs

•Unused & VOIDED Answer Documents

•Test Booklets

STS (lowest grade on top; highest grade on bottom)

•DFAs

•Unused & VOIDED Answer Documents

•Test Booklets

Page 67-69 in manual

TOP

BOTTOM

53

Returning Materials: Labeling Boxes Returning Materials: Labeling Boxes

Affix label to designated area on box

Put box counts in SCHOOL section

on labels

54

CORRECT WAY TO NUMBER BOXES

WRONG WAY TO NUMBER BOXES

COUNT SCORABLE BOXES

SEPARATELY FROM

NONSCORABLE BOXES

Lightly seal boxes to transport

55

56

RED EnvelopeRED Envelope

1. Signed Apportionment Form2. Signed Certification Form3. Signed Security Affidavits4. Incident Reports

Make copies for your files and submit originals

Do not pack RED envelope in

scorable and nonscorable boxes; keep

separate

Return your materials to Annex 10 by Return your materials to Annex 10 by 4:30 p.m. on your assigned day4:30 p.m. on your assigned day

Traditional School Deadlines: May 14: A-F (Elem & Middle)May 15: G-M (Elem & Middle)May 16: N-Z (Elem & Middle)May 17: Senior High Schools

57

58

Contact InformationContact InformationAssessment ServicesAssessment Services

Erin Gordon (619) 725-5687; [email protected]

Denise Ormsbee (619) 725-7059; [email protected]

Fax Number (619) 725-7070

Website: http://www.sandi.net/page/1545

Research & ReportingResearch & ReportingJim Gustafson (619) 725-7195; [email protected]

Special EducationSpecial Education

Julie Wade (619) 725-7412; [email protected]

Debby Warner (619) 725-7604; [email protected]

Demo guides

CMA

CAPA