2012 STAR Order Management Workshop October 19, 2011 Start Time 9 a.m. Presenters: Mark Hansen and Michael McDaniel 2012 STAR Order Management || Slide

2012 STAR2012 STAROrder Management Order Management

WorkshopWorkshop

October 19, 2011

Start Time 9 a.m.Presenters: Mark Hansen and Michael McDaniel

2012 STAR Order Management || Slide 1 October 2011

ObjectivesObjectives

District STAR coordinators will identify:• Which materials to order• How to order test materials


AgendaAgendaMajor changes and reminders for 2012 ordering• 25-Day testing window• Ordering braille versions • Eligibility for tests

CMA CAPA STS

• What needs to be ordered? Discussed by grade

• Eligibility for end-of-course (EOC) California Standards Tests (CSTs) Mathematics Science World History


Agenda, continuedAgenda, continued• Eligibility for EOC California Modified Assessment

(CMA) Mathematics (Algebra I and Geometry)

• Eligibility for EOC Standards-based Tests in Spanish (STS) Mathematics (Algebra I and Geometry)

• Ordering materials Overview of process Ordering options

– Online ordering– Batch file submission


What’s New What’s New • The California Code of Regulations, Title 5, Education (5 CCR),

Section 855, extends the STAR testing window by 4 days, from 21 instructional days to “25 instructional days that includes 12 instructional days before and after completion of 85% of the school’s, track’s, or program’s instructional days. Testing for all pupils, including makeup testing, is to be completed within this 25 instructional day window.” At least two makeup days must be included within the testing window. The testing window calculated by the Test Administration Setup

module applies this change.

• Ordering braille versions using the Order Management module: CMA for English–language Arts (ELA) in grades ten and eleven

and CMA for Geometry are now available. CMA for Life Science (Grade 10) is to be ordered using the

module.


District Preparation ChecklistDistrict Preparation ChecklistObtain school calendars

Including nonpublic, nonsectarian schools (NPS)Obtain warehouse calendar Identify dependent charter schools Identify NPSs providing special education

servicesCollect order quantities from test site

coordinators


Site Preparation Checklist: Site Preparation Checklist: Give to District STAR Give to District STAR

CoordinatorCoordinator School calendar(s) Quantity and type of test booklets required

CST – Grade-level tests

ELA (grades 2–11) Mathematics (grades 2–7) Science (grades 5 and 8); Life Science (grade 10) History–Social Science (grades 8 and 11)

Based on individualized education programs (IEPs)– CMA

ELA (grades 3–11) Mathematics (grades 3–7) Science (grades 5 and 8); Life Science (grade 10) Algebra I (grades 7–11) Geometry (grades 8–11)


Site Preparation Checklist: Site Preparation Checklist: Give to District STAR Give to District STAR

CoordinatorCoordinator CAPA Special versions

Large print Braille

Based on mathematics department chair input– CST for EOC mathematics

Algebra I (grades 7–11) Other EOC mathematics (grades 8–11)

– CMA for EOC Mathematics Algebra I (grades 7–11) Geometry (grades 8–11)

– STS for EOC Mathematics Algebra I (grades 7–11) Geometry (grades 8–11)


Site Preparation Checklist: Site Preparation Checklist: Give to District Coordinator (cont.)Give to District Coordinator (cont.)

Based on science department chair input– CST for EOC science

Grades 9–11 Based on history–social science department chair input

– CST for EOC World History Grades 9–11

Based on English learner status– STS

Grades 2–11 Number of additional DFAs needed for CST, CMA, and STS:

CMA DFAs calculated 1 per 10 students CST/STS DFAs calculated 1 per 20 students


General Rules for OrderingGeneral Rules for Ordering

• Do NOT over-order Districts are sent 5% overage Schools are sent 10% overage

• Be realistic with quantities Especially large print, braille

– These materials are expensive! Mobile populations (county offices)

– Average prior-year orders, then use “Supplemental Order” process if necessary


California Modified AssessmentCalifornia Modified AssessmentWho Takes the CMA?Who Takes the CMA?

CMA participation is an IEP team decision based on: Previous participation in the CSTs or CAPA Progress based on multiple measures and objective evidence

(Previous performance on the CMA may be used as objective evidence to document academic achievement within the year covered by the student's IEP)

Response to appropriate grade-level instruction Not precluded from attempting to complete requirements for a

regular high school diploma Parents are informed that achievement will be measured based

on modified achievement standards

See the complete CMA participation criteria at http://www.cde.ca.gov/ta/tg/sr/participcriteria.asp


California Modified AssessmentCalifornia Modified AssessmentWho Takes the CMA? (cont.)Who Takes the CMA? (cont.)

Reminders: The IEP team must annually decide whether the

student takes the CMA. The IEP team may continue to designate the CMA for a student who previously scored proficient or advanced if the team determines that the student still meets the SBE-adopted criteria.

Students may take the CMA for some subjects and CST for other subjects

Students may NOT take a combination of CAPA and CMA.

California Alternate Performance California Alternate Performance AssessmentAssessment

Who Takes the CAPA?Who Takes the CAPA?

• Student must have an IEP.• Student’s IEP must specify CAPA and whether

the student should take the grade-assigned CAPA level or CAPA Level I.

Note:

Student counts by CAPA level are not necessary during the ordering process.


What needs to be ordered? What needs to be ordered? CAPACAPA

• Examiner’s Manual: One for each examiner Can be used for several students All CAPA levels covered One version per school district

• Answer documents One per student taking the CAPA All CAPA levels covered 10% double-rated (use overage)

– Will be discussed in the Pre-Test Workshop


CAPA ManipulativesCAPA Manipulatives• Not ordered through ETS• School districts need to assemble manipulatives• Dependent upon

CAPA version– Assigned by ETS (available in early December)

CAPA level– Determined by IEP team

Designate Level I or grade-level• Manipulatives list indicates the following:

Single-use items Multi-use items


Standards-based Tests in Standards-based Tests in SpanishSpanish

Who takes the STS?Who takes the STS?• Available in grades 2–11

Spanish-speaking English learners (EL)– Required to take STS if they:

Are receiving instruction in Spanish OR Will have attended school in the U.S. or one of its

territories less than 12 cumulative months on the first day of testing (regardless of whether they receive instruction in English or Spanish)

– At the option of the school district: Any other Spanish-speaking English learners

• Not to be administered to:– English-only, I-FEP, R-FEP students– English learners whose primary language is not Spanish– Note – students take STS in addition to the CST and / or

CMA2012 STAR Order Management || Slide 16 October 2011

What Needs to Be Ordered, by What Needs to Be Ordered, by GradeGrade


What needs to be ordered?What needs to be ordered?Grade 2Grade 2

• CST grade-level test booklet for each student to be tested Contains:

– CST for English–Language Arts– CST for Mathematics

• STS grade-level test booklet for each eligible student Contains:

– STS for Reading/Language Arts– STS for Mathematics



• CST grade-level test booklet for each student to be tested with one or more CST CST test booklet contains:


• CMA test booklet for each eligible student Contains:

– CMA for English–Language Arts– CMA for Mathematics





• CST grade-level test booklet for each student to be tested with one or more CST Contains:


• CMA grade-level test booklet for each eligible student Contains:





What needs to be ordered?What needs to be ordered?Grade 4 (cont.) Grade 4 (cont.)

• CST for Writing test booklet for all students taking the CST for ELA

• CMA for Writing test booklet for all students

taking the CMA for ELA

• Note – there is no writing test for the STS




– CST for English–Language Arts– CST for Mathematics– CST for Science


– CMA for English–Language Arts– CMA for Mathematics– CMA for Science






– CST for English–Language Arts

– CST for Mathematics• CMA grade-level test booklet for each eligible student

Contains:– CMA for English–Language Arts

– CMA for Mathematics• STS grade-level test booklet for each eligible student

Contains:– STS for Reading/Language Arts– STS for Mathematics





For students not completing an Algebra I course



For students not completing an Algebra I course

• CST or CMA Algebra I test booklet For students completing a standards-aligned

Algebra I course


What needs to be ordered?What needs to be ordered?Grade 7 (cont.)Grade 7 (cont.)


– STS for Reading/Language Arts– STS for Mathematics (grade-level)

• Algebra I STS test booklet For students completing a standards-aligned

Algebra I course• CST for Writing test booklet for all students taking the

CST for ELA • CMA for Writing test booklet for all students taking

the CMA for ELA

• Note - there is no writing test for the STS.




– CST for English–Language Arts– CST for Science– CST for History–Social Science


– CMA for English–Language Arts– CMA for Science



• EOC CST or CMA mathematics test booklet All grade 8 students MUST take a mathematics

test Test booklet contains one of the following:

– CST or CMA for Algebra I– CST for General Mathematics – CST or CMA for Geometry– CST for other EOC mathematics

Courses aligned with the CST or CMA blueprint




– STS for Reading/Language Arts• EOC mathematics STS test booklet

Contains– STS for Algebra I or STS for Geometry

Courses aligned with STS blueprint




– CST for English–Language Arts• CMA grade-level test booklet for each eligible student

Contains:– CMA for English–Language Arts

• EOC mathematics CST or CMA test booklet All grade 9 students MUST take a mathematics test Contains one of the following:

– CST or CMA for Algebra I or Geometry– CST for General Mathematics– CST for other EOC mathematics

Courses aligned with the CST or CMA blueprint



• EOC science CST test booklet Contains one of the following:

– Biology, or Earth Science, or Physics, etc. Courses aligned with the CST blueprint

• CST for EOC World History test booklet Course aligned with the CST blueprint


– STS for Reading/Language Arts• EOC mathematics STS test booklet for each eligible

student Contains:

– STS for Algebra I or STS for Geometry Courses aligned with the STS blueprint




– CST for English–Language Arts – CST for Life Science


– CMA for English–Language Arts – CMA for Life Science

• EOC mathematics CST or CMA test booklet Contains one of the following:

– CST or CMA for Algebra I or Geometry – CST for Algebra II, or CST for Integrated

Mathematics 3, and so forth Courses aligned with the CST or CMA blueprint




– Earth Science, or Biology, or Physics, etc. Courses aligned with the CST blueprint



– STS for Reading/Language Arts• EOC mathematics STS test booklet for each eligible student• Contains:

– STS for Algebra I or STS for Geometry Courses aligned with the STS blueprint




– CST for English–Language Arts– CST for U.S. History


– CMA for English–Language Arts • EOC for mathematics CST or CMA test booklet

Contains one of the following:– CST or CMA for Algebra I or Geometry – CST for Algebra II, or CST for Integrated

Mathematics 3, and so forth Courses aligned with the CST or CMA blueprint




– Earth Science or Biology or Physics, and so forth Courses aligned with the CST blueprint



– STS for Reading/Language Arts• STS for EOC mathematics test booklet for each eligible student• Contains:

– STS for Algebra I or STS for Geometry Courses aligned with the ST S blueprint

• EAP Essay test booklet


Who Takes CST or CMA for EOC Who Takes CST or CMA for EOC Mathematics?Mathematics?

• Grades 2–9 ALL students take a mathematics test

• Grades 10 and 11 Students may take no mathematics test if

– They are in the first year of a multiyear Algebra I course; or– They are taking a Business Mathematics course or a general

mathematics course; or – They are taking no mathematics course (unless they are eligible to

take the CST for Summative High School Mathematics).• Determine which mathematics test will be administered in

grades 7–11 Review state blueprints available at:

http://www.cde.ca.gov/ta/tg/sr/resources.asp Review curriculum Review guidelines in the Order Management Manual CMA students in grades 8 and 9 should take the CMA for

Algebra I, Geometry, an EOC mathematics CST, or the CST for General Mathematics


Who takes the STS for EOC Who takes the STS for EOC Mathematics?Mathematics?

• The STS for Algebra I is available for students in grades 7–11

• The STS for Geometry is available for students in grades 8–11

• Eligibility requirements are as follows: Completing the course or completed it in the

summer of 2011 Same EOC rules as CST/CMA Must be Spanish-speaking English learners (EL) Not to be administered to English-only, I-FEP, R-

FEP


Which Students Take Which Students Take the CST for General Mathematics?the CST for General Mathematics?

• Students in grades 8 or 9 only who are Not taking a mathematics course; or Taking any mathematics course prior to

Algebra I (e.g. Pre-Algebra, Algebra Readiness, Business mathematics, and so forth); or

Not in the last year of a multiyear Algebra I course


Which Students Take Which Students Take Algebra I?Algebra I?

• Students in grades 7–11 who will complete an Algebra I course during the 2011 – 2012 school year or completed it in the summer of 2011.

• Grade 7 students not completing an Algebra I course take the grade 7 mathematics test.


Which Students Take Which Students Take Summative High School Mathematics?Summative High School Mathematics?

• Students in grades 9-11, if:• They completed Algebra I, Algebra II, and Geometry courses in previous

years and completed an advanced mathematics course in the 2011 summer session or will complete it during the 2011–12 school year; or

• They completed a course aligned with the Integrated Mathematics 3 test blueprint in a previous year and completed an advanced mathematics course in the 2011 summer session or will complete it during the 2011–12 school year; or

• They completed Algebra I, Algebra II, and Geometry courses in previous years and are taking no mathematics course this year; or

• They completed a course aligned with the Integrated Mathematics 3 test blueprint in a previous year and are taking no mathematics course this year; or

• They are in grade ten or grade eleven and took the CST for Summative High School Mathematics in a previous year; those students retake the CST for Summative High School Mathematics (whether or not they are taking a mathematics class).


EOC Mathematics—Example 1EOC Mathematics—Example 1• Carol

2011– Grade 9 student– Previously completed Algebra I and

Geometry courses and took an Algebra II course in 2011

– Took the CST for Algebra II 2012

– Grade 10 student– Not studying mathematics– Takes CST for Summative High School

Mathematics


EOC Mathematics—Example 2EOC Mathematics—Example 2• Robert

2011

– Grade 9 student

– Took a Geometry course (but has not takenAlgebra II)

– Took the CST for Geometry 2012

– Grade 10 student

– Not studying mathematics

– Takes no mathematics test


EOC Mathematics—Example 3EOC Mathematics—Example 3• Juan

2011– Grade 10 student– Took an advanced mathematics course– Took the CST for Summative High School

Mathematics 2012

– Grade 11 student– Not studying mathematics– Takes the CST for Summative High School

Mathematics


EOC Mathematics—Example 4EOC Mathematics—Example 4• Juliet

2011– Grade 10 student– Took an advanced mathematics course– Took the CST for Summative High School

Mathematics 2012

– Grade 11 student– Studying Calculus– Takes the CST for Summative High School

Mathematics


Which Students TakeWhich Students TakeEnd-of-Course Science?End-of-Course Science?

• Students in grades 9–11 Completed a California standards-aligned science

course in the 2011 summer session or will complete it during the 2011 – 2012 school year.– Review state blueprints– Review curriculum– Determine which, if any EOC science CST students in

each course will take

• All students in grade 10 take the Life Science test Test printed in the grade 10 test booklet (both CST

and CMA) Grade 10 students will also take an EOC science

CST if taking a standards-aligned science course.


Which Students TakeWhich Students TakeEnd-of-Course World History?End-of-Course World History?

• Students in grades 9–11 Completed the World History course in the 2011

summer session or will complete it during the 2011–12 school year

• All students in grade 11 will take the CST for U.S. History The test is printed in the grade 11 test booklet Grade 11 students will also take the CST for

World History if they meet the criteria above


EAP EssayEAP Essay

• Grade 11 Order for all students Must be taken in conjunction with additional

ELA multiple-choice questions to achieve an exemption from the CSU and participating California Community Colleges.

Order entered on the Early Assessment Program administration (EP01)

Approve order separately


15-minute break for everyone!15-minute break for everyone!


Test AdministrationsTest Administrations• Multiple-choice

Up to 8 administrations allowed MC01 – MC08 Each administration should have different date for “First day of

testing” Each administration’s order needs to be approved separately

– Enter orders for ALL administrations before starting approval process– Report for 2012 provides list of schools without orders– Report generated when each order approved

• Writing Application (grades 4 and 7) CST and CMA Administration WA01

– March 6 with makeup on March 7 if in session on March 6 Administration WA02

– May 1 with makeup on May 2 ONLY if not in session on March 6 Enter and approve order separately from multiple-choice

• Early Assessment Program (EAP) Essay Administration EP01

– March 6 through March 30 Enter and approve order separately from multiple choice


Ordering ProceduresOrdering Procedures

1. Set up test administration dates• See the Webcast “2012 STAR Test

Administration Setup”• Manual posted on www.startest.org/sms.html

2. Confirm “Profile” information• Primary Shipping Address• Secondary Shipping Address (optional)

– Can be used for Supplemental Order delivery

• Report Shipping Address (optional)– Used to deliver Reports in summer 2012– Address must be set up before June 1, 2012


Ordering ProceduresOrdering Procedures1. Enter order quantities for each Multiple-Choice,

Writing Application, and the Early Assessment Program administration.

• Screen entry

or• Produce file containing order quantities and

upload

2. Approve order for each administration.


Software DemonstrationSoftware Demonstration

1. Verify Profile

2. Enter order online

3. Approve order













School district cannot approve order when errors still exist.




Book count warnings

Schools with no orders

School district can still approve order when warnings exist.







STAR Order ManagementSTAR Order Management

File upload option


Order File Upload FormatOrder File Upload Format

• Included in Order Management Manual

• Fixed-length field; text file only

• Orders for one administration only per file


Sample FileSample File

October 2011STAR Order Management 742012 STAR Order Management || Slide 74 October 2010

Sample E-MailSample E-Mail


Review and ApproveReview and Approve• Review orders using

Online screens and/or Printouts generated by the STAR

Management System• Adjust orders where necessary using

Online entry to adjust quantities• Approve orders

All orders entered through “file upload” need to be approved by the district STAR coordinator


In ConclusionIn Conclusion


Excessive Materials Ordered ChargesExcessive Materials Ordered Charges

• 90% of the value of materials ordered minus value of materials used

• Be careful ordering! Do not over-order Large-print and braille materials are very

expensive

• No excessive order charges for EAP Essay test books

• ETS will invoice approximately December 2012


Excessive Materials Ordered ChargesExcessive Materials Ordered Charges

• Value of materials ordered ($x) Does not include overages Order quantities will be adjusted based

on number of Pre-ID records

• Value of materials used ($y)• If (x-y) ≤ 10%(x) then no charges will

apply • If (x-y) > 10%(x) then charges will

apply


Excessive Materials Ordered ChargesExcessive Materials Ordered ChargesExample 1Example 1

• Value of materials ordered = $5,000• Value of materials used = $4,600• Difference between ordered and used = $400• 10% of materials ordered = $500• Difference ($400) is less than 10% of materials

ordered ($500) No charges will apply


Excessive Materials Ordered ChargesExcessive Materials Ordered ChargesExample 2Example 2

• Value of materials ordered = $5,000• Value of materials used = $4,100• Difference between ordered and used = $900• 10% of materials ordered = $500• Difference ($900) is greater than 10% of

materials ordered ($500) Charge will apply Charge will be $900 – $500 = $400


ReviewReview

• Set up test administration dates NPS schedules may be different from

district schedules

• Enter order quantities for each administration Multiple-choice Writing (CST and CMA, grades 4 and 7) EAP Essay

• Approve orders Every administration


TimetableTimetable

• Gather data from sites immediately• Enter orders: Now through December 1, 2011• Orders reviewed by ETS throughout December

and January• Adjustments to initial orders up until “Order

Sent for Packaging” date• If required, place supplemental orders after

“Order Sent for Packaging” date• Track order status


Questions?Questions?

October 2011 2012 STAR Order Management || Slide 84

More Questions?More Questions?

For STAR technical questions:STAR TAC—800-955-2954

For STAR policies: CDE—916-445-8765

For accountability questions:CDE Academic Accountability Unit—916-319-0863

October 2011 2012 STAR Order Management || Slide 85

Next WebcastNext Webcast

2012 STAR Pre-ID Workshop WebcastNovember 16, 2011


Documents

2012 STAR Order Management Workshop October 19, 2011 Start Time 9 a.m. Presenters: Mark Hansen and Michael McDaniel 2012 STAR Order Management || Slide