View
214
Download
0
Category
Tags:
Preview:
Citation preview
2010 STAR2010 STAROrder Management Order Management
WorkshopWorkshop
October 28, 2009
Start Time 9:00 a.m.Presenter: Mark Hansen and Michael McDaniel
October 2009 STAR Order Management 1
ObjectivesObjectives
District STAR coordinators will identify:• Which materials to order• How to order test materials
October 2009 STAR Order Management 2
AgendaAgendaMajor changes and reminders for 2010 Ordering• Eligibility for tests
CMA CAPA STS
• What needs to be ordered? Discussed by grade
• Eligibility for end-of-course (EOC) CST tests Mathematics Science World History
• Eligibility for EOC CMA test Mathematics (Algebra I)
• Eligibility for EOC STS tests Mathematics (Algebra I and Geometry)
October 2009 STAR Order Management 3
AgendaAgenda
• Ordering materials Overview of process Ordering options
–Online ordering–Batch file submission
October 2009 STAR Order Management 4
What’s New What’s New • The California Standards Test (CST) and California
Modified Assessment (CMA) for Writing will be offered to students in grade seven only.
• The CMA multiple-choice test will be administered to students in grade nine (English–language arts), grade ten (Life Science), and seven through eleven (Algebra I).
• Students taking the CMA in grades eight through eleven will receive a separate CMA answer document.
• CST answer documents will always be provided to students in grades eight through eleven.
• CMA Directions for Administration (DFAs) for all grade levels will be calculated as one DFA per every 10 tests ordered.
October 2009 STAR Order Management 5
What’s New (continued)What’s New (continued)• Audio CDs are no longer available. • Braille is available for the CMA in grades six through eight
ELA, grades six and seven mathematics, and grade eight science (but not for the CMA for grade nine, grade ten and Algebra I).
• The “Supplemental Order / Late Label Cutoff Date” will be calculated as seven calendar days before the selected last testing date.
• The “Transfer Student Cutoff Date,” for Pre-ID will be calculated as seven calendar days before the selected last testing date.
• While ordering forms like the “Add Initial Order” form and reports pages like the “Approve Order” page display fields for grade four Writing tests, audio CDs, and additional Version 1 test booklets, these materials are not available for order. Numbers entered into these fields will be disregarded. Additional Version 1 test booklets will be available as supplemental orders.
October 2009 STAR Order Management 6
District Preparation ChecklistDistrict Preparation Checklist Obtain school calendars
Including nonpublic, nonsectarian schools (NPS)
Obtain warehouse calendar Identify dependent charter schools Identify NPSs providing special education
services Collect order numbers from test site
coordinators
October 2009 STAR Order Management 7
Site Preparation Checklist: Site Preparation Checklist: Give to District STAR Give to District STAR
CoordinatorCoordinator School calendar(s) Number and type of test booklets required
Based on individualized education programs (IEPs)– CMA
Grades 3–9 for ELA and grades 3–7 for mathematics
Grades 5, 8, and 10 (Life Science) Algebra I, grades 7–11
– CAPA– Special versions
Large print available for all tests Braille
» CSTs—All tests» CMA—Grades 3–8 (but not Algebra I)» STS—All tests
October 2009 STAR Order Management 8
Site Preparation Checklist: Site Preparation Checklist: Give to District Coordinator (cont.)Give to District Coordinator (cont.)
Based on mathematics department chair input– CST for Algebra I
Grades 7–11 – Other EOC mathematics (grades 8–11)– STS for Algebra I and STS for Geometry
Grades 7–11 STS Algebra Grade 8-11 STS Geometry
Based on science department chair input– EOC science
grades 9–11 Based on history–social science department chair input
– EOC World History grades 9–11
October 2009 STAR Order Management 9
Site Preparation Checklist: Site Preparation Checklist: Give to District Coordinator (cont.)Give to District Coordinator (cont.)
Based on English learner status– STS
Grades 2–11 Number of additional DFAs needed for CST, CMA,
and STS. CMA DFAs calculated 1 per 10 CST/STS DFAs calculated 1 per 20
October 2009 STAR Order Management 10
General Rules for OrderingGeneral Rules for Ordering
• Do NOT over-order Districts are sent 5% overage Schools are sent 10% overage
• Be realistic with quantities Especially large print, braille
– These materials are expensive! Mobile populations (county offices)
– Average prior year’s order, then use “Supplemental Order” process if necessary
October 2009 STAR Order Management 11
California Modified AssessmentCalifornia Modified AssessmentWho Takes the CMA?Who Takes the CMA?
Available in grades 3–9 for ELA, grades 3–7 for mathematics, grades 7–11 for EOC Algebra I, and grades 5, 8, and 10 for science. Eligible students shall, in part:
1. Have an IEP that specifies that they take the CMA for one or more subjects; and
2. Scored below basic or far below basic in a previous year on the CST in the subject area being assessed by the CMA and may have taken the CST with modifications; or
3. Have taken the CAPA Level II–V in two previous years and received a performance level of either proficient or advanced.
Student may test one or more content areas with CMA, e.g. CMA for Mathematics, CST for ELA
October 2009 STAR Order Management 12
California Alternate Performance California Alternate Performance AssessmentAssessment
Who Takes the CAPA?Who Takes the CAPA?
• Student must have an IEP• Student’s IEP must specify CAPA and
determine if student should take grade assigned CAPA level, or CAPA Level I.
Note:
Student counts by CAPA level are not necessary during the ordering process.
October 2009 STAR Order Management 13
What needs to be ordered? What needs to be ordered? CAPACAPA
• Examiner’s Manual: One for each examinerCan be used for several studentsAll CAPA levels coveredOne version per school district
• Answer documentsOne per student taking the CAPAAll CAPA levels covered10% double-rated (use overage)
– Will be discussed in Pre-Test Workshop
October 2009 STAR Order Management 14
CAPA ManipulativesCAPA Manipulatives
• Not ordered through ETS• School districts need to assemble manipulatives• Dependent upon
CAPA version– Assigned by ETS (available in early December)
CAPA level– Determined by IEP team
Designate the use of Level I or grade-appropriate level
• Manipulatives list indicates Single-use itemsMulti-use items
October 2009 STAR Order Management 15
Standards-based Tests in Standards-based Tests in SpanishSpanish
Who takes the STS?Who takes the STS?• Available at grades 2–11
Spanish-speaking English learners (EL)– Required to take STS if they:
Are receiving instruction in Spanish OR Will have attended U.S. schools less than 12
cumulative months on the first day of testing (regardless of whether they receive instruction in English or Spanish)
– At the option of the school district: Any other Spanish-speaking English learners
• Not to be administered to Non-ELs – E.g. English-only, I-FEP, R-FEP students– English learners whose primary language is not
Spanish
October 2009 STAR Order Management 16
What Needs to Be Ordered, by What Needs to Be Ordered, by GradeGrade
October 2009 STAR Order Management 17
What needs to be ordered?What needs to be ordered?Grade 2Grade 2
• CST grade-level test booklet for each student to be tested Contains:
– CST for English–Language Arts
– CST for Mathematics
• STS grade-level test booklet for each student eligible to be tested with the STS Contains:
– STS for Reading/Language Arts
– STS for Mathematics
October 2009 STAR Order Management 18
What needs to be ordered?What needs to be ordered?Grade 3Grade 3
• CST grade-level test booklet for each student to be tested with one or more CST CST test booklet contains:
– CST for English–Language Arts– CST for Mathematics
• CMA test booklet for each student eligible to be tested with one or more CMA Contains:
– CMA for English–Language Arts– CMA for Mathematics
• STS grade-level test booklet for each student eligible to be tested with the STS Contains:
– STS for Reading/Language Arts– STS for Mathematics
October 2009 STAR Order Management 19
What needs to be ordered?What needs to be ordered?Grade 4Grade 4
• CST grade-level test booklet for each student to be tested with one or more CST Contains:
– CST for English–Language Arts– CST for Mathematics
• CMA grade-level test booklet for each student eligible to be tested with one or more CMA Contains:
– CMA for English–Language Arts– CMA for Mathematics
• STS grade-level test booklet for each student eligible to be tested with the STS Contains:
– STS for Reading/Language Arts– STS for Mathematics
October 2009 STAR Order Management 20
What needs to be ordered?What needs to be ordered?Grade 5Grade 5
• CST grade-level test booklet for each student to be tested with one or more CST Contains:
– CST for English–Language Arts– CST for Mathematics– CST for Science
• CMA grade-level test booklet for each student eligible to be tested with one or more CMA Contains:
– CMA for English-Language Arts– CMA for Mathematics– CMA for Science
• STS grade-level test booklet for each student eligible to be tested with the STS Contains:
– STS for Reading/Language Arts– STS for Mathematics
October 2009 STAR Order Management 21
What needs to be ordered?What needs to be ordered?Grade 6Grade 6
• CST grade-level test booklet for each student to be tested with one or more CST Contains:
– CST for English–Language Arts– CST for Mathematics
• CMA grade-level test booklet for each student eligible to be tested with one or more CMA Contains:
– CMA for English-Language Arts– CMA for Mathematics
• STS grade-level test booklet for each student eligible to be tested with the STS Contains:
– STS for Reading/Language Arts– STS for Mathematics
October 2009 STAR Order Management 22
What needs to be ordered?What needs to be ordered?Grade 7Grade 7
• CST grade-level test booklet for each student to be tested Contains:
– CST for English–Language Arts– CST for Mathematics
– For students not completing an Algebra I course
• CMA grade-level test booklet for each student eligible to be tested with one or more CMA Contains:
– CMA for English–Language Arts– CMA for Mathematics
– For students not completing an Algebra I course
• CST or CMA Algebra I test booklet For students completing a standards-aligned
Algebra I courseOctober 2009 STAR Order Management 23
What needs to be ordered?What needs to be ordered?Grade 7 (cont.)Grade 7 (cont.)
• STS grade-level test booklet for each eligible student Contains:
– STS for Reading/Language Arts– STS for Mathematics (grade-level)– No STS for Writing test
• EOC mathematics STS test booklet For students completing a standards-aligned
Algebra I course• CST Writing test booklet for all students taking the
CST for ELA • CMA Writing test booklet for all students taking the
CMA for ELA
October 2009 STAR Order Management 24
What needs to be ordered?What needs to be ordered?Grade 8Grade 8
• CST grade-level test booklet for each student to be tested Contains:
– CST for English–Language Arts– CST for Science– CST for History–Social Science
• EOC mathematics CST test booklets All grade 8 students MUST take a mathematics test
– CST or CMA for Algebra I– CST for General Mathematics, CST for Geometry,
and so forth Courses aligned with the CST blueprint
October 2009 STAR Order Management 25
What needs to be ordered?What needs to be ordered?Grade 8 (cont.)Grade 8 (cont.)
• CMA grade-level test booklet for each student eligible to be tested with one or more CMA Contains:
– CMA for English-Language Arts– CMA for Science
Appropriate EOC CST for Mathematics or CMA for Algebra I
October 2009 STAR Order Management 26
What needs to be ordered?What needs to be ordered?Grade 8 (cont.)Grade 8 (cont.)
• STS grade-level test booklet for each student eligible to be tested with the STS Contains:
– STS for Reading/Language Arts• EOC mathematics STS test booklet
For students completing a standards-aligned Algebra I or Geometry course
October 2009 STAR Order Management 27
What needs to be ordered?What needs to be ordered?Grade 9Grade 9
• CST grade-level test booklet for each student to be tested Contains:
– CST for English–Language Arts• CMA grade-level test booklet for each student eligible to
be tested with one or more CMA Contains:
– CMA for English–Language Arts
• EOC mathematics test booklet All grade 9 students MUST take a mathematics test
– CST or CMA for Algebra I– CST for General Mathematics, CST for Geometry,
etc. Courses aligned with the CST blueprint
October 2009 STAR Order Management 28
What needs to be ordered?What needs to be ordered?Grade 9 (cont.)Grade 9 (cont.)
• EOC science test booklet Biology, Earth Science, Physics, etc. Courses aligned with the CST blueprint
• EOC world history test booklet Course aligned with the CST blueprint
• STS grade-level test booklet for each student eligible to be tested with the STS Contains:
– STS for Reading/Language Arts• EOC mathematics STS test booklet for each student
eligible to take an end-of-course test Contains:
– STS for Algebra I or STS for Geometry
October 2009 STAR Order Management 29
What needs to be ordered?What needs to be ordered?Grade 10Grade 10
• CST grade-level test booklet for each student to be tested Contains:
– CST for English–Language Arts – CST for Life Science
• CMA grade-level test booklet for each student to be tested Contains:
– CMA for Life Science• EOC mathematics test booklet
– CST or CMA for Algebra I– CST for Algebra II, CST for Geometry, etc.
Courses aligned with the CST blueprint
October 2009 STAR Order Management 30
What needs to be ordered?What needs to be ordered?Grade 10 (cont.)Grade 10 (cont.)
• EOC science test booklet Contains:
– Earth Science, Biology, Physics, etc.– Courses aligned with the CST blueprint
• EOC world history test booklet Course aligned with the CST blueprint
• STS grade-level test booklet for each student eligible to be tested with STS Contains:
– STS for Reading/Language Arts• EOC mathematics STS test booklet for each student eligible
to take an end-of-course test Contains:
– STS for Algebra I or STS for Geometry
October 2009 STAR Order Management 31
What needs to be ordered?What needs to be ordered?Grade 11Grade 11
• CST grade-level test booklet for each student to be tested Contains:
– CST for English–Language Arts– CST for U.S. History
• EOC mathematics test booklet – CST or CMA for Algebra I– CST for Algebra II, CST for Geometry, etc.
Courses aligned with the CST blueprint• End-of-course science test booklet
Earth Science, Biology, Physics, etc. Courses aligned with the CST blueprint
October 2009 STAR Order Management 32
What needs to be ordered?What needs to be ordered?Grade 11 (cont.)Grade 11 (cont.)
• End-of-course world history test booklet Course aligned with the CST blueprint
• STS grade-level test booklet for each student eligible to be tested with the STS Contains:
– STS for Reading/Language Arts• EOC STS test booklet for each student eligible to
take an end-of-course test Contains:
– STS for Algebra I or STS for Geometry • EAP Essay test booklet
October 2009 STAR Order Management 33
Who Takes CST or CMA for EOC Who Takes CST or CMA for EOC Mathematics?Mathematics?
• Grades 2–9 ALL students take a mathematics test
• Grades 10 and 11 Students may take no mathematics test if they are not
enrolled in a mathematics course and did not previously complete Algebra II or a course aligned with the Integrated Mathematics 3 test blueprint or they are enrolled in the first year of a two-year mathematics course or enrolled in General Mathematics or Business Mathematics
• Determine which mathematics test will be administered in grades 7–11 Review state blueprints Review curriculum Review rules CMA students should take the CMA for Algebra I, an EOC
mathematics CST, or the CST for General Mathematics (grades 8 and 9 only)
October 2009 STAR Order Management 34
Who takes the STS for EOC Who takes the STS for EOC Mathematics?Mathematics?
• The STS for Algebra I is available for students in grades 7–11
• The STS for Geometry is available for students in grades 8–11 Must be
– Spanish-speaking English learners (EL)– Not to be administered to non-ELs such as
English-only, I-FEP, R-FEP• Same EOC rules as CST/CMA
Completing the course or completed it in the summer of 2009
October 2009 STAR Order Management 35
Which Students Take Which Students Take the CST for General Mathematics?the CST for General Mathematics?
• Students in grades 8 or 9 only who are: Not taking a mathematics course
Or Taking any mathematics course prior to
Algebra I (e.g. Pre-Algebra, Algebra Readiness, Business mathematics, etc.)
Or Not in the last year of a multi-year Algebra I
course
October 2009 STAR Order Management 36
Which Students Take Which Students Take Algebra I?Algebra I?
• Students in grades 7–11 who are completing Algebra I or completed it in the summer of 2009
• Grade 7 students not completing Algebra I take the grade 7 mathematics test
October 2009 STAR Order Management 37
Which Students Take Which Students Take Summative High School Mathematics?Summative High School Mathematics?
• Students in grades 9–11 who have completed Algebra II or a course aligned with the Integrated Mathematics 3 test blueprint in a previous school year, and who:
Are taking higher-level mathematics courses; or Are taking no mathematics courses; or May have taken the CST for Summative High School
Mathematics previously
October 2009 STAR Order Management 38
Example 1Example 1• Jenny
2009
– Grade 9 student
– Took Algebra II
– Took the CST for Algebra II 2010
– Grade 10 student
– Not studying mathematics
– Takes CST for Summative High School Mathematics
October 2009 STAR Order Management 39
Example 2Example 2• James
2009– Grade 9 student– Took Geometry– Took the CST for Geometry
2010– Grade 10 student– Not studying mathematics– Takes no mathematics test
October 2009 STAR Order Management 40
Example 3Example 3• Juan
2009– Grade 10 student– Studying an advanced mathematics class– Took the CST for Summative High School
Mathematics 2010
– Grade 11 student– Not studying mathematics– Takes the CST Summative High School
Mathematics
October 2009 STAR Order Management 41
Example 4Example 4• Juliet
2009– Grade 10 student– Studying an advanced mathematics course– Took the CST for Summative High School
Mathematics 2010
– Grade 11 student– Studying Calculus– Takes the CST for Summative High School
Mathematics
October 2009 STAR Order Management 42
Which students takeWhich students takeEnd-of-Course Science?End-of-Course Science?
• Students in grades 9–11 Completing or completed in summer of 2009,
California standards-aligned science course– Review state blueprints– Review curriculum
• All students in grade 10 take the Life Science test Test printed in the grade 10 test booklet (both
CST and CMA) Most grade 10 students will take TWO science
tests
October 2009 STAR Order Management 43
Which students takeWhich students takeEnd-of-Course World history?End-of-Course World history?
• Students in grades 9–11 Completed the World History course in the 2009
summer session or will complete it during the 2009-10 school year
• All students in grade 11 will take the CST for U.S. History The test is printed in the grade 11 test booklet Some grade 11 students will take TWO History–
Social Science tests
October 2009 STAR Order Management 44
EAP EssayEAP Essay
• Grade 11 Order for all students Must be taken in conjunction with additional
ELA multiple-choice questions to achieve an exemption from CSU placement tests upon admission to a campus and participating California Community Colleges
Order entered on the Early Assessment Program administration (EP01)
Approve order separately
October 2009 STAR Order Management 45
Test AdministrationsTest Administrations• Multiple-choice
Up to 8 administrations allowed MC01 – MC08 Each administration should have different date for “First day of
testing” Each administration’s order needs to be approved separately
– Enter orders for ALL administrations before starting approval process– Report for 2010 provides list of schools without orders– Report generated when each order approved
• Writing Application (grade 7 only) Administration WA01
– March 2 with make-up on March 3 if in session on March 2 Administration WA02
– May 4 with make-up on May 5 ONLY if not in session on March 2 Enter and approve order separately from multiple-choice
• Early Assessment Program (EAP) Essay Administration EP01
– March 2 through March 31 Enter and approve order separately from multiple choice
October 2009 STAR Order Management 47
Ordering ProceduresOrdering Procedures
1. Set up test administration dates• See Webcast “2010 STAR Test Administration
Setup”• Manual posted at www.startest.org/sms.html
2. Confirm “Profile” information• Primary Shipping Address• Secondary Shipping Address (optional)
– Can be used for Supplemental Order delivery
• Report Shipping Address (optional)– Used to deliver Reports in summer 2010– Address must be set up before June 1, 2010
October 2009 STAR Order Management 48
Ordering ProceduresOrdering Procedures1. Enter order quantities for each Multiple-Choice,
Writing Application, and the Early Assessment Program administration.
• Screen entry
or• Produce file containing order quantities and
upload
2. Approve order for each administration.
October 2009 STAR Order Management 49
Software DemonstrationSoftware Demonstration
1. Verify Profile
2. Enter order online
3. Approve order
October 2009 STAR Order Management 50
October 2009 STAR Order Management 65
Book count warnings
Schools with no orders
School district can still approve order when warnings exist
Changes to Batch ProcedureChanges to Batch Procedure
• Do not need to zero-fill quantities Numbers must be right-justified E.g., 0012 may also be entered as _ _12
• No special sequence of records required
October 2009 STAR Order Management 72
Order File Upload FormatOrder File Upload Format
October 2009 STAR Order Management 73
• Included in Order Management Manual
• Fixed-length field; text file only
• Orders for one administration only per file
Review and ApproveReview and Approve• Review orders using
Online screens And/or Printouts generated by STAR Management
System• Adjust orders where necessary using
Online entry to adjust quantities• Approve orders
All orders entered through “File load” need to be “Approved” by district STAR coordinator
October 2009 STAR Order Management 76
Excessive Materials Ordered ChargesExcessive Materials Ordered Charges• 90% of the value of materials ordered minus
value of materials used• Be careful ordering!
Do not over-order Large print and braille
– These materials are very expensive
• No excessive order charges for EAP Essay test books
• ETS will invoice approximately December 2010
October 2009 STAR Order Management 78
Excessive Materials Ordered ChargesExcessive Materials Ordered Charges
• Value of materials ordered ($x) Does not include overages Order quantities will be adjusted based
on number of Pre-ID records
• Value of materials used ($y)• If (x-y) ≤ 10%(x) then no charges will
apply • If (x-y) > 10%(x) then charges will
apply
October 2009 STAR Order Management 79
Excessive Materials Ordered ChargesExcessive Materials Ordered ChargesExample 1Example 1
• Value of materials ordered = $5,000• Value of materials used = $4,600• Difference between ordered and used = $400• 10% of materials ordered = $500• Difference ($400) is less than 10% of
materials ordered ($500) No charges will apply
October 2009 STAR Order Management 80
Excessive Materials Ordered ChargesExcessive Materials Ordered ChargesExample 2Example 2
• Value of materials ordered = $5,000• Value of materials used = $4,100• Difference between ordered and used = $900• 10% of materials ordered = $500• Difference ($900) is greater than 10% of
materials ordered ($500) Charge will apply Charge will be $900 – $500 = $400
October 2009 STAR Order Management 81
ReviewReview
• Set up test administration dates NPS schedules may be different from
district schedules
• Enter order quantities for each administration Multiple-choice Writing (CST and CMA, grade 7) EAP Essay
• Approve orders Every administration
October 2009 STAR Order Management 82
TimetableTimetable
• Gather data from sites immediately• Enter orders Now through December 1, 2009• Orders reviewed by ETS throughout
December and January• Adjustments to Initial Orders up until “Order
Sent for Packaging” date• If required, place “Supplemental Orders” after
“Order Sent for Packaging” date• Track Order status
October 2009 STAR Order Management 83
Recommended