2013 STAR Reports Preview

2013 STARReports Preview

May 22, 2013

May 22, 2013Webcast starts at 9 a.m.Mark Hansen and Michael McDaniel

2013 STAR Reports Preview Webcast | May 2013

2013 STAR Reports Preview Agenda

May 22, 2013

Objectives: Identify the reports districts receive; understand the information provided on each report and how to use the information

• Shipment Schedule and Packaging • Student Reports

– CSTs (California Standards Tests) – CMA (California Modified Assessment)– CAPA (California Alternate Performance Assessment)– STS (Standards-based Tests in Spanish)

• Individual Reports• Summary Reports • Data CD• Quick-turnaround Reporting

2


What’s New for 2013

May 22, 2013

• Quick-turnaround Reporting is now available for the spring 2013 administration.

• STS performance levels—advanced, proficient, basic, below basic, and far below basic—are now also reported for RLA in grades eight through eleven and EOC Algebra I and Geometry.

• ELA scale scores for the grades four and seven CSTs and CMA will be provided based on the multiple-choice items only.– The reporting cluster “Writing Applications” is no longer part of the

CST and CMA ELA cluster groups.– The writing score is provided as a standalone score called “Writing

Response Score.”3


When Will Report Information Be Delivered?

May 22, 20134

What? When Scheduled?

Quick Turn-around Reporting

2–3 weeks after receipt of test materials

Paper reports August 8 (if test returned by July 1, 2013)

Internet Reports Mid August, 2013

Post-Test Guide

Posted End of July, 2013

Hard copy delivered After August 13, 2013

Post-Test Workshop August 7, 2013


Shipment Schedule for Single Administration Districts

May 22, 2013

• One shipment of reports contains:– All individual reports including Student Reports for CST,

CMA, CAPA, and STS– Student Report Interpretation Guides

English only, except for STS (English and Spanish)– Unmatched reports– All summary reports– Data CD– EAP Roster (if applicable) – DVD-ROM containing Student Report PDFs (if ordered

on Processing Form) 5


Shipment Schedule forMultiple Administration Districts

May 22, 2013

• One shipment per administration• Early shipment(s) contain:– Student Reports (CST, CMA, CAPA, and STS)– Student Report Interpretation Guides– Student Master List– Student Record Labels– Unmatched reports – Data CD– EAP Roster (if applicable)– DVD-ROM containing Student Report PDFs

(if ordered on Processing Form)

6

Note: Summary (aggregated) reports are not available for early shipments.

2013 STAR Reports Preview Webcast | May 2013 May 22, 2013

• Final shipment contains:– All remaining individual reports including Student

Reports (CST, CMA, CAPA, and STS)– Student Report Interpretation Guides– All summary (aggregated) reports– Unmatched reports– Data CD– EAP Roster (if applicable)– DVD-ROM containing Student Report PDFs

(if ordered on Processing Form)

7

Shipment Schedule forMultiple Administration Districts


Student Reports

May 22, 2013

• CST, CMA, CAPA, and STS• Receive two report copies for each test students took.– Send one report to parent/guardian within 20 working

days of receipt.– Forward the school shipment, which contains a second

copy for students’ current teacher.

8


CST Student Report Example

May 22, 20139


STAR Student Report

• Address on LEFT– Same position as the 2012 STAR

Student Report and the CAHSEEStudent Report

– #10 left window envelope– Address includes POSTNET

barcode• Statewide Student Identifier

(SSID) (“Student #”) and localidentification number (“Local ID #”) printed

• Student name printed on front and back

May 22, 201310


CST, CMA, and STS Student Report, Front

• Scale scores• Performance levels

May 22, 201311

CST Grade 7 Example


CST, CMA, and STS Student Report, Back: Reporting Clusters• Number and percent correct• Comparison to statewide proficient scores

May 22, 201312

CST Grade 7 Example


CST, CMA (4–7) Writing Response Scores

May 22, 201313

• Shows score from 1–4• Shows rubric used to determine that score

Note: The writing score is NOT combined with the multiple-choice score to calculate the ELA score.

CST Grade 7 Example


CMA Student Report Example

May 22, 201314


CMA Student Report, Front

• Scale scores and performance levels for:

May 22, 201315

– ELA– Mathematics

– Science

CMA Grade 8 Example


CMA Student Report, Back

• Reporting clusters for ELA, Mathematics, and Science– Number and percent correct– Comparison to statewide proficient scores

• Description of the CMA

May 22, 201316

CMA Grade 8 Example


CAPA Student Report Example

May 22, 201317


STS Student Report Example

May 22, 201318


STS Student Report, Front• Scale scores and performance levels for all tests– RLA (including grades 8–11)– Mathematics (including Algebra I and Geometry)

May 22, 201319

STS Grade 5 Example


STS Student Report, Back• Reporting clusters for all tests– Number and percent correct

• How to use the STS results

May 22, 201320

STS Grade 5 Example


Student Record Labels

• Add to students’ permanent record– Schools are responsible for affixing labels to each pupil’s

permanent school records or for entering the scores into electronic pupil records. [California Code of Regulations, Title 5, section 863(c)]

• Includes SSID number and, if provided, local student ID number

• Available for:– CSTs/CMA– CAPA– STS

May 22, 201321


CST/CMA Record Label

May 22, 201322

CST/CMA Grade 3 Example


CAPA Record Label

May 22, 201323

CAPA Grade 5 Level III Example


STS Record Label

May 22, 201324

STS Grade 8 Example


Student Master List

• Report that contains details of results for each student• For all grade-level and EOC CSTs, CMA, and STS, the report

includes:– Percent correct for each reporting cluster– Scale scores– Performance levels

• For the CAPA, the report includes:– Scale scores– Performance levels

May 22, 201325


Student Master ListSort Sequence

• School• Grade• Test type– CSTs/CMA– CAPA– STS

• Alphabetical order by last name

May 22, 201326

Note: STS data are not matched with CST, CMA data.


Student Master List

May 22, 201327

CST/CMA Grade 3 Example


Summary Reports

• Review data on reports and use to develop reports for your school or district.– Do NOT compare across grades or across subjects.

• Student Master List Summary includes CSTs, CMA, CAPA, and STS results.

• Student Master List Summary: End-of-Course (EOC) includes EOC results for CSTs, CMA, and STS.

• Subgroup Summary includes results for CSTs, CMA, CAPA, and STS.

May 22, 201328


Student Master List Summary

May 22, 201329

Grade 7 Example


Student Master List Summary

May 22, 201330

Grade 3 Partial Example


Student Master List SummaryEnd of Course

May 22, 201331

CST for Biology Example


Subgroup Summary

May 22, 201332

Grade 5 Gender Example


Subgroup Summaries• Compare results among different student demographics– Gender– Disability status

(CAPA, specific disability)

– Economic status– Ethnicity

Two or more races

– English proficiency– Ethnicity for economic status

May 22, 201333


Subgroup Summary

May 22, 201334

Grade 5 Gender Example


Data CD—Text Format

• Two files• Three record types

• EAP status data – Reported in file; four positions, 407–410

• 2013 Student Data File Layout– Layout description included in shipment– Contact STAR TAC for questions – Download from www.startest.org/reports.html in

mid-June

May 22, 201335

– 01 = CST/CMA – 02 = CAPA – 03 = STS


Data CD—XML Format

• One file– Two companion files on www.startest.org/reports.html:

.xsd = Schema .xsl = Data layout

– Available at the end of June• Easy to import data into other formats– Access database

May 22, 201336


Quick-turnaround Reporting (QTR)

May 22, 201337


• QTR is a module of the STAR Management System that makes a data file available that contains early student-level results for the CSTs and CMA.

• QTR data file is available upon completion of an entire administration once all scorable test booklets and answer documents for that administration have been received at the STAR Processing Center in Iowa City, IA, and certified by Educational Testing Service.

• The school district will be notified via e-mail that all CST and CMA tests in the administration have been certified and a QTR file is ready for download.

May 22, 201338

QTR—Background


QTR—Background, continued

May 22, 201339

• QTR data files contain results data for CST and CMA multiple-choice tests:– Scale-scores– Performance-levels– Associated student-identification and test-taken

information• It is important to remember that these are preliminary

results only; the results may change in the reports that are shipped to districts.


1. Log on to the STAR Management System.

May 22, 201340

QTR—Access


2. Select the Quick-turnaround Reporting button in the left navigation bar to open the “Quick-turnaround Reporting” application window.

May 22, 201341

QTR—Access, continued


QTR—Access, continued

3. Select a file-name link for the QTR file you wish to download.

4. Select the Save button in the File Download dialog box to download the file or the Open button to open it.

5. Use your zip archive application to extract the contents of the file.


• Available on the “STAR Management System” Web page at http://www.startest.org/sms.html:– Quick-turnaround Reporting Manual– Student Data Layouts

Fixed-format file—“_FIX.txt.zip” extension Tab-delimited format file —“_TAB.txt.zip” extension

May 22, 201343

QTR—Documentation


Questions ?

May 22, 201344


• For STAR technical questions:STAR TAC—800-955-2954

• For STAR policies: CDE—916-445-8765

• For accountability questions:CDE Academic Accountability Unit—916-319-0863

More Questions?


Next Webcast:2013 Post-Test Workshop

August 7, 2013Webcast starts at 9 a.m.

May 22, 201346

Documents

2013 STAR Reports Preview