Transitioning from STAR to CAASPP 2014 Smarter Balanced Field Test In-Service February 27, 2014 1

Transitioning from STAR to CAASPP

2014 Smarter Balanced Field Test In-Service

February 27, 2014

1

Agenda• New Testing System: California Assessment of Student Performance and Progress

(CAASPP)

• General Overview of Smarter Balanced System

• Smarter Balanced Field Test Overview

• Site Coordinator and Test Administrator Responsibilities

• Test Security, Planning and Logistics for Field Test

• Overview of Student Supports & Accommodations

• Preparing Teachers & Students

• On-line Test Administration

• Classroom Activity & Performance Task

• After Smarter Balanced Testing

• California Standards Tests (CSTs) for Science and CAPA

2

Grades 3 -8

CST/CMA Science

Identified Special Education Students

Math and English Language Arts

Components of 2014 State Tests

Grades 5&8

Grades 2-8

Math and English Language Arts

3

Smarter Balanced Assessments: Improving Teaching & Learning

CommonCore State

Standards

specifyK-12

expectationsfor

college and

career readines

s

All students

leavehigh

school college

and career ready

Teachers and schools have

information and tools they need to improve teaching

and learning

Summative: College and career

readiness assessments for

accountability

Interim: Flexible and open assessments, used

for actionablefeedbac

k

Formative resources: Supporting

classroom-based assessments to

improve instruction

4

2014 SBAC Field Test

5

Field Test Purpose

6

A field test is not designed to be a valid and reliable measure of student achievement; rather, it is designed to help the test developers evaluate whether the tests, individual items, and the technology platform work as intended before the first operational administration.

— Deborah S. Delisle

U.S. Department of Education

Benefits of Field Test Participation• Students will have hands-on experience with

the functionality of a computer-based assessment.

• Teachers and administrators will gain valuable exposure to administration logistics during a trial run.

• Local educational agencies (LEAs) will benefit from having learned where technology gaps may exist, and then can fully prepare for operational assessments.

7

Smarter Balanced Spring 2014 Field Test Overview

• Field Test window for BCSD: April 7– May 16, 2014• April 10-11 and May 8-9 are black-out days for testing• April 14-21 Spring Break• 20 school days for testing

• Grades 3–8: All students are expected to participate with the exception of• CAPA students• EL less than 12 months do not test in ELA but do test

in math • (R&E to provide translation of SAY Boxes upon

request)• Parent exemptions

• Signed parent letters8

CA TAM 7, 29-30

Smarter Balanced Spring 2014 Field Test Overview

• Test will be approximately 3.5-4.5 hours long though it is untimed

• No paper-and-pencil version will be available

• No student, school, or district score reports will be produced

• Results will not be factored into any state or federal accountability calculations

9

Smarter Balanced Spring 2014 Field Test Overview

Each participating student in Grades 3-8 willexperience:

• 25 ELA questions• 25 mathematics• 1 performance task

• Either ELA or Math• We will be assigned one by March 10, 2014

• R&E to inform schools

10

Smarter Balanced Spring 2014 Field Test Overview

11

Item Types

• Selected Response (SR)• Previously multiple choice

• Constructed Response (CR)• Items of greater complexity than SR. Require more analytical thinking and reasoning; develop

answers without suggested answer choices.• Extended Response

• Short text and essay• Performance Tasks (PT)

• Requires a classroom activity and independent student response. Measure capacities such as depth of understanding, interpretive and analytical ability, basic recall, synthesis, and research

• Technology- Enabled• Video, animation, sound• Respond with SR or CR

• Technology- Enhanced• Students manipulate information • Require students to do something other than write text or numbers, or select from among a set

of options such as reordering text, selecting and changing text, selecting text, and selecting from drop-down menus

CA TAM 71

Roles and Responsibilities

12

New Terminology for Roles

Other important roles◦ LEA Technology Coordinator (John Deaton) ◦ LEA CALPADS Administrator (Robert Burks)

Smarter Balanced terminology California terminology

District Test Coordinator (DC) LEA CAASPP Coordinator

School Test Coordinator (SC) Test Site Coordinator

Test Administrator (TA) Test Examiner and Test Proctor

13

Roles and ResponsibilitiesTEST SITE COORDINATOR (SC)

• Collect security affidavits from Test Administrators (TAs) and retain at your test site.

• Train TAs• Submit appropriate supports and

accommodations to R&E.• Ensure that testing in the school is

conducted in accordance to test security policies.

• Create test schedules and procedures for the school.

• Report test security incidents to R&E• Monitor testing and address problems,

as needed.

TEST ADMINISTRATOR (TA)

• Read and sign new security affidavit.

• Attend test administration training.• Confirm student information prior

to testing, to ensure it is correct.• Ensure that appropriate designated

supports and accommodations have been set prior to testing.

• Set up test sessions & proctor testing.

• Report test security incidents to SC.• Encourage students to do their best.

14

CA TAM 9-10

Test Security

15

New Test Security Forms for the 2013–14 School Year

• Site Coordinators must sign the new CAASPP Test Security Agreement and retain at the LEA.

• Test Administrators must sign the new test security affidavit and provide a copy for LEA.

• Forms specify no reviewing, discussing, or analysis of test items, reading passages, or writing prompts at any time during between, or after sessions.

• Agree to not email, fax, or replicate items.

• No form or type of answer key may be developed for items

CA TAM 20-22

16

17

Test Security There are three different types of test security incidents that must be reported:• Impropriety• Irregularity• Breach

Notify R&E within 24 hours for processing and next steps.

CA TAM 23-24, 63-70

18

Test Impropriety

• Unusual circumstance that has a low impact on the testing individual or group of students

• Low risk of affecting student performance, test security, or test validity

• Correctable and containable at local level

• Example: Students talking during testing

19

Test Irregularity• Unusual circumstance that impacts the testing individual or

group of students• May affect student performance, test security, or test validity• Correctable and containable at the local level• Submitted in the online system for resolution of the Appeal

for testing impact

• Examples: Student cheating or providing answers to another; student accessing or using electronic equipment (e.g., cellphone)

20

Test Breach• Event that threatens test validity (e.g., release of secure

materials)• External implications for the Consortium

• Examples: − Administrator or coordinator modifying student

responses or record at any time− Administrator allowing students to take home test items,

passage, prompts, or scratch paper

21

Planning and Logistics

22

Field Test Details • Preparation Checklist in CA TAM page 79-89

• Secure Web Browser has been downloaded for you.

• Test Administrator & Proctors = State-certified schoolstaff that have been trained to use the Smarter Balanced Testing system need to be present in each testing room.

CA TAM 9

Planning and Logistics

23

Integration of LEA and CDE Student Information Systems

Integration with CALPADS• CALPADS is the sole source for student demographic data• Frequent data extracts from CALPADS• First data pull was February 18, 2014

Test registration system• CALPADS information is transferred to TIDE (Test Information

Distribution Engine)• TIDE is the system used to manage student information and user

accounts for online testing.• Since data is already loaded in TIDE, school coordinators will

primarily utilize this system for look-up. • Username and passwords will be emailed to you.• Student demographic/program data cannot be changed by LEAs

once in TIDE• LEAs will be responsible for providing accommodations data

CA TAM 28

Testing Times and SchedulingThe Field Test is expected to take 3.5 to 4 hours to complete

◦April 7 – May 16◦ Field Test◦ Black-out days

April 10-11 & May 8-9

CA TAM 35-36

24

Scheduling Testing Time: • Recommended administration:

• First: Non-PT section• Second: Classroom Activity • Third: Individually administered on-line PT

(Classroom & PT not on the same day)

• Administering the PT section:• Classroom activity should be completed within 3 days

prior to starting the PT.• ELA: 2 parts; can be completed in 2 days.• Math: 1 part; can be completed in 1 day.

CA TAM 37

25

Tentative Schedules

26

Scheduling Considerations for Special Populations

•Ensure that TAs know which students are not to test.

• Will appear in TIDE but should not be tested:• CAPA students. • Students with Parent Exemptions will not be tested

•English Learners 12 months or less should not take ELA

•Schedule activities for students not taking exam (or that finish early).

27

CA TAM 29-30

Smarter Balanced Usability, Accessibility, and Accommodations

Guidelines

28

Smarter Balanced Usability, Accessibility, and Accommodations

GuidelinesThree types of student support offered:

1. Universal tools2. Designated Supports3. Accommodations

29

CA TAM 45-47 reference

The Guidelines document is available on the CDE Smarter Balanced Accessibility and Accommodations Web page at http://www.cde.ca.gov/ta/tg/sa/access.asp.

Accommodations Module

Universal Tools, Designated Supports, and

Accommodations

30

EmbeddedColor ContrastMaskingText-to-speechTranslated Test DirectionsTranslations (Glossary)Translations (Stacked)Turn off any Universal Tools

Non-embeddedBilingual Dictionary,Color Contrast,Color Overlay,Magnification,Read Aloud,Scribe,Separate Setting,Translation (Glossary)

EmbeddedAmerican Sign Language,Braille,Closed Captioning,Text-to-speech

Non-embeddedAbacus,Alternate Response Options,Calculator,Multiplication Table,Print on Demand,Read Aloud,Scribe,Speech-to-text

EmbeddedBreaks, Calculator,Digital Notepad,English Dictionary,English Glossary,Expandable Passages,Global Notes,Highlighter,Keyboard Navigation,Mark for Review,Math Tools,Spell Check,Strikethrough,Writing Tools, Zoom

Non-embeddedBreaks,English Dictionary,Scratch Paper,Thesaurus

1. Universal tools: available to all students.

Usability, Accessibility, and Accommodations Guidelines

31

Embedded Tools

Highlighter Digital Notepad

English Glossary

Expandable Passages

Global Notes

English Dictionary

Keyboard Navigation

Mark for Review

Strike Through

Writing Tools

Non Embedded Options

Breaks English Dictionary

Scratch Paper

Thesaurus

UAA Guide Glossary 6-17

Grades 3–5 Calculator Policy• Do not allow for calculator usage.

Grades 6–8 Calculator Policy• Mathematics assessments are divided into two sections:

Calculator Available and Calculator Not Available.

• Grade 6 allows an online four- function‐ calculator during the Calculator Available section.

• Grades 7 and 8 allow an online scientific calculator during the Calculator Available section.

Usability, Accessibility, and Accommodations Guidelines

32

2. Designated supports, available to identified students, including English learners, struggling readers, and students with attention deficits that the student has been using during instruction or other assessments.

Examples include color-contrast text, the blocking of distracting content, stacked translations, and bilingual dictionary.

Translation of test math instructions and items are available.

Usability, Accessibility, and Accommodations Guidelines

33

UAA Guide Glossary 6-17

3. Accommodations, available to students with an individualized education program or a 504 plan that specifies the need for such an accommodation. Examples include closed captioning, Braille, calculator, and scribe.

R&E staff will input designated support and accommodations, process is on next slide.

34

Usability, Accessibility, and Accommodations Guidelines

UAA Guide Glossary 6-17

Accommodations & Supports Checklist for IEPs, 504s & ELs*

35

Highlight all that apply for students currently using these tools during instruction

*ELs less than twelve months

Complete and return to R&E no later than March 24th

Preparing Staff and Students for the Field Test

Recommended Training ModulesModule Time TA StudentsTest Administration Overview

Includes portions of TA and Student Interface

55:00 X

TA Interface 17:00 XPerformance Task Overview 11:13 XLet’s Talk Universal Tools 14:07 X XStudent Interface 22:48 XWhat is a Field Test? 5:52 X XAccessibility and Accommodations

35:00 X(Sp Ed)

37

CA TAM 17-18

Resources: Training Test and Practice Test

Training Test Practice TestPurpose Provide students with an

opportunity to quickly become familiar withthe software and interface features

Provide students with a grade specific testing experience that is similar in structure and format to the field test

Grade Levels Grade bands•3-5•6-8

Each grade•3-8

Number and Types of Items

Approximately 15 items per grade band (6 in ELA and 8-9 in math)

No Performance Tasks

Approximately 30 items in ELA and 30 items in math per grade level

Includes 1 ELA PT and 1 math PT per grade level

Universal Tools, Designated

Supports, and Accommodations

All included on field test are included

Most includedRefresh scheduled for late April

38

CA TAM 30

Practice and Training TestsCalifornia Smarter Balanced Portal: http://sbac.portal.airast.org/ca/practice-test-ca/

39

For student Interface option:“Guest User” is defaulted and sign in

For TA Interface option:Uncheck default “Guest User” to practice authentically creating session and student login.

Field Test Administration

Establishing Appropriate Testing Conditions

• Remove or cover displayed information that might be used by students to help answer questions including: • Rubrics, vocabulary charts, student work, posters,

graphs, charts, etc.

• Cell phones or other electronic devices are not allowed to be used during testing (i.e., turned off and put away). Post an “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session”

• Place a “TESTING—DO NOT DISTURB” sign on the door.

• May also be helpful to post signs in halls and entrances rerouting hallway traffic.

41

CA TAM 28, 48-51

Establishing Appropriate Testing Conditions

Establish procedures to maintain a quiet testing environment throughout the test session.• Remember that some students will finish more quickly

than others.

Plan quiet activities for students who finish early

42

Basic Test Rules During the Field Test

• Students must answer all test items on a page before moving on to next page.

• Within each test there may be segments. A student may not return to a segment once it has been submitted.

• Students must answer all test items before ending their test.• Students may not return to a test once it has been submitted.• Students may flag a response and return to it before ending

their test.• Students may use scratch paper but it must be collected and

shredded at the end of each test session.

43

CA TAM 32

Accessing the Field Test: http://sbac.portal.airast.org/ca/field-test-ca/

• Select [Field Tests].

• Select [TA Interface for California Users].

44

TA Interface: Teacher Login• User Names & Passwords will be

emailed once uploaded. • Confirm teachers who need

administration access. • Default will be all teachers

• Submit names to R&E no later than March 7, 2014

• The first time logging on, you will be required to change your password. Write it down, we do not have access to it.

45

Starting a Test Session

Click ‘Start Session’• Select test to be administered

• Tab will turn red and will change name to“Stop Session”

• Write Session ID on the board for students to log into your test session

46

Student Login: Joining TA’s Session• Click Secure Browser icon

• All other applications must be closed

• Prior to Student Login: TAs must follow the “DFA SAY” script exactly each time a test is administered. Refer to the DFA section of the CA TAM page 51.• Please contact R&E for Spanish Translation of

“DFA SAY” boxes

• Student will need:− Confirmation Code: Student’s legal first

name as spelled in CALPADS− State-SSID: State abbreviation (CA)

followed by a hyphen and the student’s Statewide Student Identifier

− Session ID 47

Student Login Data Cards R & E will provide a Sign-In Card with Student Login Data

• Junior High/Middle Schools consider how you want cards sorted

Delivered to school sites prior to testing window• Use the information cards during the “Training Test” for

students• Students will type information EXACTLY as printed

Collect students cards after each administration and keep secure

48

Student Login: Verify & Select Test

49

• Students will be prompted through a series of questions prior to starting their test session

Student Login: Sound Check

50

• Students may be prompted to do a sound check if taking ELA test with listening portions.

• If prompted, students should have headphones on and press green button to test volume and then press ‘Yes, I heard the voice’ or adjust as needed.

Student Login: Test Instructions

51

• Student have a “Help Guide” available at anytime

• Menu of keyboard commands• Students can “Begin Test Now” or “Cancel”

Reminder: Student Universal ToolsAll students have the ability to:• Highlight text in passages and test questions• Zoom in and out of test pages (affects all item

content)• Mark specific items for review• Strikethrough (cross out answer options)• Use the Notepad or Calculator (depending on the

test)• Use the [Expand] button to display a reading passage

or a science simulation

UNIVERSAL TOOLS MODULE 52

CA TAM 45

Student Technology Ribbon• Ribbon tools will vary depending on type of item

• Test will automatically “Save” but it is recommend that students save during their essay

53

TA Approve Students for Testing• TAs can either select [Approve] for each individual

student or select [Approve All Students].

• Reminder: If any student’s test settings are incorrect, do NOT approve that student.

• To refresh the list of students awaiting approval at any time, select the [Refresh] button at the top of the pop-up window.

54

TA Actively Monitors

• The “Students in Your Test Session” table displays students who have logged in and been approved for testing.

• Screen displays the item the student is currently solving and which students are paused (by inactivity or choice)

• Actively proctor for student engagement

55

Pausing/Stopping• Through the Test Administrator Interface:

• Stop an entire session; or • Pause individual student tests.

• Users should exit or log out of the Test Administrator Interface only after stopping the test session.

• If there is a technical issue (i.e. power outage or network failure), students will be logged out and the test will automatically be paused.

• Regardless of when or how users log out or navigate away from the Test Administrator Interface, student data will NOT be lost.

Note: If a test is paused for any reason or length of time, the student must log in again to resume testing. Highlighted text and item notes will not be preserved.

56

CA TAM 33

TA Interface: Pausing/Stopping

57

Pause Rules

• During the Non-Performance Task, if testing is paused for more than 20 minutes, the student is:• Presented with the test page containing the test item he or she was last working on

(if page contains at least 1 unanswered item) OR• Presented with the next test page (if all items on the previous test page were

answered); • NOT permitted to review or change any test items on previous test pages.

58

• There is no pause rule for the Performance Task.• Even if a test is paused for 20 minutes or more, the student can return to the

current section and continue. • ELA PTs are divided into 2 parts. After a student completes Part 1, he or she

cannot return to it.

Note: If a test is paused for any reason or length of time, the student must log in again to resume testing. Highlighted text and item notes will not be preserved.

Test Timeout Due to Inactivity• As a security measure, students are

automatically logged out of the test after 20 minutes of inactivity.

• Activity means: • Selecting an answer• Using a navigation option in the test (i.e. selecting [Next] or [Back], using the Past/Marked

Questions drop-down list)• NOTE: Moving the mouse or selecting an empty space on the screen is NOT considered activity.

• Before the system logs out, a warning message will be displayed. • If a student does NOT select [Ok] within 30 seconds, the student will be logged out.• Selecting [Ok] will restart the 20 minute inactivity timer.

59

CA TAM 34

Student Reviewing of Items

60

Student Ending the Test

61

TA Stopping Tests: Entire Session• To stop the session (and pause tests for all students in the

session):• Select the [Stop Session] button in the upper-left corner of the

screen. • An “Important!” box will appear, requesting verification to end

the session and log students out.

• Select [OK] to continue or [Cancel] to keep the test session open.

62

Performance Task

63

Two Components:

Whole Class Activity

Student Independent Response

Classroom Activity Administration Guidelines

• Classroom Activity Purpose: To provide students with important context, concepts, and key terms prior to taking the PT.

• All students will have a classroom activity before they complete the PT. All students need to actively participate.

• Site Coordinator will be notified to download the assigned classroom activity and provide to Test Administrators at least 1–2 days prior to prepare materials.

Performance Task Module

64

CA TAM 49-50; Checklist TAM 81

Classroom Activity Administration Guidelines

• Designed to fit into a 30-minute window.• Will vary due to complexity of topic and individual student

needs.• Provide the appropriate accommodations for students who

normally use them during instruction.

• Recommended: No more than a 3-day lapsebetween the classroom activity and the PT administration.

65

Classroom Activity Administration Guidelines

• May be administered in a classroom or any other appropriate space. TA may need a chalkboard or dry-erase board.

• Students may take notes during the classroom activity,but the notes must be collected before proceeding to the PT.

• PT will be completed by individual students in the computer-based test delivery system.

66

Classroom Activity & Performance Task Administration Process

Step 1: Site Coordinators will identify the classroom activities for your school.

• Assigned by grade for each individual school.

• Assignments will be posted on the SBAC portal.• Locate your state and then use

the menus within the file to filter for your school.

• Beside the name of the school will be a listing of the classroom activities assigned to each grade/content area.

67

Classroom Activity & Performance Task Administration Process

Step 2: Site Coordinators will download the classroom activity. • Materials are posted on the site in alphabetical order.

Step 3: Test Administrators will review the teacher directions for the classroom activity.

Step 4: Test Administrators will complete the classroom activity.• Site Coordinators should ensure that the Test Administrator has

presented the classroom activity prior to performance task administration.

• Classroom activities include directions associated with that specific classroom activity.

68

Classroom Activity & Performance Task Administration Process

Step 5: Administer the make-up classroom activity- may require Test Administrator to be the student partner.

Step 6: Administer the performance task after classroom activity.

• The students must work independently

• The PT is administered online

• ELA PT Components:Part 1: Students will read sources and answer three research questions. • Students may take notes electronically or on paper• Test Administrators are to collect and secure scratch paper and redistribute to student for Part 2

Part 2 (full write): Students will provide a written response using those sources. • Students are allowed a hard copy of dictionary or thesaurus/on-line option availableRecommended: Each part administered on separate days.

• Math PT Component: One part: Student will receive a stimulus (ex. Chart) and respond to items.Recommended: To be administered in 1 session.

69

After Smarter Balanced Testing• Shred Test Materials

• Student Sign-in Cards• Scratch Paper

70

CA TAM 57

STAR: Paper and Pencil Testing

71

Overview of Responsibilities

Materials◦ Verify inventory and notify R&E within 24 hours of receipt◦ No access to test materials before first day of testing◦ Daily inventory - in/out logs◦ Prepare for return

Provide training for examiners◦ Use DFAs for training

Identify testing locations◦ Determine Quiet Room◦ Conduct Environmental Sweeps - instructional materials directly related to test content

must be removed

Keep track of students needing make-ups

◦ All informati on posted on R&E website – htt p://www.bcsd.com/research/STAR

72

Save Me

CST/CMA Science - Grades 5 & 8

Students Eligible for CMA◦ Have an IEP that specifies CMA and subject(s)◦ May take CMA for some subjects; CST for others◦ If CMA, not eligible to take CAPA◦ Must be tested separately from CST

Examiners and Proctors◦ Must be district employees (certificated preferred)◦ Includes long-term subs and daily subs◦ Must be trained◦ Must sign Test Security Affidavit

73

CAPA – Grades 2-8 Performance-based

◦ Administered one-on-one◦ For students with significant cognitive disabilities

unable to take CST or CMA

IEP must specify CAPA level

Mark CAPA Level in 7a

74

CAPA – Grades 2-8 Schools double-rate ten percent (10%) of CAPA students per level

◦ R&E randomly selects and will send to sites before Spring Break

Observers must mark Observer and sign the answer document

75

For the observer,complete the following fields on a blank document

1 Name, etc.

3 Date of Birth

5 Name

6 Gender

7a CAPA Level

7b Grade

11 Student ID

12 SSID

76

CAPA – Grades 2-8

Test Administration Use Directions for Administration (DFAs)◦ Read “SAY” boxes exactly as written

◦ Students fill out Section 1

◦ Use district-provided translations only ◦ Cannot translate test questions, prompts, or passages

Additional materials◦ No. 2 pencils with erasers◦ Scratch paper (math and science tests only)

◦ Must collect from classrooms and shred

Quiet Activities77

Back of Answer Document A1 for R&E use, only

A2 Special Conditions◦ Grid specific condition for content area(s)

A3 Accommodations and Modifications◦ a. Grid IEP or Section 504 Plan even if

accommodations or modifications not used◦ b. Grid specific accommodation for content area(s)

A4 English Learner Test Variations ◦ Grid specific variation for content area(s)

78

Scorables & Nonscorables• Transcribe damaged answer docs/booklets to a new

matched version document

• Place new document with Scorables

• Write “Void Damaged” on damaged document and place with Nonscorables.

• Pre-id students who left before first day of testing Write “Void Moved” and place with Nonscorables

79

Organizing Materials for Return

• Separate Scorables from Nonscorables

R&E will organize and pack

80

Documents with No Pre-Id

R&E will: hand grid demographics, SGID, & Master File Sheet

81

Pick-Up Schedule

82

CAASPP Testing Pick-up ScheduleGrades 5 & 8

May 7 - 9, 2014

Please have your materials ready. We are on a very tight schedule.

Approximate TimeWednesday

May 7Thursday

May 8FridayMay 9

  Team A Team B Team A Team B Team A Team B

8:30 Hills Sequoia Owens Intermediate Williams Jefferson Harding

9:15 Longfellow Wayside Owens Primary Horace Mann Noble Compton

10:00 Downtown Casa Loma Fremont Mt Vernon College Heights Chavez

10:45 Munsey Pauly McKinley Garza Eissler Thorner

11:30 Curran Frank West Emerson Sierra Chipman Hort

Lunch            

1:00 Harris Evergreen Roosevelt Pioneer Nichols Stiern

1:45   Washington Wm Penn Voorhies Franklin