Download pdf - Is Your District Ready for Computer Adaptive Assessments ...€¦ · CAASPP (2015)! SBAC Summative Computer Adaptive Tests (CAT) or;! 3 year paper-and-pencil option for schools that

Is Your District Ready for Computer Adaptive Assessments?!

San Juan Unified School District!

Educate!Inspire!Succeed!Contribute!

Carl Fahle!Senior Director, Technology Services!San Juan Unified School District!

AB 484 – CAASPP (Formerly CALMAPP, Jan 7, 2014)!

❖  Establishes a New Statewide Student Assessment System!❖  CAASPP – California Assessment of Student Performance and Progress!❖  Assessments Aligned to Common Core State Standards!❖  Includes Computer Delivered Assessments – SBAC Computer Adaptive Assessments (CAT)!

STAR (2013)!❖  CST/CMA/CAPA ELA!❖  EAP Writing (ELA)!❖  CST/CMA/CAPA Math!❖  CST/CMA/CAPA Science!❖  CST End of Course Science!❖  CST Social Science!❖  STS (Spanish)!

CAASPP (2014)!❖  CAPA ELA & Math (gr 2-11)!❖  CST/CMA/CAPA Science (gr. 5, 8, 10)!❖  EAP Writing & ELA (gr. 11)!❖  EAP Algebra II (gr. 11)!❖  EAP HS Summative Math (gr. 11)!

CAHSEE!

CELDT!

FITNESSGRAM!

CHSPE - GED!

Fahle – San Juan USD – Jan 17, 2014!

SBAC Computer Adaptive Assessments (CAT)!❖  Emphasizes a Balanced Assessment System!

❖  CAT Summative Assessments (Mandatory)!❖  CAT Interim Assessments (Optional)!❖  Formative Assessment Practices and Strategies (SBAC Digital Resource Library) – March 2014!

CAASPP Field Test (2014) – 6 weeks between Mar 18 – Jun 6, 2014!❖  Smarter Balanced Computer Delivered Field Test - ELA, Math and one Performance Task (Sampling)!

❖  Grades 3-8 (95% Students, Sampling of ELA, Math and one Performance Task)!❖  Grades 3-8 (5% Students, Sampling of ELA or Math and one Performance Task)!❖  Grades 9-10 (Sampling from Select Schools and Students for Scientific Study)!❖  Grade 11 (Sampling from Select Schools and Students for Scientific Study)!

Untimed • No paper and pencil version of the Field Test • No published scores • Not Adaptive!

CAASPP (2015)!❖  SBAC Summative Computer Adaptive Tests (CAT) or;!

❖  3 year paper-and-pencil option for schools that do not yet have the infrastructure and/or computing devices to support computer adaptive testing!


San Juan USD Strategic Plan!

The Big Picture!Strategy I!

Ensure all staff are implementing effective instructional strategies, integrating technology and utilizing assessment data to actively engage each student to increase achievement on state standards, 21st century skills, and personal educational plans.!!Strategy IV!

Design and implement a system that creates challenging personal educational plans.!!Strategy V!

Integrate relevant technology into teaching, learning and system operations to best achieve our mission and objectives.!


Building Capacity for Computer Based Assessments!

System Preparation and Capacity!

❖  Technology Infrastructure and Computing Devices!Bandwidth, Network Reliability, Sufficient Compatible Computing Devices and Peripherals (e.g., headphones)!

❖  Logistics and Support!Scheduling, Test Environment, Makeups, Additional Time, Space Requirements, Technical Issues, Hardware/Network Failure, etc.!

❖  Human Readiness/Resiliency – The Four C’s!Culture, Capacity, Collaboration and Communication!

❖  Practice, Practice, Practice!Once a year will not provide sufficient opportunity for identifying and working through issues, building capacity, and improving process and procedures!


Driven by a Larger Objective!“The Application of Technology to Power 21st Century Student Learning and Teaching and Support for the Common Core State Standards”!

!

❖  Our Essential Question!What do we already have and how should we invest to provide the resources and environment to feasibly manage large numbers of student computing devices at scale, provide access to CCSS aligned digital learning resources (DLR), and maintain a relentless focus on learning objectives, student outcomes, and high-yield instructional strategies? !

Technology Infrastructure and Computing Devices!


Technology Infrastructure and Computing Devices!

Our Best Thinking and Current Approach for San Juan !The technology, as far as possible, should be Fast, Flexible, Friendly and ultimately, “Invisible”!

❖  Infrastructure:!❖  Bandwidth capacity to support multimedia rich learning environments!❖  Wireless environments to support flexible/responsive learning environments and

instructionally driven needs and decisions!

❖  Computing Device:!❖  Enterprise level management and rapid deployment!❖  Cost effective (approaching the threshold for “consumable resource”)!❖  Simple and Intuitive: easiest to train, support, manage and maintain!❖  Able to access DLR’s, support digital literacy skills within CCSS, and leverage the

vast information and resources of the Internet and Cloud applications!


Logistics and Support!

A Collaborative and Tiered Approach!Scheduling, test environment, makeups, additional time, space requirements, technical issues, hardware/network failure, etc.!

❖  Cross Division, Centralized Coordination/Support!Div. Teaching and Learning, Accountability, Evaluation and Planning (AEP), Technology Services (Hardware Support, Network Services, GAFE/Chromebook Management, SIS-CALPADS, and Support Desk)!

❖  User-Based Training Teams (Lead Contacts)!Site Administration, Site Leadership Staff, Site Technical Staff or Volunteers!

❖  Support Desk Routing and Triage!Phone Support, Trouble Shooting, Spare Computing Devices, Rapid Response and Communication!


Logistics and Support!

Professional Development for the End User!❖  Learning basic functionality of the computing device (hardware)!

❖  Learning how to administer computer adaptive assessments (software)!

❖  Learning strategies for dealing with “technical issues” (troubleshooting)!

❖  Interpreting and analyzing interim assessment results (data analysis)!

❖  Personalizing instruction based on individual results (goal setting)!

❖  Posting real-time updates and sharing feedback via an online, communication/collaboration forum and knowledgebase (communication)!

❖  Providing ongoing training, and refresher computer adaptive testing PD prior to interim and formative assessment testing windows (systematized support)!


Human Readiness/Resiliency – The Four C’s!

Culture, Capacity, Collaboration and Communication!There is nothing more difficult to take in hand, more perilous to conduct, or more uncertain in its success, than to take the lead in the introduction of a new order of things.” — Niccolo Machiavelli, The Prince (1532).!

CULTURE!This will be a very big shift for some of your most veteran educators. Change is hard, and is made worse when concerns and criticisms appear to be validated. Be unremitting in your preparation and communication. Expect issues, regularly communicate that expectation, and remind everyone that this is a new journey and with patience, openness, a positive attitude, and creative problem solving you’ll collectively find a way to make it work. !




CAPACITY!Someone at each site will need to take ownership of the coordination, communication, and preparation for CAT. Professional development with multiple opportunities for hands on experience prior to testing is highly recommended. Providing staff and students with a few quick troubleshooting strategies for common issues can minimize frustration and delays (e.g., troubleshooting toolkit). Whenever possible, staffing more than one adult in a testing space during test initiation is recommended. Always have a backup plan when the network goes down or the system fails.!




COLLABORATION!Your technology department/director should not be the de facto functional owner of this project just because it involves computers. Neither, can your Teaching and Learning (Curriculum/Assessment) staff be successful without coordinating their efforts with IT. This CAT process is a “silo buster”. It requires ongoing collaboration and communication among multiple departments and among staff at varying levels of responsibility. Are you meeting once a month? Do staff from each division have a solid understanding of the work and business practices of each other department related to this project?!




COMMUNICATION!Do you have a mechanism for frequent and targeted communication on issues and status updates for site leads and key personnel? How quickly can you inform all end users of system-wide issues/outages? How effective and immediate is your communication from department to department at the district level, district to lead contact at school sites, and from school contact to all affected end users at the site? Are you acknowledging and timely messaging technical issues and efforts to resolve them and thanking staff for their patience and understanding as you collectively learn and enhance systems and processes?!


Practice, Practice, Practice!

SBAC Optional Interim Computer Adaptive Tests!These assessments will provide educators with actionable information about student progress throughout the year. Like the summative assessment, the interim assessments will be computer adaptive and includes performance tasks. !❖  Provides an opportunity for staff, students, and parents to experience computer adaptive

assessments ahead of SBAC summative testing to build community awareness, site capacity, and provide time to work into the culture and routine of each school !

❖  Provides opportunity to build capacity and ownership at every site (scheduling, logistics, basic troubleshooting strategies, patience, flexibility, comfort with technology, etc.)!

❖  Informs requirements for minimum level of support to address technology (hardware/software) and instructional support requests during peak testing periods!

❖  Provides IT staff an opportunity to evaluate the capacity and reliability of the network infrastructure to support thousands of concurrent CAT test takers (“stress test”)!

❖  Provides staff an opportunity to assess the viability and reliability of low-cost, centrally managed computers (e.g., Chromebook computers) for online assessment via wireless connections!


Resources and Links!

K-12 High Speed Network (K12HSN)!K12HSN provides the California K-12 community with network connectivity, Internet services, network diagnostic service, teaching and learning application coordination, and videoconferencing coordination and support. http://www.k12hsn.org/about/!

SBAC in a Box PowerPoint: (Recommended)!Summary of device considerations, network requirements, assessment environments, and lessons learned from scientific pilot.!

http://www.k12hsn.org/files/presentations/SBAC_in_a_Box_CETPA_2013.pdf!

!

About K12HSN: SBAC in a Box: http://www.k12hsn.org/about/news/archive.php/view/news/7819!


Bridging STAR to Smarter Balanced Assessments!

what we learned!•  culture is King and clear and consistent

communication is key!•  some of the “old test taking strategies” for paper

based assessments no longer apply!•  what to do when the Chromebook screen turns

sideways!•  the network WILL fail at the most inopportune time,

what’s your plan?!•  sometimes the hosted online testing environment is

the problem!•  increased experience and comfort with technology

translates into a significant decrease in “issues”!•  the Technology Readiness Tool provides valuable

data at the local level and statewide to quantify the funding, resources and support required to ensure a successful experience with Smarter Balanced Online Assessments!
