VTPBiS School and SU/District Coordinators Webinar: Facilitating Data

Days

SPRING 2013

Welcome!Facilitating Data Days by Sherry Schoenberg & Cassandra Townshend

How to login:You will be connected to audio using your telephone after joining the Webinar. Please dial the following info that will also appear on your screen:

Toll: (XXX ) XXX-XXXXAccess Code: this is the number that was provided in your confirmation email from GoToWebinar (don’t forget to hit the # key after the access code)Audio PIN: Shown after joining the Webinar

Please use a telephone to connect or use a headset if connecting via your computer’s microphone and speakers.

Introductions:

When we call your name please:

1)Say “hello”

2)Tell us what school you are from.

3)Indicate who is in the room with you, if anyone.

Webinar Logistics:

2 Ways to Interact: Raise your hand using the icon on your

screen Type a question into the text box

Intermittently we will provide opportunities to interact.

This webinar will be recorded.

Please note, your microphone will be muted unless otherwise indicated.

Opening Activity:

What were your successes and challenges in using PBIS data this year? (fidelity and/or student outcome measures)

In a moment, we will ask for a sampling of responses.

5

Purpose

To build competence and confidence in your role as facilitators of Data Days

To introduce/review useful tools and strategies to wrap- up this year and plan for next year

6

Objectives:By the end of this webinar, you will have:

• Reviewed how to use PBIS data tools for problem-solving and decision-making

• Identified your role and responsibilities as facilitator of Data Days

• Considered action planning strategies for next year

7

Differentiate based on your experience

FoundationsThink about how you plan to accomplish the work.

Full Implementation:Think about how to make it easy, better, more effective.

Sustainability:Think about how to continue the practice and ensure sustainability.

Never stop doing what is already working

Always look for the smallest change that will produce the largest effect

Do no add something new without also defining what you will stop doing

Collect and use data for decision making 9

Guiding Principles for Using data to Plan for Sustainability:

Review of PBIS Data Tools

http://www.pbisvermont.org/resources/evaluation-tools

Types of Data: Staff Perception Data

Self-Assessment (SAS) Data Leadership Team Self-Assessment

Student Outcome Data Review ODR Data “Big 5” CICO, SIMEO and/or ISIS Data

Implementation Fidelity Data Benchmarks of Quality (BoQ) Benchmarks of Advanced Tiers (BAT)

Action Planning Tools Action Plan for Sustainability (Universal and Targeted) 11

Other data to consider

12

Leadership Team Self-Assessments

Leadership Team

Self-Assessme

nt

Navigating www.pbisapps.org

13

Self-Assessment Survey (SAS)

14

Purpose: Assess staff perceptions of PBIS practices in place and priority for changesDesign annual action plan

Format: Survey

Completed by: All staffManual or on-line scoring, graphing

When? Annually, preferably in the spring

Two main questions

1. What systems are in place now?

2. What systems are most in need of improvement?

16

Understanding SAS Results:www.pbisapps.org

1)Total Score2)Subscale3)Items

Total Score:

18

Total Score:

19

Subscale:

20

Items:

SAS Summary Sheet

21

Leadership Team Activity for SAS Review and Planning

As a leadership team, record results on the SAS Summary Sheet: Using the total Scores Report, circle High, Medium

or Low Priority by school domain. Using the Individual Items Report, list the three

major strengths in each of the four systems areas Using the same report, list three major areas in

need of development For each system, circle one priority are for focusing

development activities Come up with 2 priority focus areas for next school

year

22

Questions/Comments?

Using the BoQ and/or BAT

BoQ-Universal Systems

BAT – Targeted/Intensive Systems

24

Benchmarks of Quality (BoQ)

25

Purpose: Assess leadership teams perceptions of PBIS implementation at the Universal Level

Format: Survey (Electronic Scoring Form)

Completed by: Leadership Team, School Coordinator and SU/District Coordinator

When? Twice Annually, in the Fall and Spring

BoQ 10 Critical Features:

1. PBIS Team2. Faculty/Staff Commitment3. Effective Procedures for Dealing with

Problem Behaviors4. Data Entry and Analysis Plan Established5. Expectations and Rules Developed6. Reward Recognition Program Established7. Lesson Plans for Teaching

Expectations/Rules8. Implementation Plan9. Classroom Systems10.Evaluation

27

Understanding BoQ Results:www.pbisapps.org

1)Total Score2)Subscale3)Items

28

Total Score:

29

Subscale:

30

Items:

BoQ Team Summary Sheet

31

Leadership Team Activity for BoQ Review and Planning

As a leadership team, review your BoQ Data using the BoQ Team Summary Sheet: Using the Individual Items Report identify three

areas of Strength Using the same report, list three areas in need of

development If there are other Action Items, place those under

the Other Action Items section on the Team Summary sheet

Come up with 2 priority focus areas for next school year

32

Benchmarks for Advanced Tiers (BAT)

33

Purpose: Assess leadership teams perceptions of PBIS implementation at the Targeted and Intensive Level

Format: Survey (Electronic Scoring Form)

Completed by: Leadership Team, School Coordinator and SU/District Coordinator

When? Annually, in the Spring (optional)

34

Understanding BAT Results:www.pbisapps.org

1)Total Score2)Subscale3)Items

35

Total Score:

36

Subscale:

37

Items:

Questions/Comments?

TIPS Problem-Solving “Mantra” 

1.Do we have a problem?(identify)

2.What is the precise nature of our problem? (define, clarify, confirm/disconfirm inferences) 

3.Why does the problem exist, & what can we do about it? (hypothesis & solution)

4.What are the actual elements of our plan? (Action Plan)

5.Is our plan being implemented, & is it working? (evaluate & revise plan)

Innovation neutral: Use for Reading, Behavior, Math, School Improvement

REMEMBER to use…..

Elements of an Action Plan

Prevention *Teach behavioral expectations in cafeteria

*Maintain current lunch schedule, but shift classes to balance numbers.

Teaching

Reward Establish “Friday Five”: Extra 5 min of lunch on Friday for five good days.

Extinction Encourage all students to work for “Friday Five”… make reward for problem behavior less likely

Corrective Consequence Active supervision, and continued early consequence (ODR)

Data Collection Maintain ODR record and supervisor weekly report

Quick Big 5 blends all of the Big 5 Reports together into a single report.

Universal Behavior Data: School-wide Data

41

Year-End Reportwww.pbisapps.org

42

How does your school compare to the National Trend?

43

Targeted Behavior Data: Individual & Targeted Practices Data for CICO

44

Average Daily Points by Student

45

Questions/Comments?

47

Your Role as Facilitator of Data Days

COACHING

Our goal is to become

competent coaches

Why?

48

Building Building Staff, Staff,

Students Students and Familiesand Families

School School Leadership TeamLeadership Team

Supervisory UnionSupervisory Union/District /District

Leadership Team Leadership Team and and

Coordinator(s)Coordinator(s)

State Level State Level Trainers, Trainers,

Implementation Implementation Coaches Coaches

and and Technical Technical Assistance Assistance ProvidersProviders

Responsibilities for Planning Spring Data Days:

Ensure that School Leadership Teams complete SAS and BoQ and/or BAT

Work with Data Analyst to preview and highlight SAS, BoQ and BAT assessment results to share with team

Work with Data Analyst to analyze School-wide and CICO data

Identify features of SAS, BoQ and/or BAT to prioritize for next year

Create hypotheses and problem solve around school-wide and CICO data

Complete Action Plan for Sustainability

49

VTPBiS Action Plan for Sustainability:

50

PAGE 1

PAGE 2

Responsibilities for facilitating data review and improvement planning for next year:

Consider Calendar of VTPBiS Assessments

Schedule next year’s Data Days – Fall, Winter, Spring

Identify/enhance the role of the Data Analyst

Plan Professional Development around priorities identified through assessments – NOW! Consider TIPS/SWIS learning module Consider training in Universal Screening Consider training in classroom management, FBA/BIP,

crisis prevention an intervention, other

53

VTPBiS Assessment Calendar

54

Resources to Support you

From now until you retire...

56

Large Group Discussion

Review the successes and challenges that you noted at the beginning of the webinar.

How has this Data Day webinar helped to address the challenges?

Please share one “ah-ha” that you had as a result of this webinar.

57

Thank you!