18
Embedding Assessment into Daily Activities and Routines COLLECTING AND RECORDING THE DATA THIS SECTION CONTAINS: o Data Collection Forms o Compiling the Data o Organizing Your Data Collection System Cindy Kongs M.S., Misty D. Goosen, Ed.S., Phoebe Rinkel, M.S. and David P. Lindeman, Ph.D. December 2011 Kansas Inservice Training System Kansas University Center on Developmental Disabilities 2601 Gabriel, Parsons, KS 67357 620-421-6550 ext. 1618 or 1-800-362-0390 ext. 1618 http://kskits.org/

5 Collecting and Recording the Data - University of …kskits.dept.ku.edu/ta/Packets/embedAssess/CollectEA1211.pdfEmbedding Assessment into Daily Activities and Routines COLLECTING

Embed Size (px)

Citation preview

                                                                                           

Embedding Assessment into Daily Activ ities and Routines

COLLECTING AND RECORDING THE DATA

THIS SECTION CONTAINS:

o Data Collection Forms o Compiling the Data o Organizing Your Data Collection System

Cindy Kongs M.S., Misty D. Goosen, Ed.S., Phoebe Rinkel, M.S. and David P. Lindeman, Ph.D.

December 2011 Kansas Inservice Training System

Kansas University Center on Developmental Disabilities 2601 Gabriel, Parsons, KS 67357

620-421-6550 ext. 1618 or 1-800-362-0390 ext. 1618 http://kskits.org/

    2  

Data Collection Forms    Teachers   identify  specific  skills   to  be  assessed  and  record   them  on  data  collection   forms.  Three  types  of  data  collection  forms  are  discussed  as  a  part  of  this  packet:      1.   Large  Group  Data  Collection    

• Teacher  Made  Independent  Activity  Data  Collection  Form    (Figure  1a)  • Teacher  Made  Independent  Activity  Data  Collection  Form  Example  (Figure  1b)  

 2.   Small  Group  Data  Collection    

• AEPS  Assessment   Activities  with   data   collection   forms   available   in   Appendix   A   of  Volume  2  Test  (Bricker,  et  al.,  2002)    

• AEPSi   Assessment   Activities   (With   subscription   or   30-­‐day   free   trial,   small   group  activities   with   data   collection   forms   can   be   downloaded   from   AEPSi   (at  https://www.aepsi.com/aepsi/  (Figure  2)  

• Teacher  Made  Small  Group  Data  Collection  Form  (Figure  3a)    • Teacher  Made  Small  Group  Data  Collection  Form  Example  (Figure  3b)  

 3.   Language  samples  

• Teacher  Made  Language  Sample  Form  (Figure  4a)  • AEPS  Social  Communication  Observation  Form  (Figure  4b).    

 The  independent  and  small  group  sample  data  collection  forms  are  “activity  specific”  rather  than  “domain  specific”,  allowing  teachers  to   implement  best  practice   in  terms  of  teaching  “the   whole   child”.   The   independent   activity   forms   are   used   to   record   progress   data   for  children  as  they  participate  in  routine  or  self  selected  activities  during  the  daily  schedule.  Specific  learning  goals/objectives  to  be  assessed  are  selected  by  the  teacher  and  recorded  in  the  boxes  on  the  left  hand  side  of  the  form.  As  children  progress  through  the  curriculum,  the  teacher  can  update  the  goals  and  objectives  on  the  form.  Although  sample  assessment  activities  provided  are  specific  to  the  AEPS,  these  forms  could  be  adapted  for  use  with  any  curriculum-­‐  linked  assessment.        The   AEPS   Social   Communication   Observation   Form   is   domain   specific;   conducted   during  ongoing   activities   it   provides   an   organized   way   in   which   to   collect   a   large   number   of  language   samples   to   assess   specific   social-­‐communication   skills   within   a   variety   of  classroom  activities.    For  additional  examples  of  data  sheets  for  authentic,  activity  based  instruction  see  also  the  DEC  Recommended  Practices  Toolkit  (DEC,  2006)  module  on  Monitoring  Children’s  Learning.      

    3  

Figure  1a:  Independent  Activity  Data  Collection  Form      

Activity/Description  _______________________________________________________________________________    

GOAL  

STUDENT  1   2   3   4   5   6   7   8   9   1

0  11    

12  

13  

                 

                         

                 

                         

                 

                         

                 

                         

    4  

Figure  1b:  Independent  Activity  Data  Collection  Form  (Example)      

Activity/Description  _______________________________________________________________________________    

  STUDENT  GOAL   B

en  

Kylie  

Ha

ven  

Bra

nd

on  

Ash

ley  

Ka

thy  

Pete  

Ga

rrett  

Wya

tt  

Riley  

Tra

e   B

roo

ke  

Eli  

Adaptive C 1.3 Unzips zipper  

                         

Cognitive C 1.1 Follows directions of 3 or more related steps that are routinely given  

                         

Social A 1.5 Responds to affective initiations from others  

                         

Social A 1.4 Initiates greetings to others who are familiar  

                         

Multiple  Students/Four  Goals          

       

Arrival at school

Helpful  Idea:  Organize  Measurement  by  Day  of  Week  

Teams  may  decide  to  further  organize  measurement  activities  by  assigning  a  day  of  the  week  to  specific  routine  activities.  For  example,  Monday  could  be  used  to  assess  skills  during  the  arrival  activity.  Tuesday  could  be  used  to  assess  skills  during  bathroom  time,  etc.    

    5  

Figure  2:  AEPSi  (30-­day  free  trial  available  from  https://www.aepsi.com/aepsi/)  

     

Brookes.  (2008).  AEPSinteractive.  Author.  Reprinted  with  permission.  Download  at  https://www.aepsi.com/aepsi/.  

    6  

Figure  3a:  Small  Group  Data  Collection  Form       The  Small  Group  Data  Collection  Form  is  used  when  the  teacher  or  other  adult  leads  a  small  group  of  children  (between  3-­‐5  children)  through  a  specific   learning  activity  with  the  aim  of  addressing  selected  curricular  objectives.  Like   the   Independent  Data  Collection  Form,   specific   learning   goals/objectives   are   selected   by   the   teacher   and   recorded   in   the  boxes  on  the  left  hand  side  of  the  form.    Activity/Description  _______________________________________________________________________________    

GOALS  STUDENT  

1   2   3   4   5              

           

           

           

           

           

6  Goals/5  Students    

    7  

Figure  3b:  Small  Group  Data  Collection  Form  (Example)    

Activity/Description  Matching Middles/Oreo Shape Game  (Fisher  Price/Use  two  sets  if  you  only  want  to  measure  a  limited  number  or  shapes  (i.e.,  circle)      

GOALS  STUDENT  

1   2   3   4   5  Cognitive A 1.2 Demonstrates understanding of five different shapes  

         

Cognitive F 2.1 Maintains participation  

         

Cognitive F 2.2 Conforms to game rules  

         

Social B 2.1 Interacts appropriately with materials during small group activities  

         

Social B 2.2 Responds appropriately to directions during small group activities  

         

Social D 1.2 Selects activities and/or objects  

         

6  Goals/5  Students              

 

    8  

Figure  4a:    Language  Sample  Recording  Form    

Child:  ________________________________________________________Date:  _____________________________    Teacher:  ______________________________________Begin  time:  ____________End  time:  _____________    Activity:  __________________________________________Setting:  _____________________________________      

Utterance   Comment    1.  

 

 2.  

 

 3.  

 

 4.  

 

 5.  

 

 6.  

 

 7.  

 

 8.  

 

 9.  

 

 10.  

 

 11.  

 

 12.  

 

 13.  

 

 14.  

 

 15.  

 

 Summary  Notes      

    9  

Figure  4b                                                                                      Bricker,  D.,  Pretti-­‐Frontczak,  Johnson,  J.  J.,  &  Straka,  E.  (2002).  Assessment,  evaluation,  and  programming  system  for  infants  

and  children:  Administration  guide  (Vol.  1,  2nd  ed.,  p.  207).  Baltimore:  Brookes.  Reprinted  with  permission  

 

    10  

AEPS  SCOF  Data  Collection  Schedule    

Monday  • Ben  • Kylie  • Haven    Tuesday  • Brandon  • Ashley  • Kody    Wednesday  • Pete  • Garrett  • Wyatt    Thursday  • Riley  • Trae  • Brooke  

  To  help  make  data  collection  manageable,  the  teacher  may  wish  to  set  up  a  rotating  system  for  collecting  and  recording  language  samples.  The  schedule  could  be  taped  on  the  back  of  a  clipboard  that  contains  blank  copies  of  the  SCOF  for  the  teacher  or  other  support  person  to  use  as  a  reference  when  recording  data  (see  example  below).      

                                                                           

 

    11  

Compiling the Data    This   section   outlines   a   sample   process   developed  by   the   first   author,   an   early   childhood  special   education   teacher,   for   recording   and   summarizing   data   collected   in   whole   class,  small  group,  and   individual  settings   to  monitor  class  performance  on  a  curriculum-­‐based  assessment  [in  this  example,  the  Assessment  of  Education  Program  Support  (AEPS)].        The   collection   of   data   on   an   ongoing   basis   is   a   foundational   practice   central   to   quality  services  for  young  children.    Data  collection  on  a  scheduled  and  frequent  basis  is  important  for   a   variety   of   reasons.     These   include  measuring   children’s   progress   referenced   to   the  curriculum  and/or  standards,  making  decisions  regarding   instruction  and  modification  of  instructional   strategies,   and   evaluation   of   the   overall   early   childhood   program   and   its  impact  on  the  learning  and  development  of  children.    Data  collection  does  not  have  to  be  a  cumbersome  task  and  should  be  designed  to  answer  specific   questions   related   to   a   child’s   progress   within   the   curriculum   and   desired  developmental   outcomes.     Data   collection   should   be   targeted   across   the   child’s   day   and  across   settings,   activities,   and   groups.   Analysis   may   well   involve   examining   quality   of  response   as  well   as   quantity   of   response.     Simple   data   sheets   can   facilitate   collection   of  information.     Both   the   previous   section   and   the   following   pages   provide   ideas   for   both  teacher  made  and  commercially  available  forms.    Figure  5.    Whole  Class  Data:    In   the   following   example   the   AEPS   Child   Progress   Record   is   used   to   chart   the   targeted  curriculum   learning   goals/objectives   for   the   entire   class,   while   keeping   track   of   data  collection   dates   and   overall   progress   towards   accomplishing   those   goals/objectives.  Regularly  reviewing  this  information  provides  opportunities  to  make  instructional  changes  within  the  curriculum,  as  needed.    Note  the  following  teacher  adaptations:  

• All  targeted  goals  are  underlined  with  a  highlighter.  • The  month  and  day  that  each  set  of  data  is  collected  is  marked  within  the  goal  and  

objective  arrow  (i.e.,  9/25).      • When  the  entire  class  has  completed  a  goal  or  objective,  the  arrow  is  filled  in  with  a  

highlighter.   Different   colors   of   highlighters   can   be   used   to   depict   the   different  quarters  of  the  school  year.  

Figure  6.    Individual  Data:    In  this  example  the  AEPS  Child  Progress  Record  is  used  to  monitor  each  student’s  progress  so  that  instructional  decisions  can  be  made  in  a  timely  manner  specific  to  the  needs  of  the  individual  child.    

    12  

• Child’s   name   and   school   year   are   placed   in   the   upper   left   corner   (i.e.,   Ben,   2006-­‐2007).  

• Class  goals/objectives  for  the  year  are  underlined  with  a  highlighter.  • “+”  or  “–“  indicate  individual  student  performance  on  the  goal/objective  arrow  using  

data  from  collection  sheets.  • Additional   notes   are   included   as   needed   to   inform   instructional   decision   making  

(i.e.,   Objective   1.1   R   –   or   R   +   indicates   right   handed   inappropriate   grasp,   right  handed appropriate grasp).

• When   the   student   has  mastered   the   goal   or   obective,   the   arrow   is   filled   in  with   a  highlighter.  

 Figure  7.    Whole  Class  Data:    In  this  example,  the  AEPS  Child  Progress  Record  is  used  to  document  in  a  visual  manner  the  students  who  have  mastered  goals  or  objectives  to  eliminate  unneccessary  data  collection.  The   first  and   last   initials  are  recorded  within  appropriate  arrows   for   those  students  who  have  mastered  the  goal  or  objective.    Data  will  not  be  collected  for  these  students  in  future  activities.    When  all  students  have  mastered  a  specific  goal  or  objective,  the  arrow  is  shaded  with  a  highlighter.    Figure  8.    Small  Groups/Centers  Data:    This  form  is  an  example  of  a  teacher-­‐made  weekly  data  collection  form.    

• Student  names  are  listed  under  numbers  at  the  bottom  of  the  data  collection  sheet.  • Goals  or  objectives  that  were  measured  are  listed  in  the  left-­‐hand  vertical  boxes.  • Data  collected  for  each  child  is  marked  with  the  date  of  collection  (i.e.,  1/4)  and  “+”  

or  “-­‐“  for  the  skill  demonstrated.  • Shaded  boxes  indicate  that  the  student  has  already  mastered  the  goal  or  objective,  

and  that  no  data  is  needed.  • Materials  used  in  the  activity  are  listed  at  the  bottom  of  the  page  for  activity  set-­‐up  

and  future  reference.  

                   

    13  

Figure  5.    Whole  Class  Data:                                                                            

Bricker,  D.,  Pretti-­‐Frontczak,  Johnson,  J.  J.,  &  Straka,  E.  (2002).  Assessment,  evaluation,  and  programming  system  for  infants  and  children:  Administration  guide  (Vol.  1,  2nd  ed.,  pp.  284-­‐285).  Baltimore:  Brookes.  Adapted  with  permission.    

    14  

Figure  6.    Individual  Data:    

   

Bricker,  D.,  Pretti-­‐Frontczak,  Johnson,  J.  J.,  &  Straka,  E.  (2002).  Assessment,  evaluation,  and  programming  system  for  infants  and  children:  Administration  guide  (Vol.  1,  2nd  ed.,  pp.  284-­‐285).  Baltimore:  Brookes.  Adapted  with  permission.    

    15  

Figure  7.    Whole  Class  Data:                                                                                  

Bricker,  D.,  Pretti-­‐Frontczak,  Johnson,  J.  J.,  &  Straka,  E.  (2002).  Assessment,  evaluation,  and  programming  system  for  infants  and  children:  Administration  guide  (Vol.  1,  2nd  ed.,  pp.  284-­‐285).  Baltimore:  Brookes.  Adapted  with  permission.    

    16  

Figure  8.    Small  Groups/Centers  Data:                                                                                  Kongs,  C.  (2010).  Progress  monitoring:  A  link  in  the  chain.  Parsons,  KS:  University  of  Kansas  Center  on  Developmental  Disabilities.  

    17  

Figure  9.    An  Expanded  List  of  Concepts  Assessed  by  the  AEPS:    In   some   cases   a   published   curriculum  may   not   be   specific   about   concepts   to   be   taught,  making  ongoing  assessment  difficult.  The  following  form  created  in  an  early  edition  of  the  AEPS   may   be   useful   in   helping   teachers   to   target   and   monitor   cognitive   goals   and  objectives  that  may  include  numerous  concepts.    A  teacher  might  make  a  copy  of  the  form  for  each  student  to  be  kept  with  their  Child  Progress  Record.    When  a  student  has  met  the  criteria   for  mastery  of   a  goal/objective,   the  appropriate  arrow   is   filled   in  and   the  date   is  marked  on  the  Child  Progress  Record.      Cognitive  A  1.1  COLORS  (8)  Red  Blue  Orange  Pink  Yellow  Black  Purple  Gray  Green  White  Brown    Cognitive  A  1.2  SHAPES  (5)  Circle  Triangle  Diamond  Square  Rectangle  Star    Cognitive  A  1.3  SIZE  (6)  Big  Thick  Small  Skinny  Chubby  Tall  Thin  Short  Tiny  Itsy  bitsy  Little  Fat  Large  Gigantic  Long  

Cognitive  A  2.1  QUALITATIVE  (10)  Hot  Hard  Light  Cold  Different  Clean  Soft  Same  Loud  Sour  Quiet  Dirty  Good  Rough  Heavy  Wet  Slow  Bad  Smooth  Dry  Sweet  Fast    Cognitive  A  2.2  QUANTITATIVE  (8)  All  Many  None  Full  More  Few  Less  Empty  Lots  Some  Any  Each    

Cognitive  A  3.1  SPATIAL  RELATIONS  (12)  Into  Back  Front  Behind  Under  Here  Middle  Last  In  back  of  Bottom  Beside  Down  Up  In  front  of  On  Next  to  Between  There  First    Cognitive  A  3.2  TEMPORAL  RELATIONS  (7)  Yesterday  Early  Before  If-­‐then  Today  Later  After  Tomorrow  Last  First    

Cognitive  G  1.2  COUNTS  3  OBJECTS  1  2  3    Cognitive  G  1.1  COUNTS  AT  LEAST  10  OBJECTS  4  5  6  7  8  9  10    Cognitive  G  1  COUNTS  AT  LEAST  20  OBJECTS  11  12  13  14  15  16  17  18  19  20    Cognitive  G  2.1  LABELS  PRINTED  NUMERALS  TO  10  1  2  3  4  5  6  7  8  9  10  

Adapted  from  Early  Intervention  Program.  (2000,  July).  AEPS  measurement  for  three  to  six  years,  cognitive  domain:  Strand  B:  Demonstrates  understanding  of  concepts  (draft).  Eugene,  OR:  University  of  Oregon.  

    18  

Organizing Your Data Collection System  For  data  collection  to  be  efficient  and  ongoing,  it  must  be  integrated  into  the  routines  of  the  classroom.    The  following  practices  were  developed  for  use  in  an  inclusive  preschool  classroom  with  20  or  more  students.  

 Teacher  Tips  for  Developing  a  Data  Collection  System  

• Prepare  your  data  collection  sheets  for  the  week  in  advance.  

• Highlight  the  activities  that  you  have  targeted  for  data  collection  on  your  weekly  lesson  plan.  This  allows  all  staff  members  to  review  where  data  will  be  collected,  at  a  glance.  

• Use  clipboards  for  data  collection  sheets.  Consider  marking  the  back  of  the  clipboard  with  the  area  the  data  will  be  collected  (i.e.,  Dramatic  Play,  Arrival,  Small  Group).  

• Pick  a  day  of  the  week  to  record  collected  data  on  the  individual  student  progress  records.  The  data  cannot  drive  your  instruction  unless  it  is  recorded  and  reviewed.  

• Make  a  set  of  notebooks  to  store  data.  One  notebook  can  be  utilized  for  individual  student  progress  records,  another  for  completed  data  collection  sheets,  and  a  final  notebook  to  store  copies  of  frequently  used  data  collection  sheets  to  be  copied  and  reused  at  a  later  date.