A Guide to
Teaching Strategies GOLD Interrater Reliability Certification
2 A Guide to Teaching Strategies GOLD Interrater Reliability Certification
The Purposes of Teaching Strategies Interrater Reliability Certification
Teaching Strategies GOLD is an authentic, ongoing, observation-based assessment system that relies heavily on your judgment as a teacher. The information you collect every day by observing children in the context of meaningful experiences makes this instrument robust and effective. After analyzing the evidence you gathered to document each childs knowledge, skills, and behaviors, you evaluate each childs progress. You identify each childs levels of development and learning at given points in time; track progress over time; and compare the childs knowledge, skills, and behaviors with widely held expectations for children of the same age or class/grade. Your evaluations inform the decisions you make when planning learning experiences for individual children and for your group as a whole.
It is important to use Teaching Strategies GOLD reliably, both to scaffold childrens learning and because your program administrator will probably use your data in some way for reporting purposes. One criticism of any observation-based assessment system is that evaluators judgments are somewhat subjective. Administrators of programs using this type of assessment tool have voiced concerns about whether evaluators (teachers) can make accurate, consistent decisions about childrens levels of development and learning. They wonder whether teachers who observe the same situation would rate the childrens skills and behaviors the same way and, more importantly, whether they would make the same rating decisions as the developers of the tool would make.
When you use assessment results to inform instructional decisions, accurate ratings enable you to choose effective teaching strategies. When you know you are using an assessment tool reliably, you can be confident about your classroom decisions. You know that you are interpreting evidence of childrens development and learning in ways that enable you to plan for and respond appropriately to all of the children in your classroom.
To address administrators concerns and support your efforts, Teaching Strategies has taken steps to check and enhance the accuracy of your assessment ratings through a process that leads to interrater reliability certification. In addition to affording practice in using the tool, the process measures the degree of agreement between your ratings and those of Teaching Strategies master raters.
We developed Teaching Strategies interrater reliability certification to
increase the accuracy and consistency of your judgments as you use Teaching Strategies GOLD
improve planning for individual children by helping you assess children accurately
identify professional development needs by using data collected during the certification process
Teaching Strategies interrater reliability certification is neither designed nor intended to evaluate you as a teacher. Its purpose is to enhance one of your many competencies that benefit the children you work hard to support each day in your classroom.
3 A Guide to Teaching Strategies GOLD Interrater Reliability Certification
What Interrater Reliability Certification Means
After completing Teaching Strategies GOLD implementation training, you may choose to strengthen your implementation skills and receive interrater reliability certification from Teaching Strategies.
Interrater reliability is the extent to which the ratings assigned by two or more individuals (observers/raters) agree. It addresses the consistency with which a rating system is used by multiple persons. Being awarded Teaching Strategies interrater reliability certification means that your ratings of childrens knowledge, skills, and behaviors agree (within an acceptable range) with the ratings determined by Teaching Strategies GOLD developers.
The online certification process gives you multiple opportunities to rate childrens knowledge, skills, and behaviors. You will opt to evaluate portfolios for children in one of three age-groups: birth through age 2, age 3 through kindergarten, or mixed ages (including infants/toddlers, preschool children, and kindergarten children). Each portfolio was reviewed by Teaching Strategies master raters, who agreed on a rating for the childs knowledge, skills, and behaviors in relation to each objective and dimension. Your ratings will be compared with theirs.
Agreement with a checkpoint rating means that your rating is within a range of 1 of the master rating. For example, if you enter a rating of 5 for a dimension and the master rating is 6, the ratings are within the acceptable range of agreement. If you enter 4 but the master rating is 6, the ratings do not fall within the acceptable range of agreement. To be awarded interrater reliability certification, at least 80 percent of your ratings in each of six areas of development and learning must agree with the master ratings (within the acceptable range of 1).
4 A Guide to Teaching Strategies GOLD Interrater Reliability Certification
The Interrater Reliability Certification Process
You will begin the interrater reliability certification process by evaluating the portfolios of three children. Those initial evaluations are called Round 1. The portfolios include enough evidence to rate each childs knowledge, skills, and behaviors in six areas of development and learning: SocialEmotional, Physical, Cognitive, Language, Literacy, and Mathematics. The children whose portfolios you will evaluate have been attending their programs for a while and have not had excessive absences, so you should not choose Not Observed for any rating.
If at least 80 percent of your Round 1 ratings agree with the master ratings in each area of development and learning, you will have earned certification. If not, you will be able to evaluate three more portfolios, concentrating on the areas in which you did not reach 80 percent agreement. If there are areas in which you do not reach 80 percent agreement during Round 2, you will be able to evaluate a third set of portfolios, focusing on those areas. You will be able to continue with additional rounds until you have reached agreement of at least 80 percent in each area. The number of rounds you may undertake is not limited.
Certification Testing AgreementThe Teaching Strategies GOLD interrater reliability certification test is to be taken only by the individual named in the Teaching Strategies account. As an examinee, you should neither solicit nor accept any assistance during the testing process.
In order to take the test, you will be required to certify that 1) you are the individual who is registered to take the test and 2) you are completing the test without assistance from any source.
Preparing for CertificationTeaching Strategies recommends that you complete Teaching Strategies GOLD implementation training before beginning the certification process. Teaching Strategies provides two forms of implementation training: an online course (available to all Teaching Strategies GOLD users via the professional development tab in the Teaching Strategies dashboard) or a 2-day, in-person professional development session. Training sessions introduce participants to the structure of Teaching Strategies GOLD, the objectives for development and learning, the assessment cycle, and evaluation of child portfolios. Additional preparation is recommended and available through the Practice Checkpoints that are part of the online professional development module. In Practice Checkpoints, users can review portfolios, enter checkpoint levels, and then compare their ratings to those established by master raters. Users will also see a justification statement that explains the reasoning behind the master rating. Finally, users can prepare for the certification test by reading Objectives for Development & Learning to become more familiar with the 38 objectives, the dimensions, and the progressions of development and learning.
Testing Timeline You may take as much time as you need to complete each round. There are no time limits. Your starting and completion dates for each round will be listed under the professional development tab, which you access from in your Teaching Strategies dashboard.
We suggest that you take time between rounds to review the objectives for development and learning in the areas in which you did not reach 80 percent agreement. This also is a good time to review the Teaching Strategies GOLD implementation training modules.
5 A Guide to Teaching Strategies GOLD Interrater Reliability Certification
How to Complete the Test
Getting StartedTo access the interrater reliability certification screens, log in to your TeachingStrategies.com account. Once you have logged in, go to your dashboard. Then click the professional development tab at the top of the screen and select Interrater Reliability from the dropdown menu.
You may undertake interrater reliability certification in English or Spanish. To complete the test in English, continue to the bottom of the English Overview screen. To complete it in Spanish, click Complete the Interrater Reliability Certification test in Spanish /Tomar el Examen de Certificacin de Consistencia entre Evaluadores en espaol.
6 A Guide to Teaching Strategies GOLD Interrater Reliability Certification
Overview ScreenAt the bottom of the Overview screen, you will be asked to read and agree to a verification statement. If you do not understand the statement for any reason, please consult with your administrator or send an e-mail to implementa