ETS Title II Reporting · important part of Title II pass rate ... what is on the student’s score report, i.e. JonesJr, Brown-Smith, ... Title

Confidential and Proprietary. Copyright © 2011 Educational Testing Service. All rights reserved.

ETS Title II Reporting2014/15

Pass Rate Reports for IHE Report Cards

Presented by:

Sharen Virgin

Confidential and Proprietary. Copyright © 2011 Educational Testing Service. All rights reserved.Confidential and Proprietary. Copyright © 2012 Educational Testing Service. All rights reserved.

Agenda

• ETS Title II Website User’s Guide

• TLCS User Accounts

• Responsibilities of ETS and IHEs

• Entering Student Data

• Verify Matches to Test Scores

• Follow Up Reporting

• Resolution Period

• Important Dates

2


From Client Services Home Page, choose

Will include links to pre-recorded webinars,

PDF files of presentations, FAQs

All Help Documents


Website User’s Guide


TITLE II USER ACCOUNTS: PRIMARY AND SECONDARY

5


User Accounts

Each institution must have 1 primary user and can have up to 3 secondary users.

ETS administrator approves primary user; primary user approves, removes, and manages secondary user accounts.

6


TLCS Services

7


ETS AND IHE RESPONSIBILITIES

IN TITLE II PASS RATE REPORTING

8


ETS Responsibilities

• Matches students to test scores, applies state licensure requirements and calculates pass rates on tests

– Pass rate calculation: #passers / #takers• Ex: 18 passers ÷ 19 takers = 95% pass rate

• Prepares formatted pass rate reports for Program review, both Summary and Assessment Reports.

9


Summary Pass Rate Report

10

Number of completers taking one or more assessments within their

area of specialization. In order to count as a pass, the student must

pass all tests taken for at least one license area.


Assessment Pass Rate Report

11

In cases where there are less than ten students taking the assessment or

license/certificate, the number passing and pass rate are not reported.


ETS Prepares flat data files for submission to Westat for inclusion in Section III of the IHE Report Card

Single assessment:

Summary:

12


• Submit a list of students enrolled between 9/1/2014 and 8/31/2015

• Assign a program type, group, and license/certification area to each student

• Verify test match results to student records

• Review final pass rate reports

• Teacher Preparation programs must submit an Institutional and Program Report Card on the Quality of Teacher

Preparation (IHE Report Card). - Westat’s IPRC site by April

30 each year

13

Institution Responsibilities


ENTERING STUDENT DATA

14


Students to be Included

• All students officially enrolled in your program between 9/1/2014 and 8/31/2015

• Initial certification only

• Classroom teachers only

• Regardless of testing status

• Note: students who officially drop from your program before 8/31/2015 should not be included

15


Grouping Your Students

• All students currently enrolled in your teacher education program must be counted in one of three categories:

– Group 1 Enrolled students who have completed all nonclinical courses

– Group 2 Other enrolled students

– Group 3 Program completers


Exception to Group 1

• If your program has coursework during or after student teaching, you will have no students in this group

17

Enrolled students who have completed

all nonclinical courses


+ Student Categories Reported

• Group 4

– Program completers, prior year (follow-up year 1)

• Group 5

– Program completers, 2 years prior (follow-up year 2)

18

ART EDUCATION TEST I (109)

All enrolled students who have completed all nonclinical courses, 2013-14

Test Company: ETS Other enrolled students, 2013-14

Score Range: 100-300All program completers, 2013-14

All program completers, 2013-14 (group 4)All program completers, 2012-13 (group 5)


+ Student Categories Reported

19

Group 6Program completers combined three years (summary pass rates only)

Group

Number Taking

Assessment1

NumberPassing

Assessment2

All program completers, 2013-14 7

All program completers, 2012-13

All program completers, 2011-12 7

All program completers, combined 2011-14 14 14

When two or more completer groups have fewer than ten completers, data is

combined across the three completer years into an additional completer group

for the Summary pass rates.


Student Program Types

• Traditional Route within an institution

• Alternate Route within an institution

• ARO: Alternate Route Organization

outside of an institution

• State DOE designates program type for each institution and organization

20


Licensure or Certification Area

• Completer and All But Clinical must be assigned a license

• Other Enrolled should be assigned a license if possible, but can be entered as “undeclared”

21


Update Rolled Over Records

• Delete students who left your program (this should be done first)

• Filter student list and update by group

• Update by use of upload sheet

• Export student list

– Live Demo

22


Update Rolled Over Records

• Change where necessary:

– Group

– Program

– Certification area

• Live Demo

23


Enter New Students

• Enter by upload or Enter individually

• Information required

– First and last name

– DOB and/or SSN

– State

– Group

– Program type

– Licensure area

• Live Demo24


Match Verification

• Match verification is the most important part of Title II pass rate reporting

• Failing to verify your matches could results in the need to edit during the resolution period for a fee.

25


Match Verification

• ETS will match students to scores 3 times weekly (Mon, Wed, Fri)

• Students will show a match status

– Match not run

– Not Found

– Found

– Matched to scores

26


Match Verification

• Match results must be reviewed

• Edits can be made to improve match results

• New results should be confirmed and additional edits made where necessary

– Live Demo

27


Match Verification & License Rules

• A license rule is used to determine the requirements of the license

• The license rule is applied when the data is extracted for the reports.

28


Match Verification

29

• ALL tests taken will match to student record if they are present in the license rule: ( ( ( 5623 OR 0623 ) OR ( 5624 OR 0624 ) ) AND( 0700 OR ( 5701 OR 0701 ) ) ),

• The license rule is applied when the data is extracted to prepare reports.

and these tests will be dropped

When rule is applied, these tests will used in pass rates Not Passed 5623 PRINC LEARNING AND TEACHING 5-9

Passed 5624 PRINC LEARNING AND TEACHING 7-12

Not Passed 0700 AGRICULTURE (discontinued)

Passed 5701 AGRICULTURE


Match Criteria

• Last Name (or alternate), First Name, Praxis ID

• Last Name (or alternate), SSN, DOB

• Last Name (or alternate), SSN

• Last Name (or alternate), First name, DOB

• Last Name (or alternate), Praxis ID, DOB

30


Match Criteria

• Each of the 5 match criteria includes a match to the Last Name or an alternate last name. You can list up to 4 alternate last names.

• The last name must be an exact match to what is on the student’s score report, i.e. JonesJr, Brown-Smith, etc.

31


Check all Results

• Important to look at results in all match categories

– Not Found – may not have tested

– Found – may have tested outside window; review a-h list in Section 6

– Matched to scores – are they the expected scores?

• Live Demo

32


Edits to Improve Match Results

• Confirm DOB, SSN, spelling of name with original score report

• If incorrect on report, still need to use that data

• Refer to Section 6 of the User’s Guide

• If all else fails, submit email to [email protected]

33


Resolution of Non-Matched Records


Poll

• Do you have the information you need to perform match verification?

35


FOLLOW UP REPORTING

36


Follow up for Completers from2012/13 and 2013/14

• The purpose of follow up reporting is to capture any testing activity that has occurred since the close of the reporting window for the year a student is listed as a completer.

• Section 9 of the User’s Guide provides detailed information

37


Edits Allowed forFollow Up Reporting

• change or delete an SSN or DOB

• address

• state

• add alternate last names

• change, add, or delete Praxis IDs

38


Edits Not Allowed forFollow Up Reporting

• student group

• program type

• middle initial

• last name

39


RESOLUTION PERIOD

40


Resolution Period

The purpose of the resolution period is to allow programs the opportunity to review reports based on the student data provided the previous Fall. If it is believed that an error was made, an appeal can be submitted to ETS via email at [email protected].

41

mailto:[email protected]


Resolution Period

• The resolution period is 22 business days in length and begins on the day the reports become available for your review.

• Changes to your data during this time will incur a fee of $1500.

• Section 11 of the User’s Guide provides detailed information

42


IMPORTANT DATES

43


ETS Website Dates

• September 8 through November 13, 2015 9/8/2015 Site opens for entry and edit of student data and test

score match verification

11/13/2015 Site closes to IHEs

• February 10 through March 11, 2016 2/10/2016 – Draft reports available for review; resolution period

begins

3/11/2016 – Resolution closes

• April 15, 2016 – Final reports sent to Westat for Section III of IHE Report Cards

https://tlcs.ets.org

https://tlcs.ets.org/


Student and TestDate Ranges

• Enrolled between

– 9/1/2014 and 8/31/2015

• Matched to scores from tests taken

– on or after 9/1/2010 for current year (14/15)

– on or after 9/1/2009 for Follow up year 1 (13/14)

– on or after 9/1/2008 for Follow up year 2 (12/13)


Students Reported& Matched to Tests


Concerns or Questions

• Email us at [email protected]

• Most issues require a careful review of the data. Please put your request in writing with sufficient information to allow us to investigate.

• Log in issues:

[email protected]

47

mailto:[email protected]