Upload
lavender
View
63
Download
0
Embed Size (px)
DESCRIPTION
Tests of Adult Basic Education. Workshop Objectives. Practical knowledge needed for implementation, including planning, scheduling tests, registration and the preparation of students Introduction to scoring and reporting TABE results Discussion of how to accommodate students with disabilities - PowerPoint PPT Presentation
Citation preview
Tests of Adult Basic EducationTests of Adult Basic Education
Workshop ObjectivesWorkshop Objectives
• Practical knowledge needed for implementation, including planning, scheduling tests, registration and the preparation of students
• Introduction to scoring and reporting TABE results• Discussion of how to accommodate students with
disabilities• Discussion of basic test management• Discussion of other organization and implementation
needs
Why TABE?Why TABE?
• It provides a complete picture of adult student performance
– Provides both norm-referenced and competency-based/ criterion-referenced information
– Helps educators and other users evaluate clients’ abilities in basic skills (reading, language, mathematics)
• Provides data for initial placement in an Educational Functioning Level (EFL) and subsequent promotion to a higher EFL
• Approved for NRS Reporting
Tests of Adult Basic EducationTests of Adult Basic Education
• Most widely used adult test in the United States (ABE)
• Proven “Validity” and “Reliability”• Norms based on adult reference groups• Content reflects adult learning• Built on 45 years of experience• Grounded in Basic Skills/Higher Order
Thinking Skills – Cognitive Complexity– Bloom, Rankin-Hughes, Norm Webb
History of CTB/McGraw-Hill’sTests of Adult Basic Education (TABE)
History of CTB/McGraw-Hill’sTests of Adult Basic Education (TABE)
TABE 1 & 2 1964
TABE 3 & 4 1974-1975
TABE 5 & 6 1983
TABE 7 & 8 1994
TABE 9 & 10 2003-2004 TABE Online 2006
TABE Adaptive2012
TASC 2014
TABE Content ValidityTABE Content Validity
• Higher Order Thinking Skills – Cognitive Complexity
• National Adult Literacy Survey (NALS)• Standards and Guidelines
– NCTM, IRA, NCTE
• Culturally Diverse Content• Maximum Bias Elimination
– Ethnicity– Age– Gender
Content ValidityContent Validity
Content measures three types of literacy needed for the High School Equivalency and today’s jobs:– Prose literacy —reading and understanding written text – Document literacy —understanding content of
common documents (diagrams, maps, charts, tables, forms, and consumer labels )
– Numeracy —merging knowledge of numerical and word content (the ability to understand complex documents such as tax forms or advertisements that require both text and math skills
2003 NALS Comparative Report to the Nation on Adult Literacy Performance
Versions of TABE
Two Alternate Forms – 9 &10
Two versions for each form
Complete Battery (3 hours, 37 minutes)Complete norm- and criterion-referenced
informationDetailed diagnostic information
Survey (2 hours, 8 minutes)Shorter testing timeEasy screening and placement
TABE Test BookletsTABE Test Booklets
• Level L Form 9 or 10 (consumable)
• Complete Battery Form 9 or 10 (reusable)– Levels E, M, D, or A
• Survey Form 9 or 10 (reusable)– Levels E, M, D, or A
• Large Print Test Books • Braille (9 only)• Audio (9 only)
TABE 9 and 10: A Flexible, Modular Structure
TABE 9 and 10: A Flexible, Modular Structure
*Core Tests:• Reading• Language• Mathematics
– Mathematics Computation
– Applied Mathematics
Plus Tests (Optional):– Language
Mechanics– Vocabulary– Spelling
Advanced Tests (Optional):
• Social Studies and Science• Algebra/Geometry• Writing ( 2 prompts)Instructional Support• Getting to Know TABE• Building Skills With TABEScoring Options• Hand-scoring• TABE-PC or TestMate TABE• TABE Online*approved for federal reporting
Literacy LevelLiteracy Level
Content Area Items Time
Pre-Reading 18 :13
Reading 32 :32
Math Computation 16 :15
Applied Math 34 :45
TABE Administration and Support Materials
TABE Administration and Support Materials
• Test Directions• Norms Book• Technical Report• Individual Diagnostic Profiles• Building Skills with TABE• Getting to Know TABE
TABE 9 & 10 Flexible Options: TABE Online
TABE 9 & 10 Flexible Options: TABE Online
• Web based version of TABE 9&10• Rapid Registration of student in the system• Test scored immediately and automatically• Auto Locator for placing students in test
level• Completely secure test administration and
data storage• Timer and book marking features• Reports allow for aggregation of data• Improved accommodation functionality –
font color/size
TABE 9 & 10 Flexible Options: TABE PC
TABE 9 & 10 Flexible Options: TABE PC
• Entire test or any part completed on computer• Test scored immediately and automatically• Auto Locator for placing students in test level• Option for randomizing distractors/ correct
answer to improve test security• Timer and book marking features• Option for integrating data with TestMate
TABE testing and upload• Same reporting formats as TestMate TABE
Understanding and Using TABE Appropriately
Understanding and Using TABE Appropriately
Frequency of TABE assessments?Frequency of TABE assessments?
• Time prior to post-testing● 50- 60 hours of instruction
(40 min) recommended for ABE students
● 30-59 hours of instruction recommended for ASE students
●same level, different form● 120 hours of instruction
recommended ● same level, same form
TABE Levels by Content DifficultyTABE Levels by Content Difficulty
L 0 - 1.9
E 2.0 - 3.9
M 4.0 - 5.9
D 6.0 - 8.9
A 9.0 - 12.9
• Most questions on tests are written at the content difficulty indicated
• Small amount of questions above and below content range for vertical scaling
Using Best Practices to Administer TABE 9 and 10
Using Best Practices to Administer TABE 9 and 10
Pre-test/Post-test EvaluationPre-test/Post-test Evaluation
Best Practices in Administering TABEBest Practices in Administering TABE
• Inform student about the test experience.– Purpose of testing and use of results– When and where the test will be given– What subject matter will be tested– Types of test questions– Timing and test length– Practice questions
• Create and maintain appropriate testing environment.– Trained administrators and proctors– Appropriate spacing/seating of students
Variables That Can Affect Test ResultsVariables That Can Affect Test Results
Student • Fatigue• Motivation level• Physical
discomfort• Test anxiety
Environmental • Light levels• Temperature• Noise level• Ventilation• Other distractions
Best Practices in Administering TABE Best Practices in Administering TABE
• Use “Locator” to determine appropriate test level.– May not be used instead of test level– Is not an absolute prediction of ability– Has limited number of items– Avoid administering a level “too easy” or “too difficult”
• Use determined test level in a “standardized” manner.– Use proper timing– Read script verbatim– Follow test directions explicitly– Ensure comparable testing situation for all examinees
How to Help ExamineesHow to Help Examinees
Do explain: • Won’t know all the answers• Time frame• No preparation needed• Current skills• Breaks• No trick questions
Do not say: • Easy test• Extra time is allowed
Hand Scoring
• Must have the following to complete:– Scoreze Answer Sheet or CompuScan Answer
Sheet– Stencil overlay or Answer Key to score– Norms Book– Diagnostic Profile Sheet
Using TABE with Special Needs StudentsUsing TABE with Special Needs Students
Adult Students with DisabilitiesAdult Students with Disabilities
• Must self-identify• Must provide approved documentation• Must request accommodation
Modifications / Accommodations of Testing Procedures
Modifications / Accommodations of Testing Procedures
• Flexible scheduling• Flexible setting• Flexible responding• Flexible presentation• Flexible timing
TABE AccommodationsTABE Accommodations
• Making Test Accessible for Adult Students with Special Needs– TABE 9 & 10 -Large Print-(available in Complete
and Survey editions) – TABE 9-Braille-(available in Complete and Survey
Editions).– TABE 9-Audio Taped Edition-(available in
Complete and Survey Editions). – Use of TABE Online or TABE PC.
Maintaining Security and Integrity of TABE 9 and 10
Maintaining Security and Integrity of TABE 9 and 10
Security IssuesSecurity Issues
• Handling Testing Materials– Tracking with TABE Administrators, Students– Keeping Materials in Locked Storage
• No cell phones or electronic devices• Number tests and answer sheets• Plan for contingencies• Active monitoring
– 1 proctor for every 15 students being tested– Direct observation for entire test period
Interpreting and Using TABE ResultsInterpreting and Using TABE Results
Score Range vs. Content Range Score Range vs. Content Range
Skill Level
Grade Equivalent
Range L 0.0–4.9+ E 0.0–6.9+ M 0.0–9.9+ D 0.7*–12.9+ A 1.1*–12.9+
Skill Level
Grade Range
L 0–1.9 E 2.0–3.9 M 4.0–5.9 D 6.0–8.9 A 9.0–12.9
Content RangeGrade Equivalent
How to interpret scoresHow to interpret scores
– The “raw score” (number correct) cannot be compared from Form to Form
• Forms are “alternate” • but not 100% equal item by item
– Number Correct (NC) is starting point for determining meaningful scores• For manual scoring, use norms book
to interpret NC• TestMate TABE, TABE PC & TABE
Online generate instant test reports
Interpretation of Grade Equivalent Scores
Interpretation of Grade Equivalent Scores
• A GE of 7.6 in mathematics does NOT mean the student is capable of doing 7th grade math– it depends on the level of the test being given
• The GE score may not always keep pace with academic growth.– Is a 5.5 GE on M level the same as 5.5 on the D
level?– Can a student’s GE stay the same, but still
demonstrate academic growth?
TABE 9 & 10 Score TypesTABE 9 & 10 Score Types
• Norm-referenced Scores– National Percentile (NP)– Stanine (1-9)– Scale Score (0-999)– GE (0 – 12.9)
• Standard Error of Measurement (SEM)– All tests have error, but how much?
• Criterion-referenced Scores– Number correct– Percent mastery
Scale Scores…0 to 999Scale Scores…0 to 999
• Scale scores are used as
– a basis for deriving the other TABE 9&10 norm-referenced scores that can be used to describe test performance
• The scale score takes into consideration– the difficulty of the form:
• it takes more items correct in “M” than it does in “D” to get the same scale score
• Scale score is the only way to assess educational gain
– All items are on a “vertical” scale
– Being on an equal-interval scale means that the distance between the two scale scores has the same meaning at different points on the scale
Standard Error of Measurement (SEM)
Standard Error of Measurement (SEM)
• Every test has error; important to use SEM for correct interpretation of test scores– Estimate of amount of error to be expected in a
particular score from a particular test
• SEM is:– Attached to each scale score and takes a student’s
“true score” into account– Much larger near the floor or ceiling of the range of
performance for a given test
• Range of performance may be calculated by adding and subtracting the SEM to/from the scale score
38
Linking Data to Instruction
Linking Data to Instruction
Linking Data to Instruction Linking Data to Instruction
• Building Skills with TABE
• Achieving TABE Success
• Contemporary
• Steck-Vaughn
• Number Power and Number Sense
Turning the Focus to InstructionTurning the Focus to Instruction
• Diagnostic Reports - Why Create Them?– Gives an instant view of TABE skills on which to focus prior to
post-testing
– Gives teachers the opportunity to look at their entire class or select individuals performance on TABE Pre-test
– Helps teachers plan instruction – Small group and/or entire class activities based on common skill
weaknesses– Target specific weak skills utilizing the Study Guides books and – Form daily lesson plans
– Provides a reference for pulling extra materials for supplemental practice
– Shapes daily, direct instruction between teacher and student
Julie Anne Kornahrens, Director, Dorchester County Adult EducationApril 12, 2011
Item Analysis Data
1. Individual Diagnostic Profile
2.TestMate for TABE software or TABE PC
3.TABE Online Group Item Analysis Report
4.TABE Teachers Guides Instructional Binders
Turning the Focus to Instruction:
43
44
45
Turning the Focus to Instruction
Correlations from Publishers Content Where to find them? In the front of some of the Instructional
materials Links each question to targeted skill lessons
in that publisher’s materials Used for an Individual Students
Julie Anne Kornahrens, Director, Dorchester County Adult EducationApril 12, 2011
Creating & Using a TABE Study Plan (Prescriptive)• WHY Create Them?
– Provides relevant information to the student about areas of skill strength & weakness
– Ties relevance to TABE skills & skills needed for other academic areas (e.g., HSAP, HSE, etc.)
– Gives an immediate assignment– Focuses on appropriate TABE – Skill practice along
with the use of HSE materials– Gives instant success– Promotes student confidence
Turning the Focus to Instruction
49
Assessment ResultsAssessment Results
• Results of both pre- and post-tests are important to the:– Learner: They should know the reason they are placed
at a certain level, in certain materials, etc. They can also see how much progress they make.
– Teacher: Results should be used to guide instruction and curriculum development.
– Program: Critical for program improvement and accountability for achieving targeted outcomes.
Results should DRIVE the Instructional
Program & TRANSLATE into
POSITIVE Program Performance
New TABE Instructional Information: Lexiles
New TABE Instructional Information: Lexiles
• A Lexile is a measure related to reading level of text
• TABE reading scale score is matched to a Lexile scale
• Books & other texts have been assigned Lexile measures
• You can:– Match your learner with materials that are right for
his/her reading ability– Monitor growth in reading– Differentiate instruction for your learners– Classify and manage reading materials
TABE Level E
Grade 2-4 140L – 700LTABE Level L
Grade 1-2 Up to 300L
TABE Level D
Grade 6-8 665L-1100L
TABE Level A
Grade 9-12 855L-1210L
TABE Level M
Grade 4-6 445L-910L
Grade and Lexile Rangesby TABE Level
Grade and Lexile Rangesby TABE Level
● Aetna Health Care Discount Form (1360L)● Medical Insurance Benefit Pkg (1280L)● Application for Student Loan (1270L)● Federal Tax Form W-4 (1260L)● Installing Your Child Safety Seat (1170L)● Microsoft Windows User Manual (1150L)● GM Protection Plan (1150L)● CD-DVD Player Instructions (1080L)
A Portrait of Adult Reading DemandsA Portrait of Adult Reading Demands
Using LexilesUsing Lexiles
Achieving Reading Proficiency for All, Willard R. Daggett, ED.D.International Center for Leadership in Education, 2003
Free! How to Access Lexile Information for Your Learners
Free! How to Access Lexile Information for Your Learners
• Call CTB Customer Services at
1-800-538-9547
• Ask for your TABE Lexile Web Access
• Go to http://tabe.lexile.com and log in with your user name and password
• TABE Adaptive released in 2012– No Locator – No E,M,D,A – No 9/10– Reading, Math (Applied & Computation) and Language tests only– Adaptive engine will select test questions base on the student response on the
previous question– Testing time is shortened but diagnostics data similar to the Complete Battery
• Next version of TABE - Development scope work to begin– New Forms (rolled out over time from a collection of unscored test items from
TABE Adaptive and TABE Formative tests)– Higher level content above the current Level A– Aligned to TASC, OVAE/NRS standards and Common Core Standards
• TABE CLAS-E Online - TBA– Computer based testing for Adult ESL students
– Reading, Listening, Writing and Speaking
2014 Plans and Beyond2014 Plans and Beyond
TABE Paper and PencilTABE Paper and Pencil
• Currently TABE 9/10– NRS approved through 2017
• New Version needs NRS and State approval• Content for TABE 11 & 12
– Common Core– OVAE Adult Ed Standards– High School Equiv
• Levels and Forms – TBD
TestMate TABE TestMate TABE
• Scans TABE 9/10 answer sheets
• Updated reports
• Updated to support new scanners
• Updated to support new version of Windows
• Researching an enterprise version that would scan to a web database (TABE Online) for easier aggregation and data sharing
TABE PCTABE PC
• Currently TABE 9/10– NRS approved through 2017
• New USB option replaces Floppy Disk– Support for Windows 7 (above)
• Plans for 2014 and beyond– New interface– Adaptive– Linking to centralized database (TABE Off-
Line)
TABE OnlineTABE Online
• Currently TABE 9/10– NRS approved through 2017
• New Prescriptive Reports
• New Interface
• New Functionality – Selecting multiple students
• New Content– Testlets - FREE– Common Core aligned
Sample CBT ItemSample CBT Item
Best Practices for Administering TABEBest Practices for
Administering TABE• Follow test publisher’s
recommended testing procedures– Be concerned about
test security– Follow NRS and
state guidelines regarding the timing and frequency of testing
– Use the TABE to drive instruction
Questions? - Thank you !Questions? - Thank you !
Mike JohnsonNational Adult Assessment Manager(630) 789-4586 [email protected]