2015 Florida ACE Conference Update
Linda Taylor, CASAS Veronica Pavon-baker, CASAS State and National Trainer Claire Valier, CASAS State and National Trainer Phil Anderson, Florida Dept. of Education, State Trainer The Changing Landscape of Adult Education
WIOA: Workforce Innovation and Opportunity Act New NRS Educational Functioning Level (EFL) descriptors based on the College and Career Readiness Standards (CCRS) for Adults Emphasis on Integration of Education and Training (IET) Emphasis on career pathways Common measures: Skills gains for all partners, not just WIOA II-Adult Ed. Other indicators of progress- credentials, degrees, other Florida ACE Conference 2015 Preparing Adult Learners for the 21st Century
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 Preparing Adult Learners for the 21st Century CASAS Strategies to Support States and Address WIOA Implementation Content Standards Alignment with CCR Standards for Adults Assessment Alignment with CCR Standards andnew NRS Level Descriptors Transitions Document skills gains and workforce skills Technology Interoperability with WIOA partners Professional Development Online PD options Pat Florida ACE Conference 2015 2015 CASAS National Summer Institute CCRS for Adult ELLs In April 2013 the US Department of Education, Office of Career, Technical and Adult Education (OCTAE) published a study, CCR Standards for Adult Education identifying CCR standards from K-12 that are appropriate for Adult Basic Education (ABE) and Adult Secondary Education (ASE) learners. OCTAE is launching a similar study to identify appropriate K-12 CCR standards for Adult ESL learners and produce revised NRS EFL Descriptors for ELLs. This will take time -- 2 years or more. Note the change in terms from ESL (English as a Second Language) or ESOL (English to Speakers of Other Languages) to ELL (English Language Learners) Currently, Adult ELL programs are faced with the challenge of using the ABE/ASE CCR Standards for Adult Education and determining how to apply them for Adult ELLs. Programs continue to use current NRS ESL levels (EFLs) for now. Florida ACE Conference 2015 Revised Draft NRS ABE/ASE Levels and Descriptors
6 NRS Educational Functioning Levels for ABE/ASE 5 CCRS Levels (A E) Draft ABE/ASE NRS EFLs comments from the field Concerns about the lowest level Ability range is too broad and does not go low enough Low literacy learner ability is not well described Beginning level ABE learners will take a very long time to complete a level State Directors of Adult Ed suggested measuring skill gain instead of level completion Florida ACE Conference 2015 NRS EFL Descriptor Revisions and New Test Development
OCTAE published draft ABE/ASE NRS EFLs and got numerous comments from the field Timeframe for finalization of NRS EFLs for ABE/ASE affects test development New tests must align with CCRS Content for each test level must align with NRS EFLs Revision of NRS EFLs for ABE/ASE and ELLS are on different schedules Draft WIOA regulations proposed to implement revised ABE/ASE NRS EFLs when 1 test aligned to CCRS is approved This policy will probably change in final regulations expected in Spring 2016. We expect a transition period of several years after the final approval of EFLs and extension of approval of the currently approved tests to allow states to plan for the transition and implementation of the revised assessments. Florida ACE Conference 2015 New Test Series Timeline
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 New Test Series Timeline Write and field-test new items Conduct research studies with new test forms Submit new test series to NRS for approval for ABE/ASE, depending on finalization of revised NRS ABE/ASE Descriptors 2017 or later Ready for ABE/ASE programs to use 2017 or 2018 Submit new series to NRS for approval for ELL, depending on finalization of revised NRS ELL Descriptors 2019 or later Ready for ELL programs to use Linda Florida ACE Conference 2015 2015 CASAS National Summer Institute New Assessment Series CASAS is developing new Reading and Math series for use in ESL and ABE/ASE programs in the U.S. Field testing began in January The new Reading and Math series will be aligned to the College and Career Readiness Standards. At Levels C and D, they will focus more on academic skills and are designed for programs that transition adult learners to careers and post-secondary instruction. These new Reading and Math series will continue to measure CASAS Competencies, Content Standards and Task Areas. The new Reading and Math tests will be available using paper test booklets and answer sheets as well as online. Florida ACE Conference 2015 New Test Series Blueprints
CASAS new Reading Series Blueprint reflects: CASAS Competencies Content Standards CASAS Reading Content Standards CCR Standards for Adult Education in the areas of: Reading Reading Foundations Language Reading Task Areas Depth of Knowledge (DOK) Florida ACE Conference 2015 Field Input on Test Development Priorities
2014 CASAS Summer Institute Reading Focus Group Surveys CCRS Standards for new Reading series Survey of priorities for assessment by CCRS Reading Anchor Standard and Level Results indicated focus should be on CCRS R1, R2 and R4 Reading closely; cite evidence Main idea and key details Vocabulary CASAS Competency Areas and Reading Task Areas for new Reading series Survey of priorities for assessment by level Results confirmed the proposed test blueprint specifications Comments to include Reading and Thinking Skills at all levels This will be accomplished by aligning with the CCRS. Florida ACE Conference 2015 CASAS Competency Areas
Reading series blueprint specifications # of Items for CASAS Level CASAS Competency Area A B C D Basic Communication 9 Community Resources 7 Consumer Economics Health Employment 11 Government and Law 5 Learning and Thinking Skills 8 Total items 45 Florida ACE Conference 2015 CASAS Reading Task Areas
Reading series blueprint specifications % of Task Areas for CASAS Level Reading Task Areas A B C D Form 15% 10% Table/chart 20% Text 30% 45% Other format (e.g., sign, label, ad) 35% 25% Diagrams Florida ACE Conference 2015 Test Design and Development Considerations for Adult Education
Many constraints because of limited: funding and budgets for assessment time for assessment 1 hour technology resources -- need to offer both CBT and Paper tests staff availability for scoring assessments Multiple-choice has objective scoring. Short answer (generated response) is too expensive to train for and implement for most programs. background knowledge of most ABE/ASE learners mixed academic and non-academic backgrounds for ESL learners cultural familiarity for most ESL learners What we can control Display and item content and difficulty level Cultural appropriateness Vocabulary and question wording Item formats for learners with disabilities Florida ACE Conference 2015 New Reading Test Series Item Types
Multiple choice - All levels Comprehension Question (in existing Reading tests) Sentence completion Commonly used in academic test items Distractors vary in length (single word or clause) New text and item features Levels B, C, D Numbered lines in text passages Items containing references to numbered lines in text Underlined words embedded in passage Facilitates test takers ability to quickly go back to specific text location for evidence Better utilization of longer displays Level A only: Photo prompts and distractors for some items Completely computer-based delivery which will Requires touch screen or (mouse) click: Point and click Florida ACE Conference 2015 14 Item Family Approach At All Levels
More grouped items related to one display Display length ranges: single sentence to passage More efficient use of testing time Family members may vary in: Difficulty Standards/competencies addressed Florida ACE Conference 2015 15 Short Reading with Sentence Completion
The Food and Drug administration has issued an update on shellfish. This update supplemented an announcement released on May 18th, clarifying that canned product (now in addition to fresh and frozen shellfish) was considered adulterated. Consumers should avoid canned products because _____ fresh and frozen are healthier. they have been contaminated. their labels are incorrect. they expired on May 18th. Choose the word or words which would best complete the sentence. Florida ACE Conference 2015 16 New Item and Display Features
Syxtar provides computers and Internet connectivity for purposes limited to company business. However, employees are allotted 20 minutes of personal Internet usage per day. While the company attempts to provide a reasonable degree of privacy, all communications, including personal communications, that use company computers, technology, networks, etc., are the property of Syxtar. The company has the right to search and/or monitor any information, including personal messages, created, accessed, sent, received, and/or stored by any employee using Syxtar equipment or any equipment connected to the companys network. Since the companys monitoring software cannot filter all inappropriate websites, users may encounter websites that contain controversial, inappropriate, or offensive content. It is impossible for the IT Department to define such content comprehensively. It is the employees responsibility to determine if a website contains inappropriate material and, if it does, not to access such material using company technology. Which lines of the paragraph indicate that the company may inspect employees use of computers and internet? 1-2 3-4 5-8 9-12 Florida ACE Conference 2015 New Item and Display Features
Syxtar provides computers and Internet connectivity for purposes limited to company business. However, employees are allotted 20 minutes of personal Internet usage per day. While the company attempts to provide a reasonable degree of privacy, all communications, including personal communications, that use company computers, technology, networks, etc., are the property of Syxtar. The company has the right to search and/or monitor any information, including personal messages, created, accessed, sent, received, and/or stored by any employee using Syxtar equipment or any equipment connected to the companys network. Since the companys monitoring software cannot filter all inappropriate websites, users may encounter websites that contain controversial, inappropriate, or offensive content. It is impossible for the IT Department to define such content comprehensively. It is the employees responsibility to determine if a website contains inappropriate material and, if it does, not to access such material using company technology. Which word is closest in meaning to the underlined word as it is used in line 2? allowed delivered withheld assigned Florida ACE Conference 2015 Item Family Approach What point does the article make?
In business as in life, how we achieve our goals matters. Managers too often misinterpret what their staff is saying. What we observe in a workplace may not tell the whole story. It is misleading to look at end results as a measure of business success. What does the writer say about everyday life? A successful life is very similar to a successful business. Success in life is not necessarily measured by accomplishments. Everyone needs balance in their life between work and play. Most people do not take life as seriously as they should. Business or Busyness? The sight of a busy employee warms the heart of a manager. When workers are frantically busy with emails, constantly making phone calls, and consulting with fellow employees even during lunch, however, they are not necessarily as productive as they could be. Success in life may mean enjoying the journey rather than the destination, but success in business is measured by end results. Calling anding need to happen, but they should be purposeful and efficient. Meetings should be focused and short. And in an over-busy workplace, interruptions and distractions take their toll on everyones concentration and productivity. The atmosphere at some of the most successful companies is often anything but frenetic; it can be calm and casual. The relaxed atmosphere allows quiet focus that encourages productive output and meaningful results. These companies recognize a difference between busyness and business. Florida ACE Conference 2015 Item Family Approach What does the writer advocate?
reassessing customary indicators of worker productivity reviewing approaches to making staffing decisions reevaluating accepted concepts of manager/employee relations rethinking the emphasis on maximum worker output What does the writer offer? an approach to setting production goals an observation on workplace efficiency a method for measuring worker productivity a way of monitoring workplace activity levels Business or Busyness? The sight of a busy employee warms the heart of a manager. When workers are frantically busy with emails, constantly making phone calls, and consulting with fellow employees even during lunch, however, they are not necessarily as productive as they could be. Success in life may mean enjoying the journey rather than the destination, but success in business is measured by end results. Calling anding need to happen, but they should be purposeful and efficient. Meetings should be focused and short. And in an over-busy workplace, interruptions and distractions take their toll on everyones concentration and productivity. The atmosphere at some of the most successful companies is often anything but frenetic; it can be calm and casual. The relaxed atmosphere allows quiet focus that encourages productive output and meaningful results. These companies recognize a difference between busyness and business. Florida ACE Conference 2015 Item Family Approach What conclusion can be drawn from the article?
Productivity is not a good measure of end results. Improving efficiency will not increase productivity. Activity is not the only indicator of productivity. Productivity should not be a main concern for businesses. Based on the article, which of these statements is true? A busy staff is a sign of an ineffective manager. The more relaxed the workplace, the more productive the business. Staff input is vital in achieving business goals. Results are the best indicator of workplace efficiency. Business or Busyness? The sight of a busy employee warms the heart of a manager. When workers are frantically busy with emails, constantly making phone calls, and consulting with fellow employees even during lunch, however, they are not necessarily as productive as they could be. Success in life may mean enjoying the journey rather than the destination, but success in business is measured by end results. Calling anding need to happen, but they should be purposeful and efficient. Meetings should be focused and short. And in an over-busy workplace, interruptions and distractions take their toll on everyones concentration and productivity. The atmosphere at some of the most successful companies is often anything but frenetic; it can be calm and casual. The relaxed atmosphere allows quiet focus that encourages productive output and meaningful results. These companies recognize a difference between busyness and business. Florida ACE Conference 2015 Depth of Knowledge (DOK)
The new College and Career Readiness Standards and the Common Core State Standards in language arts and mathematics reflect higher-order thinking. DOK describes levels of cognitive processing One of 4 criteria of Norman Webbs Alignment Tool (2005), WI Center for Education Research Related to Blooms Taxonomy of Educational Objectives Knowledge, Understanding, Application, Analysis, Synthesis, Evaluation (1956) SOME BACKGROUND . . . The Web Alignment Tool, developed by Dr. Norman Webb, at the U. of Wisconsin Center for Education Research. NCLB has required states to prove that their assessments are aligned to their content standards, andWebbs alignment system is one of several alignment systems developed during the last 15 years. It has been used in more states than any other system.His approach seems to be the one most favored by the federal govt.The WAT is an electronic tool, in which teams enter information about assessments and content standards about matching DOK levels, as well as the extent to which the same categories of content appear in both (Categorical Concurrence); whether the span of knowledge assessed has been taught (Range-of-Knowledge Correspondence); equal emphasis of objectives within a standard (Balance of Representation); assessment difficulty related to the standard or clarity for users(Source of Challenge). Webbs DOK taxonomy is one of several taxonomies designed to classify intellectual behavior and complexity of thinking. Bloom found that over 95% of test questions students encounter require them to think only at the lowest level of recall.Thats why he developed (with others) his taxonomy. New book by Brookhart, How to Assess HOT Skills: Teachers understand the importance of teaching and assessing HOT skills, but they write recall-level test questions because they are the easiest kind to write. Florida ACE Conference 2015 Depth of Knowledge (DOK)
Four DOK levels: Recall, Reproduction, Recitation Application of Skill/Concept Strategic Thinking Extended Thinking Levels of cognitive processing, not difficulty Final Jeopardy is always a DOK 1!!! See the DOK Wheel handout Note of caution: The Depth of Knowledge is NOT determined by the verb, but the context in which the verb is used and the depth of thinking required.(See describe in the wheel at 3 different levels.) Some state-assessment items reflect Level 3 DOKs, but Level 4 DOK activities are reserved for classroom assessmentThese are usual inquiry-based projects, in which students develop and support hypotheses and carry out complex investigations. Final Jeopardy is very difficult, but its still straight recall of a fact. DOK levels are about depth of processing not difficulty level. Well look at examples of all 4 levels. Florida ACE Conference 2015 Academic Word Lists The Academic Word List (AWL)
developed by Averil Coxhead at the School of Linguistics and Applied Language Studies at Victoria University of Wellington, New Zealand. The list contains 570 word families which were selected because they appear with great frequency in a broad range of academic texts. The list does not include words that are in the most frequent 2000 words of English (the General Service List), thus making it specific to academic contexts. Alphabetized version (see handout) Florida ACE Conference 2015 Assessment and Research
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 Assessment and Research Field Testing CASAS is field testing new Reading and Math items in CASAS eTests Online. Research Studies related to Test Development CASAS requests agencies to participate in a variety of research studies for the new Reading test series. These studies began in July 2014 and will continue through 2018. Contact Andrea Shields at , ext. 143 to participate. Linda Florida ACE Conference 2015 2015 CASAS National Summer Institute Revision of the CASAS Reading Content Standards
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 Revision of the CASAS Reading Content Standards In 2013, CASAS began revising the CASAS Reading Content Standards Incorporated field input gathered since 2009 Revised the categories and standards Combined some related standards to streamline and shorten the document Reduced the number of literature-related standards Re-named and re-organized the categories and standards Number of categories reduced from 9 to 4 Number of standards reduced from 125 to 51 Added new standards from the CCR Standards for Adult Education in the English Language Arts and Literacy areas of Reading, Reading Foundations and Language All CCRS Anchor Standards in these 3 areas are referenced once or more in the revised CASAS Reading Standards. PRESENTER/TRAINER NOTES: Linda Florida ACE Conference 2015 2015 CASAS National Summer Institute Revision of the CASAS Reading Content Standards
Included references to the CASAS Reading Task Areas in Category 3: Forms Charts, tables, graphs, and maps Text Diverse formats (ads, labels, etc.) Measurement scales and diagrams CASAS has convened Technical Advisory Groups to get input on the revised Reading Content Standards and on plans for the new Reading series, including input from Florida practitioners Revisions to the CASAS Reading Content Standards will be completed in Fall CASAS will offer a webinar to present the revised version Florida ACE Conference 2015 Revised CASAS Reading Standards Categories
1 Foundational Literacy 2 Language and Vocabulary 3 Literal and Inferential Comprehension Task and Text Types - includes CASAS Reading Task Areas Reading Comprehension Strategies 4 Higher Order Reading Skills Informational and Literary Text Literary Text Only To align assessment with instruction, the categories for reporting test results for the new CASAS Reading series will be the same as the categories in the revised CASAS Reading Standards. Florida ACE Conference 2015 NEW Life and Work Listening 980 Series
CASAS Life and Work Listening 980 series (Forms ) was recently approved by the USDOE Office of Career, Technical and Adult Education for NRS reporting purposes through June 30, 2017. Florida agencies may continue using the 80 series Life and Work Listening according to FDOE Policy: For information purposes, not for NRS reporting For instructional placement Florida agencies may also use the new 980 series Life and Work Listening according to FDOE Policy: Florida ACE Conference 2015 NEW Life and Work Listening 980 Series
Florida agencies will continue to be required to report Reading and Listening scores to the FDOE. Florida agencies may use either the 80 or 980 series listening tests for reporting test scores to FDOE, not for NRS reporting. FDOE will continue to report only CASAS Reading scores to NRS. Florida ACE Conference 2015 NEW Life and Work Listening 980 Series
Students pre-tested on one series must post-test on the same series. 80 to 80 980 to 980 Agencies that decide to use the new 980 Life and Work 980 Series must pretest and post-test using the new series (Forms ). Agencies may use the Appraisal Form 80 or the eTests Listening Locator to place into the Listening 980 Series. Florida ACE Conference 2015 NEW Life and Work Listening 980 Series
980 Series tests are slightly longer to improve content coverage. 980 series test content is similar to the 80 series similar CASAS Competencies and Listening Content Standards are measured. There are additional lower level items at the beginning of Level A and additional higher level items at the end of Level C. The item types are the same except Level A test booklets (981/982) contain an item type with color photos. Florida ACE Conference 2015 Life and Work Listening 980 Series
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 Life and Work Listening 980 Series The LWL 980 series has revised scale scores: Linda Florida ACE Conference 2015 2015 CASAS National Summer Institute DOE Policy on Use of Lower Score
Adult Education Assessment TA Paper, Page 2 Students enrolled in the Adult ESOL course are required to test in reading and listening skill areas. Use the reading score to establish and report to FDOE. Use the lower score of reading or listening to assign the student to a classroom that provides instruction at the level of the lower score. Submit both reading and listening test information to the FDOE in accordance with FDOE instructions for reporting. Florida ACE Conference 2015 Use of Test Results for Instruction
CASAS is a system with 3 main supports: Curriculum Instruction Assessment Teachers need to know the areas their students are struggling in. Florida ACE Conference 2015 CASAS: An Integrated Systems Approach
Curriculum Assessment Instruction Florida ACE Conference 2015 Class Performance by Competency sample report
Test Question Number The Competency Description gives more detail about the Competency Number Percentage of Students who answered this question correctly This is another sample TOPSPro reportand shows class performance by competency. It is the electronic version of slide 40. The Competency Number on which this question is based Florida ACE Conference 2015 3 Resources for Instruction
Content Standards Task Areas Competencies Florida ACE Conference 2015 Content Standards Content Standards are clear statements of skills that students need to have at specific levels. Content standards identify the underlying basic skills associated with CASAS Competencies. Content Standards Task Areas Competencies Florida ACE Conference 2015 Test Items: Task Areas Reading Task Areas Listening Task Areas Forms
Charts, maps, consumer billings, matrices, graphs, or tables Stories, articles, paragraphs, sentences, directions, or pictures Signs, price tags, ads, or product labels Measurement scales and diagrams Listening Task Areas Picture prompt Comprehension question Predict next line of dialogue Identify true statement based on prompt Content Standards Task Areas Competencies Florida ACE Conference 2015 CASAS Competencies Competency Content Areas 0. Basic Communication
1.Consumer Economics 2.Community Resources 3.Health 4.Employment 5.Government and Law 6.Math Learning and Thinking Skills Independent Living FL Adult ESOL Standards are strongly correlated to the CASAS Competencies. Download CASAS Competencies at Take some time for participants to look through the Competencies. There are nine content areas. Here are two things to remember: The list is not a power list. The numbering system does not mean that 0 Basic Communication is easier than other content areas. It is just a method of organizing the competencies This is the master competency list you would not be expected to teach every single competency! Florida ACE Conference 2015 The Competency Coding System
Content Area 2.Community resources Competency Area Understand how to locate and use transportation Competency Statements 2.2.2 Recognize and use signs related to transportation 2.2.4 Interpret transportation schedules and fares Go over the coding system. Every competency is identified with a three-digit number. The first digit refers to the content area. Slide shows Content Area 2 Community Resources. The second digit corresponds to a competency area represents the competency area of Understanding how to locate and use different types of transportation and interpret travel related information. The three-digit competency statement, 2.2.2, describes a measurable action, Recognize and use signs related to transportation. Competency statement also addresses this content. Every test item in the CASAS system correlates to at least one specific competency. Florida ACE Conference 2015 Time allowed for Reading Tests
CASAS policy is to allow one hour for reading tests. This rule applies to all tests, from Level A through Level D. When time is called at one hour students may finish the question they are on but may not continue to the next question. Florida ACE Conference 2015 Use of Touchscreens All CASAS Reading and Listening tests can be used with a touchscreen. They are especially useful for adult learners who are not familiar with using a computer. Built-in touchscreens have come down in price and are much more affordable than they were before. Florida ACE Conference 2015 Assessment ESL Intake Process (Using Forms 27/28 Online)
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 Assessment ESL Intake Process (Using Forms 27/28 Online) PRESENTER/TRAINER NOTES: Linda (Jane to come up when she is finished) Intake and orientation is your opportunity to welcome students to your program and determine their needs, goals, skill levels, and education and work backgrounds. With an effective intake and orientation process you'll create a learning environment that works with each of these factors. You can promote student retention rates, improve learning gains, and build overall program success. Florida ACE Conference 2015 2015 CASAS National Summer Institute Use of Forms 27/28 The Form 27 Practice Items are used in the ESOL intake process as the first step in a screening process to determine whether a student might have limited literacy skills. The Form 27R or 28R pre- and post-tests can be given to students who take Form 81R or 82R and score below the accurate range. This test sequence has been programmed in CASAS eTests. Florida policy for scoring Forms 27/28 is that they are only valid up to a CASAS scale score of 180. If a student scores above 180 on Form 27R or 28R, retest with Form 81R or 82R. Forms 27R and 28R pre- and post-tests are available in CASAS eTests As with all Reading and Listening tests in CASAS eTests, these forms can be used with a touchscreen. Florida ACE Conference 2015 + CASAS Technology Online - Fully Integrated Desktop Import/Export
Point out that states can implement both editions. Desktop Florida ACE Conference 2015 Advantages of Using No more paper answer sheets and bubbling
No more scanning and correcting errors Much reduced staff time and lower costs Increased security Seamlessly administers locator & pretest Automatically assigns next test Student sees score at end of test (optional) PRESENTER/TRAINER NOTES: Agencies have the option of providing web-based tests in combination with paper- based tests. We highly encourage agencies to use CASAS eTests. Nationally recognized system for computer delivery of standardized and adaptiveassessments Use anywhere with Internet connection and computer running Windows(can be used on Macs running Windows) No need for test booklets, CDs/cassettes, answer sheets or #2 pencils Intuitive interface: questions display left of stem Includes practice test items Discourage cheating: no A,B,C,D responses Locator seamlessly moves examinee into an appropriate-level pretest Provides summary results immediately after each test Automatically assigns the next test Given individually or to a group Accommodation features: screen-reader compatible scalable displays, stems, options Retractable toolbar identifies examinee, test form, remainingitems and remaining time. Generate Student Competency Performance reports on-site! Florida ACE Conference 2015 Advantages of Using Online Access anywhere via Internet
Fully integrated with TOPSpro Enterprise No more transferring data with TOPSpro Reports on demand from anywhere Proctor management console controls test session Easier access for teachers and administrators PRESENTER/TRAINER NOTES: Agencies have the option of providing web-based tests in combination with paper- based tests. We highly encourage agencies to use CASAS eTests. Nationally recognized system for computer delivery of standardized and adaptiveassessments Use anywhere with Internet connection and computer running Windows(can be used on Macs running Windows) No need for test booklets, CDs/cassettes, answer sheets or #2 pencils Intuitive interface: questions display left of stem Includes practice test items Discourage cheating: no A,B,C,D responses Locator seamlessly moves examinee into an appropriate-level pretest Provides summary results immediately after each test Automatically assigns the next test Given individually or to a group Accommodation features: screen-reader compatible scalable displays, stems, options Retractable toolbar identifies examinee, test form, remainingitems and remaining time. Generate Student Competency Performance reports on-site! Florida ACE Conference 2015 Advantages of Using Nationally recognized learner management and accountability software Teachers Spend zero time scoring tests Generate individual and class reports on demand Manage enrollment and track attendance with ease Administrators Monitor program effectiveness Track students in multiple programs Meet accountability requirements State Decision Makers Generate statewide NRS reports Access statewide aggregated data in real time Monitor state and local level data PRESENTER/TRAINER NOTES: Review bullets. Florida ACE Conference 2015 Test Results for Students
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 Test Results for Students Sample report displays a summary of the students results at the end of the test. per student PRESENTER/TRAINER NOTES: Richard This slide shows an example of a Personal Score Report (PSR) displayed immediately after a test is closed. Note! Displaying the report is optional. The Print button is optional too! A copy of the PSR is also available via TOPSpro Enterprise. Sample report available on the CASAS website at:> Product Overviews > Software > TOPSpro Enterprise > Sample Reports Florida ACE Conference 2015 2014 CASAS National Summer Institute for Teachers PRESENTER/TRAINER NOTES:
This individual skills profile report is an example of a student enrolled in an ESL program. This sample displays competencies assessed in reading and listening. Florida ACE Conference 2015 for Teachers PRESENTER/TRAINER NOTES:
This is the electronic version of Class Profile worksheets provided in Test Administration Manuals (TAMS). Notice the similarities. Florida ACE Conference 2015 for Teachers PRESENTER/TRAINER NOTES:
The Student Performance report shows test results of an individual student on a given test form by displaying the competency number and statement for each test item and indicating whether the student correctly answered the item. This report is sorted by order of test items. This is the electronic version of Student Performance worksheets provided in Test Administration Manuals (TAMS). Florida ACE Conference 2015 for Teachers PRESENTER/TRAINER NOTES:
This report shows every student who has taken a test and displays the test history for each studentincluding CASAS test form, test date, scale score, hours of instruction, and scores outside of accuracy range. Florida ACE Conference 2015 for Teachers Class PRESENTER/TRAINER NOTES:
Non-bold Competency Descriptions and Numbers give additional details about the test item. Bold Competency Descriptions give details about the Competency Number Test Question Number Percentage of students who answered this question correctly The Competency Number on which this question is based Task Area Class PRESENTER/TRAINER NOTES: This slide shows a class performance report sorted by percentage correct. This report is a popular alternative to the Class Profile report displayed on the previous slide. Teachers can readily identify areas of greatest need to develop lessons that address those needs and prepare students for post/progress-testing. Florida ACE Conference 2015 for Administrators Florida ACE Conference 2015 for Administrators PRESENTER/TRAINER NOTES: This report is designed to show, by Class, the average gains (or setbacks) achieved between the scale scores of the First and the Last tests taken (not necessarily highest) within a defined period. Florida ACE Conference 2015 for Administrators PRESENTER/TRAINER NOTES: Lists students with their last CASAS test form, scale score, and test date. Based on the previous test result, this report displays, by modality, the next-assigned test (NAT) form and level for the specified date range. This report replaces Suggested-Next Charts. Florida ACE Conference 2015 Technology Where Weve Been (PY14-15)
New HSE GED 2014, HiSET, TASC Batch Insert and Batch Edit New server / performance optimization Info, Copy, Notes, Schema features Growing User Base Welcome Tennessee! Florida ACE Conference 2015 CASAS Studies with HSE Tests
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 CASAS Studies with HSE Tests High School Equivalency (HSE) Tests GED- General Educational Development Test ACE and Pearson VUE CASAS-GED study started July 1, 2014 with preliminary data Spring 2015 HiSET- High School Equivalency Test ETS CASAS-HiSet Study starting this Fall TASC- Test Assessing Secondary Completion CTB McGraw Hill PRESENTER/TRAINER NOTES: Jane Florida ACE Conference 2015 2015 CASAS National Summer Institute Technology Where Were Going (PY15-16)
Workforce Skills Certification System (WSCS) Barriers to Employment New Regional level to TE hierarchy Piloting Co-Enrollment with WIOA partners Brand new interface for eTests Online Enhancing TE database for WIOA Florida ACE Conference 2015 Technology Coming in PY15-16! Testing on multiple devices
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 Technology Coming in PY15-16! Testing on multiple devices Windows based computers Apple based computers Chromebook and iPad Tablets and touchscreen PRESENTER/TRAINER NOTES: Richard Could your agency benefit from access to CASAS tests, results and reports at your fingertips? You can essentially use CASAS Online to access program data anywhere with Internet connection and computer running Windows. No delay in retrieving results and generate reports. CASAS Online is afully integrated system with testing, automated scoring, recording, and reporting student, class, program, and agency outcomes. All data is stored on the server hosted by CASAS through Amazon Web Services (AWS); nothing is stored on a local machine. CASAS maintains an HTTPS* connection and secure browser environment. *Hypertext Transfer Protocol over Secure Socket Layer is a protocol for secure communication over a computer network, with especially wide deployment on the Internet. CASAS Online is privacy protected under the Family Educational Rights and Privacy Act of FERPA , or the Buckley Amendment, is a United States federal law. Florida ACE Conference 2015 2015 CASAS National Summer Institute Technology Under Development in PY15-16 WIOA Interoperability
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 Technology Under Development in PY15-16 WIOA Interoperability Sharing co-enrollments Exchanging common data Linking regional partners Managing common IDs PRESENTER/TRAINER NOTES: Richard Could your agency benefit from access to CASAS tests, results and reports at your fingertips? You can essentially use CASAS Online to access program data anywhere with Internet connection and computer running Windows. No delay in retrieving results and generate reports. CASAS Online is afully integrated system with testing, automated scoring, recording, and reporting student, class, program, and agency outcomes. All data is stored on the server hosted by CASAS through Amazon Web Services (AWS); nothing is stored on a local machine. CASAS maintains an HTTPS* connection and secure browser environment. *Hypertext Transfer Protocol over Secure Socket Layer is a protocol for secure communication over a computer network, with especially wide deployment on the Internet. CASAS Online is privacy protected under the Family Educational Rights and Privacy Act of FERPA , or the Buckley Amendment, is a United States federal law. Florida ACE Conference 2015 2015 CASAS National Summer Institute 2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting
June 16, 2014 Technology How does TOPSpro Enterprise help local and state administrators? Local, regional and statewide is aggregated All data is auditable down to the student level Skills performance can be compared at all levels Programs can be monitored in real time via the Internet PRESENTER/TRAINER NOTES: Richard Point out that states can implement both eTests Online and Desktop editions within their state and still aggregate all data at the state level. Florida ACE Conference 2015 2015 CASAS National Summer Institute Technology for State Decision Makers
2014 National Consortium, Certified Trainers, and Trainers-in-Progress Meeting June 16, 2014 Technology for State Decision Makers TOPSpro Enterprise Supports all NRS approved Adult Education Assessments NRS Approved Pre/Post-Tests CASAS BEST GAIN TABE High School Equivalency (HSE) GED 2014 HiSET TASC PRESENTER/TRAINER NOTES: Richard Florida ACE Conference 2015 2015 CASAS National Summer Institute Data Access Rights TE Demonstration Florida ACE Conference 2015 Next Assigned Test Charts
CASAS Implementation Training Next Assigned Test Charts Next Assigned Test charts identify the appropriate next test Each form has its own chart Aligns computer and paper-based recommendations Charts posted at PRESENTER/TRAINER NOTES: Jane Introduce Next-Assigned Test (NAT) charts. NOTE! This is a significant change to what is formerly known as Suggested Next Test charts. All test series are updated and apply to both paper-based and computer/web-based testing. Once you have an appraisal score, how do you know which test to administer? NAT charts help you select the appropriate next test. What is the next listening test for the student who scores 204 on Form 80 Listening? (983L) What is the next reading test for the student who scores 222 on Form 80 Reading?(085R or 185R) Review parts of the chart. Point out that there is a separate chart for each appraisal and each reading, math, and listening test form. Test administration manuals contain NAT charts and they are also available on the CASAS website. Consider performance on classroom activities or informal assessments, educational background, life experiences, use of English outside classroom, etc. to decide which level to administer. Ask if anyone has questions. Automatically assigns the next test. Florida ACE Conference 2015 2014 CASAS. All rights reserved. Online Provides an essential link between assessment and instruction in the CASAS system. An easy-to-use database of 2,300+ commercially available instructional materials. Titles coded to skill levels, CASAS Competencies, and skill areas. Complimentary, unlimited access. Visit> Product Overviews > Curriculum Management & Instruction > Instructional Materials: QuickSearch Online PRESENTER/TRAINER NOTES: Introduce QuickSearch Online by going over bullets. Complimentary Unlimited access Helps program coordinators and instructors select materials to match their curriculum. Participants may search by title, competency, program, level, skill area, publisher, and test form. Encourage participants to use QuickSearch to identify which competencies are targeted in the texts they are already using. Available free of charge on the CASAS Web site. If you have access to the Internet, you may wish to go to QuickSearch at this point and demonstrate how to use the database. Suggestion: ask participants for the title of a favorite instructional resource and Search by Title to see the CASAS Competencies addressed in that title. Visit linked resource if time permits and Internet connection is available. Florida ACE Conference 2015 CASAS Partnership with Burlington English
CASAS has entered into a strategic partnership with Burlington English as an official CASAS partner. Burlington English has developed an online blended learning system for adult ESOL learners that is strongly aligned with the CASAS system. For these reasons, it has been designated as an official CASAS preparation system. A report of a formal study of CASAS test results by adult ESL students using Burlington English is forthcoming. Florida CASAS Network Meetings: 2nd Tuesday every month, 2:00 - 3:00 pm (Eastern Time) Florida ACE Conference 2015 Adult LowLevel Literacy Curriculum Modules
CASAS Competencies and Content Standards linked with informal assessment and CASAS standardized assessment. Universally designed strategies with alternate formats, metacognitive and self-determination skills, and community transition activities. Use with pre-beginning and beginning readers. Ten theme-based modules for learning progression. Complimentary, unlimited access. Visit> Product Overviews > Curriculum Management & Instruction > Curriculum Modules (Low Level Literacy) PRESENTER/TRAINER NOTES: Visit linked resource if time permits and Internet connection is available. Florida ACE Conference 2015 CASAS Website: www.casas.org
A great resource for training and professional development. Florida ACE Conference 2015 CASAS Training CASAS Recommendation for training: It is recommended that all staff responsible for administering, scoring and interpreting test results complete CASAS Implementation Training which is available online at no cost. Florida ACE Conference 2015 CASAS Training Two options for initial training:
Attend an Implementation Training conducted by a Florida certified state CASAS trainer. If there is no state trainer in your district, request information about availability of state trainers from CASAS or FL DOE (Phil Anderson -- Two steps to get trained online:training.casas.org Complete the CASAS online Implementation Training at training.casas.org Complete the FL State Policy online module on the Florida Institute for Professional Development of Adult Educators website: Recertify with Beyond Implementation Training: training.casas.org Florida ACE Conference 2015 CASAS Training Training to start using CASAS eTests
eTests Online Coordinator Certification eTests Online Proctor Certification Go to training.casas.org Florida ACE Conference 2015 Whats Your Success Story?
CASAS is collecting videos and stories to highlight youth and adult education and training success across the country. Share how CASAS has helped your learners or program. The challenge The solution The outcome PRESENTER/TRAINER NOTES: Visit the CASAS website to read how agencies and programs across the country are using CASASto assist adults functioning at or below a high school level in attaining the basic literacy skills to function effectively on the job, in the community, and in the family. See how programs establish comprehensive performance accountability systems, address core indicators of performance, integrate literacy and occupational skill instruction, and evaluate the effectiveness of adult education and literacy programs. We invite you to Share Your Story! The Challenge (briefly describe the challenge your program was facing) The Solution (What did CASAS provide to help you overcome that challenge? Which CASAS assessments, resources, people/staff, etc. helped?) The Outcome (what was the result of implementing CASAS?) Visit linked resource if time permits and Internet connection is available. Share your story at> Social Media Newsroom > Success Stories Florida ACE Conference 2015 Monthly Florida CASAS Network Meetings
Who and Why? Any Florida agency using CASAS assessment To answer questions and discuss CASAS assessment and Florida DOE policy related to CASAS assessment When? On Tuesday at 2 pm Eastern time Next ones: Tuesday, October 13, 2015 Tuesday, November 17, 2015 Tuesday, December 8, 2015 Register Online: Topics? Post to CASAS Florida Forum, orPhil or Linda Florida ACE Conference 2015 Contacts Linda Taylor, CASAS , ext. 186 Co-Presenters, all FL State Certified CASAS Trainers: Veronica Pavon Baker Claire Valier Phil Anderson, FDOE CASAS Office Tech Support from 9 am to 8 pm Eastern time:press 2 To get started with CASAS eTests: Carol Farrell, ext. 123 CASAS eTests Training: Dawn Montgomery, ext. 126 Florida ACE Conference 2015