Got Data? Using your ACT tools to improve performance on all levels, moving students to College and Career Readiness

  • Published on
    25-Feb-2016

  • View
    27

  • Download
    2

DESCRIPTION

Got Data? Using your ACT tools to improve performance on all levels, moving students to College and Career Readiness. Who Benefits? Schools Teachers Counselors Districts States Students. College and Career Readiness System. The Foundation: National Curriculum Survey - PowerPoint PPT Presentation

Transcript

PowerPoint Presentation

Got Data?

Using your ACT tools to improve performance on all levels, moving students to College and Career Readiness

Who Benefits?

Schools

Teachers

Counselors

Districts

States

Students

The Foundation:

National Curriculum SurveyCollege Readiness StandardsTMCollege Readiness BenchmarksCollege and Career Readiness System

The foundational components for the College and Career Readiness System are ACTs College Readiness Standards and ACTs College Readiness Benchmarks. The scores achieved on EXPLORE, PLAN, and the ACT fall into specific readiness score ranges that speak to what a student knows and is ready to learn next. ACT scores mean something. They are reflective of where the student is in relationship to College Readiness.

The level or degree of readiness (below, at, or above) is associated with how far off or how far near the student is to the ACT established benchmarks. Through the individual student score reports and the tables in the aggregate reports counselors, teachers, programs facilitators (like AVID/Gear Up), and administrators can help individual students, groups of students, schools, and districts improve student success and their college going culture. 3http://www.act.org/research-policy/national-curriculum-surveyACT National Curriculum SurveyThe Foundation of ACTs College Readiness SystemConducted every three to five yearsNationwide survey of educational practices and expectationsCollege instructorsHigh school teachersMiddle school teachersElementary teachers

4The ACT National Curriculum Survey is a foundational piece of research that ACT conducts every 3-5 years.The survey collects data about what entering college students should know and be able to do to be ready for college-level coursework in English, math, reading, and science, but also surveys what is being taught in elementary, middle, and high schools.

ACT National Curriculum SurveyThe Foundation of ACTs College Readiness SystemIdentifies the skills and knowledge postsecondary institutions expect of studentsGuides the development of ACTs assessments that measure college-ready skillsInforms efforts to develop, refine, and update academic standards Inform policymakers and educators

5The National Curriculum Survey provides the research foundation that informs the creation and development of ACT assessment programs.

Ensures ACT curriculum-based assessments accurately measure skills high schools teach and instructors of entry-level college expect Ensures that ACT Explore, ACT Plan and the ACT continue to measure college-ready skillsSurveys completed nationally by instructors of elementary, middle school, high school, first-year college, and college remedial courses across the country. Consultation with content area expertsDetermines what skills and knowledge postsecondary institutions expect of their entering students and how these expectations compare to what is being taught in high school core preparatory courses.Identifies gaps in what high schools are teaching and what colleges and univ expect

6The acquisition of the knowledge and skills a student needs to enroll in and succeed in credit-bearing first-year courses at a postsecondary institution (such as a two- or four-year college, trade school, or technical school) without the need for remediation.The ACT Definition7The ACT College Readiness StandardsDirect link between what students have learned and what they are ready to learn next. Help interpret what the scores earned on ACT Explore, ACT Plan, and the ACT meanIdentify the knowledge and skills students are likely to demonstrate at various score levels on each academic test

The ACT College Readiness Standards, as mentioned earlier, are based upon years of research. They are structured and published in a format that can be used as a ladder for moving students up in both college/career-ready skills and ACT performance. The Standards are matched to specific scoring ranges that show what students are likely to know, based upon their scores in English, Math, Reading, and Science. Ideas for Progress, matched to each score range, provide specific information to teachers and to students as to what they need to learn next in order to advance to the next higher score range. (There are also Standards and Ideas for Writing, for ACT.) The standards can be used with EXPLORE, PLAN, and ACT scores, and can be in effect an ACT IEP for documenting and planning interventions to increase college readiness skills for students at every level. The system works well both for students who are working hard just to meet the benchmarks, and for students who are already scoring in the high ranges but want to reach even higher achievement levels, including those whose goal is that perfect score of 36.

78ACT College Readiness StandardsSuggested learning experiences provide links between the Standards in one score range and those in the next (higher) score range.Ideas for progressing to the next score range demonstrate ways that information learned form standardized test results can be used to inform classroom instruction.

http://www.act.org/standard/index.html8Statements that describe what students are likely to know and be able to do. 80% of students who achieve a score in this range demonstrate these skills.And statements that provide suggestions to progress to a higher level of achievement

A PDF of the College Readiness Standards documents can be found at www.act.org/readiness. In this version, the score ranges are found at the top of the chart, with skills (matched to score ranges) grouped by standard. If you scroll to the bottom of the page at the web site, you will find links to the matching Ideas for Progress for each score range. The hot links at the top indicate that there are versions for EXPLORE, PLAN, and ACT. The standards do not change, only the range, as the top score for EXPLORE is 25, 32 for PLAN, and 36 for ACT.

This slide illustrates the ladder characteristic of the College Readiness Standards charts. Posters for classroom use will also be available in two versions, one that has the standards for all subjects, and individual posters by subject (English, Math, Reading, Science, and Writing). Instructional Support Materials for using the ACT College Readiness Standards can be found at http://www.act.org/standard/instruct/index.html

910ACT College Readiness Benchmarks UPDATEDEmpirically derived50% chance of achieving a B or higher or about a 75% chance of achieving a C or higher in the corresponding credit-bearing college courseTestCollege CourseACT PlanThe ACT8th Grade9th GradeEnglishEnglish Composition13141518Math College Algebra 17181922ReadingSocial Sciences16171822ScienceBiology18192023ACT ExploreNEW

ACTs empirically derived College Readiness Benchmarks predict the likelihood of success in corresponding credit-bearing first-year college courses in each specific subject area. Benchmarks are scores on the ACT subject area tests that represent the level of achievement required for students to have a 50% chance of obtaining a B or higher or about a 75% chance of obtaining a C or higher in corresponding credit-bearing first-year college courses. These college courses include English Composition, College Algebra, Biology, and introductory social science courses. Based on a national sample of colleges and universities, the Benchmarks are median course placement values across these institutions and as such represent a typical set of expectations.

During the routine practice of monitoring predictive validity, ACT analyzes the performance of students in college, looking at what is happening to students in the credit-bearing first-year college course in each specific content area. The data gathered through this routine review indicated a need to make adjustments to current ACT College Readiness Benchmarks in Science and Reading.

Typically students will take the ACT in the Spring of their Junior year. The scores of these assessments are returned to the students and to their high schools in mid- to late May. When school personnel review and analyze student scores they will be able to identify students that score below one or more of the College Readiness Benchmarks. Because students are at the end of their Junior year, the student and the school only have two semesters to build the students skills to make sure the student is meeting these benchmarks.

ACT research would indicate that students that meet all four College Readiness Benchmarks have an increased change of being ready for entry level college courses and have a better chance of being successful in their college courses and certificate/degree completion.

So ACT has created assessments, in lower grades, so students can use the results to identify their strengths and weaknesses in relation to the students college and career readiness. The earlier we can assess the college and career readiness of our students, the earlier we can provide coursework, supports, and interventions to assist students in developing those skills that are going to prepare them to be ready and successful in their post high school pursuits.

We can use the benchmarks in the early grades to determine which students are on track and off track and can assist students in the development of personal improvement plans.

10What does a score mean? 2913162332212518361531Nothing!.until it is interpreted and used.11State Level Reports

Annual Condition of College and Career Readiness Report

Annual State Class Profile Report

http://www.act.org/newsroom/data/2013/index.htmlWeb

132013 A year in review for North Dakota7,102 of your graduates, which is an estimated 98% of your graduating class, took the ACT North Dakota had an average ACT Composite score of 20.55,168 of 10th graders took ACT Plan872 of 8th graders took ACT Explorehttp://www.act.org/newsroom/data/2013/

http://www.act.org/newsroom/data/2013/states/pdf/NorthDakota.pdf

Now lets take a look at what state date looks like.

13142013 A year in review for North Dakota

3116141326Numbers outside the pie chart are national %.14152013 A year in review for North Dakota

162013 A year in review for North Dakota

Since the reading benchmark went up a point to 22, fewer students met that benchmark this year. Conversely, since the science benchmark went from a 24 to a 23 this year, more students met that benchmark than in the past.16172013 A year in review for North Dakota

Students in the middle band require the least amount of intervention to meet the benchmark. They are the low hanging fruit.17182013 A year in review for North Dakota

192013 A year in review for North Dakota

This is the national ND class profile for 2013. Schools receive an identical report for their students.20

School/District Reports for EXPLORE/PLAN/ACT

ACT Class Profile

Student List Report

Research Data File (CD)

Profile Summary Report (EXPLORE/PLAN)Presentation Packet

Linkage Reports (EXPLOREPLAN, PLANACT)Item Response Summary Report

Early Intervention Roster Report

Student Score Report

Heres where you find the individual student data for your school.24

Page 4 in Profile Summary Report

Page 4 in Profile Summary Report

9%48%

So how many students in your school are meeting the College Readiness Benchmarks. Table 1c in your Profile Summary Report offers a quick answer to that question and also gives some insight into the skillset of groups of students when analyzed with the College Readiness Standards.

In this table, we bring the College Readiness Standards together with your students scores to give you information on the skillsets of groups of students. [Click] (Point out the CRS ranges and the four content areas.)

[Click] Another key piece of data is the percentage of students at or above the Benchmark in a particular area. This % is important because sometimes a Benchmark falls in the middle of a CRS score range, so it would be difficult to determine quickly how many students met the Benchmark.

So, putting the pieces together in an example. [Click] The Benchmark in Science is 20, and we can see at the bottom of the table that 9% of students in this example last year met that mark. [Click] The largest percentage of students (48%) fell in the 16-19 CRS range, which is just below the benchmark score.

Pause for discussion here: What do you need to do with these standards?

Now, it would be easy to look at the College Readiness Standards for that score range and see what Ideas for Progress are suggested, which could easily become the content for targeted tutorials or bell-ringer type activities, while also looking systemically at those skills to see when those skills are introduced and mastered in the curriculum. That may suggest some curricular changes that need to be made.

Now, lets take a few minutes and look at your own reports. In your Profile Summary Report, youll be looking on Page 4. [Give them a few minutes to review their data and an opportunity to share their observations before moving on.]

25

ACT PLAN Profile Summary Report How many students dont have a future plan? Pay attention to the areas that students express additional needs/help.26

ACT PLAN Profile Summary Report

ACT PLAN Presentation Packet

North Dakota EXPLORE/PLAN Linkage Report Are students moving progressively from EXPLORE to PLAN, or are they losing ground? Do the curricula align from 8th-9th-10?29

North Dakota EXPLORE/PLAN Linkage Report 30Item Response Summary Report

The IRSR Report shows you the percentage of your students who selected the:

-correct response to each item

-incorrect response.

-the percentage who did not answer the item.

-the average percentage of students who responded correctly to the items in each content area.

**Draw attention to the two answer choices at the top. Explain that the items alternate between A-E answer choices and F-K answer choices.

-Point to #23 as an example: this is a good instance of a situation where you need to pull out your test booklet and ask, Why did 43% answer this question incorrectly? Why did 10% omit?31Application ExerciseItem Response Summary ReportPick one content area.Circle the asterisked numbers (correct answers) for each question.

*Asterisked numbers are CORRECT answers.Be sure to emphasize that they mark the circled numbers only32Application Exercise

Look for the following patterns: Dramatic differences from the reference groupHigh percentages clustered around a wrong answerHigh percentages of omitted questions

Do any of these situations occur more frequently for some domains than others?

Instruct participants to make a note on their paper when they see something that fits one of these situations.33Replace image with what is in the workbook and fix the color coding key to match

Clustered on wrong answerDramatic Difference from Reference GroupHigh Percentage OmittedSo, what would you do with this information?

Study this data in relation to the test booklet. You may even choose to highlight each question as you have done here to facilitate that exercise.As you look at each item, you can determine what is being assessed.Then, study the College Readiness Standards and go back to the Curriculum Review Worksheets to find out when in the curriculum that concept was introduced and think about introducing it or expecting mastery sooner in the curriculum. Other ideas include:

Curriculum: If there are clustered wrong answers, you will want to review the related test questions and determine what type of misconception was represented in the wrong answer. Reviewing how the related concepts are represented in the curriculumand how teachers teach the conceptsmay point to holes that need to be addressed in the curriculum or instructional strategies.

Staff Development: Actually, the exercise of reviewing each Explore or Plan item in relation to the College Readiness Standard is an incredible development exercise for teachers. To really dig into the content and think about possible misconceptions that need to be proactively addressed.Instruction:Prompt participants to consider the timed nature of the test as an element that may need to be practiced. If students are not managing their time well, you may see more omitted questions near the end of the test.

Intervention/Student Support:If there are large numbers of students struggling with a particular strand, it is important to think about responding to that in two ways. One: to address it curricularly, how can you make changes so that more students are prepared for that type of item in the future. And Two: to address it through interventions, because now you have a group of students who have demonstrated a learning gap. And as you know, learning gaps are cumulative and tend to grow over time without focused effort.

So, lets talk about what that focused effort might look like.

34

ACT EXPLORE Early Intervention RosterUndecided students are at higher risk for dropping out from both high school and college. If you have a talented student with no academic plans, why not?35

ACT EXPLORE Early Intervention RosterWhen using your PLAN Score Report, ask yourself some questions:

Am I on target for college?

What skills do I need to improve to be ready for college?

Am I taking a rigorous core curriculum

What careers interest me most?

Individual student reports provide many one-on-one counseling opportunities.37

Students can use their answer booklet to see what they got right and wrong39

And see the suggestions for improvement provided.40

42ACT AspireThe Evolution of College and Career Readiness

Identifies a students predicted path toward readinessHighlights gaps between what students have learned and what they need to learnLeverages familiar technology Offers robust online reporting that enables timely modifications to student learning and intervention strategies

9Therefore ACT has developed an assessment system, ACT Aspire, that schools can use beginning as early as grade 3 to track student performance against ACTs readiness path. By beginning early, schools are able to provide coursework, supports, and interventions to accelerate student achievement to help close gaps early. By using the summative assessment tools and the formative/classroom assessment tools, schools will be able to personalize student educational programs to address skill deficiencies.

ACT Aspire will utilize online assessments to provide assessments that go beyond multiple choice testing. Online assessments will also provide a quick turn around of individual and aggregate reports to allow schools to quickly make modifications to student programs.

ACT Aspire will also be available in paper/pencil and reports will be available in paper format.

4243ACT AspireVertically articulated, standards-based system of assessments to monitor progress in the context of college and career readiness Summative assessments on a vertical scale that spans grades 310 and links to the ACT College Readiness score scale (136)Subject areas: English, math, reading, science, and writingEmploys modular administration by subject and/or gradeLinear, computer-based, multiple question types with paper-and-pencil optionLinks to ACT College Readiness Benchmarks and aligns with Common Core State StandardsProvides evidence-based results

Grade 3Grade 4Grade 5Grade 6Grade 7Grade 8Early High SchoolGrade 11Grade 12ACT Aspire Summative Assessments (Grades 3-10)ACT Aspire Classroom / Interim Assessment (Grades 3-12)The ACTExplore and Plan are being folded into ACT Aspire., effective June of 2015.43

Online ReportingSupport ELA Scores for those who test in English, reading, and writingReading Text Complexity Scores (Reading only)Longitudinal growth Student predicted paths toward college and career readiness Composite Score (Early High School)Predicted ACT Subject and Composite Score (Early High School)

Online Reporting DeliveryRich data and insights Accessible via computer or tabletDownloadable PDFs of prebuilt reportsStudent and Educator ReportsReports for Schools, Districts, and States

Aggregate data files available for download to SIS

The dynamic online User Experience will be the primary platform for reporting for ACT Aspire. Paper reports will be also be available at all levels (student, classroom, aggregate), however the deeper, richer data and insights exist in the online environment. Reporting is designed to be self-service, so that customers can access their data at the time and place of their choosing after scoring is completed. Customers will have access to downloadable PDFs of pre-packaged standard reports including Student Score Reports and Aggregate reporting for schools, districts and states.Aggregate data files of student results will be available in secure electronic format for download to our clients Student Information Systems. ACT Aspire Reporting will be accessible via computer or tablet for the initial product launch.

4647For more information and to sign up to receive updates go to:

www.discoveractaspire.org47Remember:

Without data, its just an opinion.

April.Hansen@act.org

Recommended

View more >