Click here to load reader

TIMSS Survey

  • View
    3.201

  • Download
    4

Embed Size (px)

Text of TIMSS Survey

  • 1. Highlights from PIRLS and TIMSS 2011Jack BuckleyNational Center for Education Statistics Washington, DC December 11, 2012

2. OverviewWhat are PIRLS and TIMSS and which educationsystems participate in them?How are U.S. students performing compared to theirinternational peers in: 4th-grade reading? 4th- and 8th-grade mathematics? 4th- and 8th-grade science?How are students performingin participating U.S. states?2 3. What are? Progress in International Reading Trends in International MathematicsLiteracy Study (PIRLS)and Science Study (TIMSS) 4th-grade reading assessment 4th- and 8th-grade mathematics andscience assessment Developed by the TIMSS & PIRLS International Study Center at BostonCollege, under contract to the International Association for the Evaluation ofEducational Achievement (IEA) * In 1999, no grade 4 assessment. 3 4. 32 education systems26 education systems 532011 4 5. 375747 education systems44 education systems 74 2011 5 6. Participating states 9 states participated as separate entities to obtain scores in PIRLS orTIMSS or bothPIRLSTIMSS grade 4 TIMSS grade 8FloridaFlorida Florida North CarolinaNorth Carolina Alabama California Colorado Connecticut Indiana Massachusetts Minnesota Each participated as part of the nation and on its own NCES funded participation at grade 8 of all states except Florida aspart of a study to statistically link NAEP (National Assessment ofEducational Progress) and TIMSS (Florida received other EducationDepartment funding)6 7. U.S. national sample size4th grade 4th gradeSchools: 370Schools: 369Students: 12,726Students: 12,5698th gradeSchools: 501Students: 10,477 7 8. U.S. state sample sizes(public schools only)4th grade 4th grade(FL)(FL, NC)Schools: 77 Schools: 46 77Students: 2,598 Students:1,792 2,6618th grade(AL, CA, CO, CT, FL, IN, MA, MN, NC)Schools: 53 82Students:1,712 2,614 8 9. READING 10. PIRLS 2011 framework PIRLSDefinition The ability to understand and use those written language forms required by society and/or valued by the individual. Young readers can construct meaning from a variety of texts. They read to learn, to participate in communities of readers in school and everyday life, and for enjoyment.ContentLiterary and informational textsCognitive dimensions Focus on and retrieve Make straightforward inferences Interpret and integrate Examine and evaluate 10 11. What is on the PIRLS assessment?Percentage of 4th-graders answering correctly:U.S.: 90%Intl Avg.: 89% 11 12. What is on the PIRLS assessment?Percentage of 4th-gradersanswering correctly:U.S.: 42%Intl Avg.: 29%12 13. U.S. average score (556) higherthan the PIRLS scale average (500) Higher than U.S. Not measurably different than U.S. Lower than U.S. 13 14. U.S. average score (556) lower than in 5 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S. 14 15. U.S. average (556) not measurablydifferent than in 7 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S. 15 16. U.S. average score (556) higher than in 40 education systemsHigher than U.S.Not measurablydifferent than U.S.Lower than U.S.16 17. Average reading scores of 4th-grade students from 2006 to 2011 in 13education systems, including the U.S. Hong Kong-CHN7*Singapore9*UNITED STATES 16* Denmark8*Chinese Taipei-CHN18*England-GBR 12*Slovenia 9* Poland6* Norway9*Georgia17*Trinidad and Tobago35*Iran, Islamic Rep. of 36*Indonesia 24*-20 -100 1020 3040 Change in average score*p < .05. Change in average scores is significant.NOTE: Education systems ordered according to average reading score in 2011. 17 18. Average reading scores of 4th-grade students from 2006 to 2011 in 8education systemsAlberta-CAN-12*Sweden -8* Italy-10*Germany -7* Hungary -12* Bulgaria -15* Austria-9* Lithuania-9* -30-20 -10 0 10 20 30Change in average score *p < .05. Change in average scores is significant. NOTE: Education systems ordered according to average reading score in 2011.18 19. PIRLS international reading benchmarks Grade 4Advanced (625) Students can interpret figurative language, distinguish and interpret complex information from different parts of text, and integrate ideas across text to provide interpretations about characters feelings and behaviors.High (550) Students can recognize some textual features, make inferences on the basis of abstract or embedded information, and integrate information to recognize main ideas and provide explanations.Intermediate (475) Students can identify central events, make straightforward inferences from the text, and begin to make connections across parts of the text.Low (400)Students can retrieve explicitly stated details from literary and informational texts. 19 20. Percentages of U.S. 4th-grade studentsreaching PIRLS reading benchmarks werehigher than international medians in 2011Percent 98 UNITED STATES1009586International median 90 80 80 70 60 56 50 44 40 30 20 17 8 100 LowIntermediate High AdvancedBenchmarkNOTE: All U.S. percentages are significantly higher than the corresponding PIRLS international medianat the .05 level of statistical significance.20 21. Two systems had higher percentages of 4th-gradestudents reaching Advanced than the U.S.Singapore24Florida-USA 22 Russian Federation19Northern Ireland-GBR 19Finland18Higher than U.S. (p < .05) England-GBR 18Not measurably different than U.S. (p < .05)Hong Kong-CHN 18 UNITED STATES17 Ireland 16Ontario-CAN 15 010 20 30 40 5060Percentage reaching Advanced benchmark NOTE: Education systems with lower percentages of students reaching the Advanced benchmark than the percentage of U.S. students reaching the Advanced benchmark are not included in figure. 21 22. MATHEMATICS 23. TIMSS 2011 mathematics framework TIMSS mathematicsContentGrade 4dimensions Number Geometric Shapes and Measures Data Display Grade 8 Number Algebra Geometry Data and ChanceCognitiveKnowingdimensions Applying Reasoning 23 24. What is on the TIMSS mathematics assessment? Percentage of 4th-gradersGanswering correctly:RU.S.: 80%AIntl Avg.: 54%DE4 24 25. What is on the TIMSS mathematics assessment?GRADE Percentage of 4th-4graders answering correctly: U.S.: 76% Intl Avg.: 65% 25 26. What is on the TIMSS mathematics assessment?GGRR Percentage of 8th-AA graders answeringD correctly:DE U.S.: 87%E Intl Avg.: 70%88 26 27. What is on the TIMSS mathematics assessment?GRPercentage of 8th-Agraders answeringD correctly:E U.S.: 66%Intl Avg.: 45%8 27 28. U.S. average score (541) higher than the TIMSS scale average (500) Higher than U.S. Not measurably different than U.S. Lower than U.S. 28 29. U.S. average score (541) lower than in 8 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S. 29 30. U.S. average (541) not measurablydifferent than in 6 education systemsHigher than U.S.Not measurablydifferent than U.S.Lower than U.S. 30 31. U.S. average score (541) higher than in42 education systems Higher than U.S. Not measurably different than U.S. Lower than U.S. 31 32. U.S. average score (509) higher than the TIMSS scale average (500)Higher than U.S.Not measurablydifferent than U.S. 32Lower than U.S. 33. U.S. average score (509) lower than in11 education systems Higher than U.S. Not measurably different than U.S. 33 Lower than U.S. 34. U.S. average (509) not measurablydifferent than in 12 education systems Higher than U.S. Not measurably different than U.S. 34 Lower than U.S. 35. U.S. average score (509) higher than in32 education systems Higher than U.S. Not measurably different than U.S.35 Lower than U.S. 36. Average mathematics scores of 4th-grade students from 2007 to 2011 in 12education systems, including the U.S.Chinese Taipei-CHN 15*Japan 17*UNITED STATES12* Denmark14*Quebec-CAN14*Slovenia11*Czech Republic 24* Norway22* Dubai-UAE 24*Georgia12*Iran, Islamic Rep. of28* Tunisia 32*-20-10 0 10 20 3040 Change in average score *p < .05. Change in average scores is significant. NOTE: Education systems ordered according to average mathematics score in 2011.36 37. Average mathematics scores of 8th-grade students from 2007 to 2011 in 10 education systems Korea, Rep. of 16* Singapore 18*Chinese Taipei-CHN11* Russian Federation 27* UNITED STATES 1 Italy19*Ukraine17*Dubai-UAE17* Georgia22*Bahrain 11*Palestinian Natl Auth 37* -20 -10 0 10 2030 40 Change in average score *p < .05. Change in average scores is significant. NOTE: Education systems ordered according to average mathematics score in 2011.37 38. Average mathematics scores of 8th-grade studentsfrom 2007 to 2011 in 6 education systemsHungary -12*Sweden -7* Malaysia-34* Thailand -14* Jordan -21*Syrian Arab Republic -15* -40-30-20 -10 0 10 20Change in average score *p < .05. Change in average scores is significant. NOTE: Education systems ordered according to average mathematics score in 2011.38 39. TIMSS international mathematics benchmarks Grade 4 Grade 8Advanced (625) Students can apply theirStudents can reason with understanding and information, draw knowledge in a variety of conclusions, make relatively complex situations generalizations, and solve and explain their reasoning.linear equations.High (550) Students can apply theirStudents can apply their knowledge and understanding and knowledge understanding to solvein a variety of relatively problems. complex situations.Intermediate Students can apply basicStudents can apply basic(475)mathematical knowledge in mathematical knowledge in straightforward situations. straightforward situations.Low (400)Students have some basicStudents have some mathematical knowledge. knowledge of whole numbers and decimals, operations, and basic graphs. 39 40. Percentages of U.S. 4th-graders reachingTIMSS mathematics benchmarks werehigher than international medians in 2011Percent at or above100 96 90 90UNITED STATES81 80International median 69 70 60 50 47 4028 30 20 13 10 40 Low Interm

Search related