19
Margaret Heritage, CRESST Raymond Yeagley, NWEA

Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics Mission: improve the quality, usefulness, timeliness, and comparability

Embed Size (px)

Citation preview

Page 1: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Margaret Heritage, CRESSTRaymond Yeagley, NWEA

Page 2: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

National Forum on Education Statistics Mission: improve the quality,

usefulness, timeliness, andcomparability of education data

State/Federal/Local partnership withassociate members

Primary method of service delivery is communicating shared ideas and best practices through meetings and publications

http://nces.ed.gov/forum

Page 3: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Why A National Data Model?                 Creating a more complete data picture of the pK-12

environment will help to:

Facilitate data transfer between applications and data storage within schools and districts

Conceptualize how to streamline vertical reporting from the school, to district, regional, state, and ultimately to the federal level.

Enable development of tools educators need to collect and analyze the data necessary to improve instruction and increase student learning.

Guide RFP writers/responders, vendors, teachers, administrators, researchers, and others in better organizing and using data

Page 4: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Initial Framework:Education Organizations

SEA Board

LEA Staff

Facilities

LEA

Food ServiceSchool

Transportation

LEA BoardFinance

Accountability

Intermediate Unit

SEA

Page 5: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Initial Framework:Teaching and Learning

Professional Development

Qualifications

StaffCourse/Class

Student

Instructional Programs and

Curriculum

Safety and Discipline

Health

Attendance Assessment

Participation & Activities

Programs

Page 6: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Intent of the Task Force

Create an organized collection of concepts and entities that need to be tracked multidimensional structure that includes relationships

Define relationships among the entities as a first-order concept – i.e., relationships are as important as data elements.

Avoid replicating data dictionaries. Use standards and established definitions, linked to NCES handbooks and other resources.

Establish that a major feature of the model will be unique sets of attributes for each entity, and the relationships among entities.

Deliver the model through a system that will invite constant expansion and update.

Page 7: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

<<Description about="Course"> <providesServicesTo resource="Student"/> <isAComponentOf resource="Curriculum"/></Description>

Defining Relationships with OWL and XML:

<<Description about="School"> <facilitates resource="Curriculum"/> <isAMemberOf resource="LEA"/></Description>

Page 8: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

What are the persons, places, things, or events we need to know about?

What do we need to keep track of to answer the

questions?

What do we need to know?

What are the important questions that need to

be answered?

Attribute

Functional Relationship

Taxonomy of Entities

Organize

Conceptual Model

Assert

Data ElementsList

Question/Issue

The ProcessWhat are the important

relationships among the entities that we need to include in the model?

What are the measures, characteristics, or other

information about the Entity that we need to

collect and store?

Entity

Asking questions about

Individual student and cohort growth over time Student characteristics related to performance Special program and instructional strategy

effectiveness Return on investment Teacher characteristics related to student

growth School performance characteristics Parents and community Impact of federal, state, and local policy on

learning

Page 9: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Teaching and Learning Subgroup

What are the questions that need to be answered by states, districts and schools about teaching and learning?

What are the attributes that states, districts and schools will need in a database to answer the questions now, and in the future?

How can these attributes be measured?

Page 10: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Sample Questions

What instructional practices are related to what levels of achievement/motivation/self- regulation in core subjects/21st century skills for students with which characteristics?

What interventions with what characteristics are most closely associated with the greatest return on investment as measured by student academic growth per dollar spent?

Page 11: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Sample Questions

What type of assessment systems lead to increased use of assessment data and what are the effects on student achievement?

To what degree is the motivation of students with what characteristics related to curriculum relevance?

Page 12: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Attributes of the Program Entity

Resources Used

Identifier

Outcome Locus

Measures ofEffectiveness

Characteristic

Goals

Program

{Other Entity Relations}

GUID

Name

Local ID

State ID

Academic Goals

Non-academic Goals

Participation

Enrollment

Targets

Benchmarks

Location

Interface

Schedule

Staff

Student

Service Provider

Person Outcome

Non-person Outcome

Program Availability

NCES Program Type

Program Periodicity

Target/Served Population Characteristics

Financial

Human

Curricular

Facilities

Equipment

Technology

Page 13: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Sample Attributes: Instructional Programs and Curriculum

Clearly articulated learning goals Curriculum coherence Enacted curriculum Interdisciplinary curricula Curriculum relevance Instructional strategies Opportunity to learn Learning environments

Page 14: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Sample Attributes: Assessment

Aligned assessment system Evidence of learning:

Individual student achievement (e.g., summative state and district wide tests)

Artifacts (e.g., models, oral presentations, written work) Observations 21st Century skills assessment (e.g., media and

technology, team work, innovation and creativity)

Motivation Self-efficacy Rate of Learning

Page 15: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Consensogram

SEAs can have a significant impact on the quality and use of data by LEAs to increase individual student learning.

It is important for our SEA to provide direct support to LEAs related to use of student level data for instructional improvement.

Page 16: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Table Discussion

What is striking about the graphs on the wall?

How might these statements be addressed by different populations?

What is the best mechanism for gathering data related to the teaching/learning process?

What entities and attributes are essential for using data to increase student learning?

Page 17: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

How can States Help?

Provide leadership Establish expectations and policies Create conditions Model effective data use Put systems in place Provide training in data use (including

measurement)

Page 18: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Table Discussion

Do you agree with what has been suggested about how states can help support LEAs?

if not why, not – how else do you think states could support LEAs?

Page 19: Margaret Heritage, CRESST Raymond Yeagley, NWEA. National Forum on Education Statistics  Mission: improve the quality, usefulness, timeliness, and comparability

Margaret Heritage: [email protected] Raymond Yeagley: [email protected] Paredes: [email protected]