Developing and Using P-20W Longitudinal Reports

2012 SLDS P-20W Best Practice Conference 1

DEVELOPING AND USING P-20W LONGITUDINAL

REPORTSMonday, October 29, 2012

Carol Jenner, Washington State Education Research and Data Center

Charles McGrew, Kentucky P-20 Data CollaborativeNeal Gibson, Arkansas Department of Education

Arkansas Research Center

2012 SLDS P-20W Best Practice Conference

• Arkansas: The Arkansas Research Center (ARC)

• Kentucky P-20: A Collaborative Approach• Washington: Washington State Education

Research and Data Center

OVERVIEW

2


THE ARKANSAS RESEARCH CENTER

(ARC)


ARKANSAS RESEARCH CENTER


REQUEST FORM


RESPONSIBILITIESK12 Higher Education

Workforce/CTE Early Learning

Web Development


AEER REPORT


GRADUATE WAGES


ECONOMIC SUCCESS MEASURES


LOTTERY SCHOLARSHIP


EARLY LEARNING FEEDBACK


ON-TIME COLLEGE GRADUATION


UAMS NEONATAL RESEARCH


KENTUCKY P-20: A COLLABORATIVE APPROACH


P-20 Data Collaborative Research Agenda• P-20 staff compile a list of potential

ongoing production and special report topics for the governance group based on feedback from various constituents, analyzing legislative topics, etc.

• Governance reviews and approves an annual reporting and research agenda.

HOW ARE REPORTS DEVELOPEDKY


Planned Development Process• Audiences are identified and contacted for

feedback or assembled as focus groups before the reports are created.

• Mock-up reports are developed for feedback and data are analyzed to ensure they are appropriate.

• Target audience iteratively review drafts.• Final reports released for vetting.• Reports released publicly.



Ad Hoc Development Process• Report or research request is made or

proposed• Approval process

o Requests from state entities are automatically approved within reason

o External requests are evaluated on merit, work required, and funding

• Initial reports are developed• Abbreviated vetting and approval process• Reports released



CURRENT AND NEAR-FUTURE REPORTS KYReport Audience ReleaseHigh School Feedback Reports – College Going

Schools, Districts, Parents, General Public

Winter

High School Feedback Reports – College Success

Schools, Districts, Parents, General Public

Fall/Winter

Kentucky County Profiles Policy Makers, Business, General Public

Summer

Early Childhood Profile Early Childhood Advisory Councils

Winter

Employment Outcomes Universities, Policy Makers, General Public

Fall

Adult Education Feedback Report

Adult Education Providers, KYAE, Policy Makers, General Public

Spring

Teacher Preparation, Student Performance, and Teacher Longevity

Teacher Prep Institutions, School Boards, General Public

Spring

Reports available at http://kentuckyp20.ky.gov

http://kentuckyp20.ky.gov/




DATA PRESENTATION AND USEKY

Pitfalls• Know your audience. What do they

need to know and what format will best communicate it to them?

• Don’t waste people’s time with data for data sake. Does it have usable meaning?

• Just the facts. Don’t interpret data based on a political agenda. If you present it clearly people can make their own interpretations

• People don’t like surprises – vet for accuracy as much as to prepare people


WASHINGTON STATE EDUCATION RESEARCH

AND DATA CENTER


The Education Research & Data Center• Centralized P-20W data warehouse in

development • Longitudinal reports are designed and

produced now• Many reports have companion data sets• Reports will eventually be data warehouse

products• P-20 reports for high schools and school

districts website: www.erdcdata.wa.gov• Plans for additional P-20W longitudinal

reports for higher education and early learning sectors

BACKGROUND

http://www.erdcdata.wa.gov/


Identify and involve stakeholders (for specific reports)• SEA staff, district administrators, school

counselors• Higher education institutional researchers• State agencies, including P-20W partners• Legislators and legislative staff • Allow for stakeholder review before public

releaseOther considerations• Maximize data available while maintaining

student privacy• Incorporate federal- and state-mandated

elements when possible

REPORT DEVELOPMENT


Public access at www.erdcdata.wa.gov• Interactive, online reports based on de-

identified data sets generated from the data warehouse (plus companion data sets for download)

Incorporation into SEA reporting (planned)• Some elements will be provided to SEA for

reporting to administrators and for public website

Directly from the data warehouse• By ERDC staff

ACCESS TO REPORTS

http://www.erdcdata.wa.gov/


Focus on “Feedback” reports• P-20 Reports for high schools and

districts• Postsecondary enrollment by student

characteristics• Pre-college (“remedial”) course-taking

• P-20W Reports for baccalaureate institutions• De-identified data files to institutional

researchers now – detail file plus longitudinal summary

• Employment while enrolled and after graduation (annual earnings, industry of employment)

WHAT TYPES OF REPORTS ARE PRODUCED?


Employ effective data governance• Communication between agency decision-

makers, data stewards and custodians, and research coordinators

Promote a P-20W data culture (“Think P-20”)• Establish definitions appropriate for P-20W• Recognize that counts in P-20W reports may not

exactly match those in individual sector reports• Recognize that P-20W data provides richer

information and presents new ways of analyzing old questions

AVOIDING PITFALLS


Contact information:Carol Jenner, [email protected] McGrew, [email protected] Gibson, [email protected] Keith Brown, [email protected]

CONTACTS & ADDITIONAL RESOURCES

26

mailto:[email protected]





For more information on developing and using P-20W longitudinal reports:

Data Use Issue Brief: Techniques for Analyzing Longitudinal Administrative Data: http://nces.ed.gov/programs/slds/pdf/Data-Use-Issue-Brief-4_Analysis-Techniques.pdf Data Use Issue Brief: Turning Administrative Data into Research-Ready Longitudinal Data Sets: http://nces.ed.gov/programs/slds/pdf/Data-Use-Issue-Brief-3_Research-Ready-Datasets.pdf

CONTACTS & ADDITIONAL RESOURCES

27

http://nces.ed.gov/programs/slds/pdf/Data-Use-Issue-Brief-4_Analysis-Techniques.pdf



http://nces.ed.gov/programs/slds/pdf/Data-Use-Issue-Brief-3_Research-Ready-Datasets.pdf



Documents

Developing and Using P-20W Longitudinal Reports