Upload
lynn-baldwin
View
220
Download
0
Embed Size (px)
Citation preview
1
DDOE Education Insight Dashboard Implementation Project
25th Annual STATS-DC 2012 Data Conference
July 13, 2012
2
Zero to Dashboard in 15 Months
•Introductions•Project Background•Going Further Faster•Next Steps•Q & A
3
Who we are
•Reese Robinsono Delaware Department of Educationo Education Insight Project Manager
•Lori Feyo Michael & Susan Dell Foundationo Director – Ed-Fi Initiative
•Eddie Parkero Otis Educational Systems (OtisEd)o Founder & CEO
4
RTTT Project Aimed at Ambitious Targets
K-12 data is increasingly important●Federal mandates●Management – Data-driven decisionmaking
DOE Targets (RT3)●90% of students will graduate by 2013-2014●100% will meet standard on state math and reading exams by 2013-2014
How do we close the gap?
5
Specific Focus on Equipping Educators with Meaningful Data to Help Students
6
Series of Education Insight Projects Required to Meet Goals
7
Project Timelines Posed Significant Challenge
8
Insight Dashboard Preparation Process
• Documentation Review
• System Inventory
• Market Review
• LEA Interviews
• Findings: Many Existing Systems, Many Potential Providers
• Request For Information: 26 Responses
• Selected Ed-Fi standard for data structure and dashboards
• Request for Proposalo Data Warehouse: ESP Solutions Group / OtisEdo Dashboard Design: Wireless Generation / Double Line Partners
July 2010 – April 2011
9
Ed-Fi Leverages Existing Data for New Uses
• Extensive documentationo Interface, Database, Metrics, Data Exchange
• Research-based• Well received• Consistent with RT3 philosophy• Public domain• Growing adoption by states and districtso States of Arkansas, Colorado, Kansas, Texaso Little Rock School District
• Adopted for the Strategic Learning Collaborative (SLC)o Piloted with Colorado, Georgia, Illinois, Massachusetts, New York,
North Carolina
Ed-Fi includes:•Open data standard•Collection of best practice metrics•Dashboard source code
Ed-Fi includes:•Open data standard•Collection of best practice metrics•Dashboard source code
10
Architecture
11
Data Flow
11
26,000,000 Records Evaluated Nightly6-7 Hours
12
Insight Dashboard Designed to Meet RTTT Goals•Collection of research-based metrics (33)o Predictive of education outcomes
•Integrated from multiple sourceso eSchool, DCAS, DIBELS…
•Focused on studentso Class, School, District rollups
•Along with student characteristicso Contacts, Program Indicators
•Designed by and for Teachers
12
13
How was it Developed?
13
• 45 Individuals• All Districts• 4 Charter Schools
• 70 Student Metrics• 200 Aggregate or Rollup Metrics
• 11 Focus Groups• 175 Participants
― 122 Teachers― 4 Principals― 49 Admin
14
Stakeholder Workshop ReviewThree stakeholder engagement workshops were conducted in June 2011.
June 20, 2011Glasgow HS
84 participants
June 22, 2011Polytech HS
55 participants
June 23, 2011Sussex Tech HS36 participants
175 people attended the stakeholder workshops•122 Classroom Teachers•4 Principals•49 Other Administration
11 Breakout Sessions with 4 stakeholder groups •Elementary Teachers•Middle School Teachers•High School Teachers•Principals, Counselors, and other Administrative personnel (sometimes as part of teacher breakout sessions)
15
Stakeholder Survey FeedbackFeedback from the Workshop participants was overwhelmingly positive.
16
Several key factors enabled DDOE to get further, faster
17
Leveraging Others’ Work Accelerated Development• Ed-Fi Toolso Data standard already createdo Metrics research already synthesized and well-documentedo Operational dashboard source code dramatically cut development time
• Stakeholder Engagement Model from Texaso Metrics prioritized by Delaware educatorso Built awareness and buy-in
• iMart Data Warehouseo OTS product with dimensional model and K12 operational processo Easily extensibleo Low cost of ownershipo Self-Sufficiency with Knowledge Transfer to DDOE staff
18
Embracing Change Eliminated Common Pitfalls• Adopting Standardso Provided common ‘language’o Minimized design confusion and unnecessary development
• Agile Managemento ‘TimeBox’ development approach was key to meeting deadlineso Executives minimized bureaucracy
• Specific Development Team Strategieso Mentoringo Pair-programmingo Code reading and reviewo Regular code walkthroughso Review of artifactso Question and answer
19
Metric Focus
20
Ed-Fi Provided Powerful, Free Accelerators
Ed-Fi Core1.2
Delaware InsightDashboard extensions
maintain compatibility with Ed-Fi Core if/as it is modified
Ed-Fi Core1.3
• Texas Student Data System dashboard code developed into publicly licensable Ed-Fi tool suite
• DDOE licensed Ed-Fi tool suite free• Implementation of Ed-Fi allows for extensibility (customization) for
Delaware presentation and unique metrics• Ed-Fi core schema will evolve over time, but will still be compatible with
Delaware implementation as long as extensibility points are only areas of customization
• Texas Student Data System dashboard code developed into publicly licensable Ed-Fi tool suite
• DDOE licensed Ed-Fi tool suite free• Implementation of Ed-Fi allows for extensibility (customization) for
Delaware presentation and unique metrics• Ed-Fi core schema will evolve over time, but will still be compatible with
Delaware implementation as long as extensibility points are only areas of customization
Future Ed-Fi Core releases
21© 2012 Michael & Susan Dell Foundation
Ed-Fi Footprint is Growing
Total US students49.4M
Total US teachers3.2M
19% of students19.5% of teachers
34% of students36% of teachers
Momentum of State Adoption Creates Further Opportunities for Leverage
22
Scope of iMart to Mapping Process
• Moving data from iMart Data Warehouse to Ed-Fi Operational Data Store
• Tableso Source Tables Used to read data: 65o Target tables loaded:
105 Type Tables (Code Tables) 84 Maps (Ed-Fi Target Tables)
• 14 packages or modules
• 95 ETL jobs
• Data pointso 600 columns loaded of 84 Ed-Fi Tableso 135,000 unique Current Year enrolled
students processedo 26,575,792 Records processed (Most of
them are only Current year records)
This does not include the source mapping to the Data Warehouse (iMart)
23
Data Mapping and Import Process
Available dataDashboard
requirements
Design
Ed-Fi Standard
24
Insight Dashboard Project Timeline
Release 1.0•Interim Teacher Dashboard Development
Stakeholder engagement
4/1/11
Release 2.0•Teacher (expansion), Principal, Administrator, DOE Dashboards
4/1
Release 3.0 and beyond•Expansion, refinement, and support for additional Stakeholders
6/30/137/1 10/1
Phased release•Pilot districts•Other districts