2007 Department of Education Database Workshop Integrated Education Data Systems

1. 2007 Department of Education Database WorkshopIntegrated Education Data Systems Florida Education, Training and Placement Information Program (FETPIP) Trina Condo Education Data Warehouse (EDW) Tammy Duncan

2. Agenda • Overview of Data Resources • Longitudinal Data Systems Initiatives • Federal • State • Current State of IEDS • Data Uses • Current Initiatives • Data Request Process

3. Florida’s Primary K-20 Data Resources

4. Integrated Education Data Systems (IEDS)

5. Current Federal InitiativesforLongitudinal Data Systems

6. A Test of Leadership, Charting the Future of U.S. Higher Education, A Report of the Commission Appointed by Secretary of Education Margaret Spellings “ Better data about real performance and lifelong working and learning ability is absolutely essential if we are to meet national needs and improve institutional performance.” U.S. Department of Education

7. U.S. Department of Education • The Test of Leadership Campaign follows students through the educational pipeline to determine findings about U.S. postsecondary education in terms of: • Access • Affordability • Financial Aid • Learning • Transparency and Accountability • Innovation

8. U.S. Department of Education • In compiling the information for the study, the Test of Leadership Campaign cites: “We have noted a remarkable shortage of clear, accessible information about crucial aspects of American colleges and universities, from financial aid to graduation rates. Because data systems are so limited and inadequate, it is hard for policymakers to obtain reliable information on students’ progress through the educational pipeline. This lack of useful data and accountability hinders policymakers and the public from making informed decisions and prevents higher education from demonstrating its contribution to the public good.”

9. National Governors Association • Initiative • Task Force on State High School Graduation Data • Goal • “… make recommendations about how states can develop a high-quality, comparable high school graduation measure, as well as complementary indicators of student progress and outcomes and data systems capable of collecting, analyzing, and reporting the data states need.” • Recommendation • “Build the state’s data system and capacity to ensure that the system can collect, analyze, and report the adopted indicators and other important information. Ultimately, states should adopt a student-unit-record data system, with unique student identifiers that can track students through the state’s education system from kindergarten through postsecondary education.”

10. Data Quality Campaign (DQC) • Data Quality Campaign • A federal initiative launched in November 2005. This initiative is supported by the Bill and Melinda Gates Foundation and managed by the National Center for Educational Accountability (NCEA) • Goals: • Improve the collection, availability, and use of high-quality education data, and • Implement state longitudinal data systems to improve student achievement

11. Longitudinal Data Systems Initiatives • Data Quality Campaign • 13 managing partners include: • Achieve, Inc. • Alliance for Excellent Education • Council of Chief State School Officers (CCSSO) • Education Commission of the States (ECS) • Education Trust • National Association of State Boards of Education (NASBE) • National Association of System Heads (NASH) • National Center for Educational Accountability (NCEA) • National Center for Higher Education Management Systems (NCHEMS) • National Governors Association Center for Best Practices (NGA Center) • Schools Interoperability Framework Association • Standard & Poor’s School Evaluation Services (SES) • State Educational Technology Directors Association (SETDA) • State Higher Education Executive Officers (SHEEO)

12. The Data Quality Campaign’s Ten Essential Elements of a Longitudinal Data System • A unique statewide student identifier that connects student data across key databases and across years • Student-level enrollment, demographics and program participation information • The ability to match individual student’s test records from year to year to measure academic growth • Information on untested students and the reasons they were not tested • A teacher identifier system with the ability to match teachers to students • Student-level transcript information, including information on courses completed and grades earned • Student-level college readiness test scores • Student-level graduation and dropout data • The ability to match student records between the P-12 and higher education systems • A state data audit system assessing data quality, validity and reliability

13. Florida’s Longitudinal Data System • Florida is the only state to include all 10 elements in its current data collection system.

14. Current State InitiativesforLongitudinal Data Systems

15. Longitudinal Grant Award • 14 States awarded “longitudinal grants” through the Institute for Education Sciences in NCES • Three year grants designed to implement state level K12 Student Information Systems in each state within the next nine years • Alaska, Arkansas, California, Connecticut, Florida, Kentucky, Maryland, Michigan, Minnesota, Ohio, Pennsylvania, South Carolina, Tennessee, Wisconsin, - 53 million dollars nationally, ranging from 1.5 to 5.8 million to each state • Florida’s grant builds on the existing statewide education data systems • K12 Student/Staff Information Systems, Facilities Information Systems, Finance Information Systems • K12 Facilities Redesign • Integration of the K12 Facilities and Finance Data into the K20 Education Data Warehouse

16. Longitudinal Grant Goal and Phases • Primary Goal • Links K12 Facilities, Classrooms and Funding • Phases • Phase 1 - Analysis of the K12 Facilities and Finance Data • Phase 2 – Develop, Implement and Test the Integration of Facilities and Finance Data • Phase 3 – Dissemination

17. Longitudinal Grant Status by Phase • Phase 1 – Complete • Phase 2 – 80% Complete • Development Complete • Integration Complete • Testing Underway • Phase 3 – Will begin development in the upcoming fiscal year

18. Ready to Work Initiative • Integrated Education Data Systems will be responsible for the Accountability Component for the Florida Ready to Work Credential Data • Example accountability measures: • Performance on the Ready to Work Credential Assessments • Remediation(s) required to attain a credential • Number of attempts required to obtain a Ready to Work Credential • Highest attainment for each credential • Gold • Silver • Bronze

19. Go Higher Task Force • Integrated Education Data Systems provides data extracts to decision making support to policy makers regarding the issue of preparing Florida’s students for college. • Examples of data provided to support this effort: • Average earnings based on highest level of attainment • Percent of recent graduates progressing to postsecondary education • Percent of non-recent graduates found enrolled as first-time in sector in a postsecondary institution • Progression of a set of 8th Grade Students over a 6 – year period to determine enrollment in a postsecondary institution • Of that same set of 8th Grade Students – Identify the number and percentage who also completed a degree and the highest degree attained

20. State of the Integrated Education Data Systems

21. We Have the Data Systems, Now What? • Current Status of the Data Systems: • Florida is the Only State with a K20 Data System that Follows Student Progression Through the Educational Pipeline and Meets All 10 Elements of the Data Quality Campaign • Next Steps • Considerations to determine where and how to improve the data systems to fit the needs of our customers

22. Ways to Access Data • Reports/Pre-defined Queries • Data Marts • Data Extracts

23. Reports and Pre-defined Queries • By 2003-04 FCAT Reading Achievement Level, the number of students enrolled in specific reading courses in 2004-05 • Postsecondary education outcomes for GED recipients • The number of students initially eligible for Bright Futures in 1998-99 who received a Bachelors or a Masters by the end of 2003-04 • The number of students initially eligible for Bright Futures in 2000-01 who received either an AA or an AS from a community college by the end of 2003-04

24. Data Marts • Characteristics of a Data Mart • Tailored to answer a specific question or support a specific business need • Contains summarized data derived from data warehouse • Subdivided by characteristics of interest • Complexity kept to a minimum • Designed for accessibility and performance

25. Data Extracts • Data extracts can be generated for users who will be given time-limited access to detailed data extracted from the normalized data warehouse database. Access at this level will require high level approval. • An example of this type of user is an individual doing educational research.

26. Meta Data • Data Warehouse component that supports understanding and effective use of the data • User-friendly interface to the definitions and documentation of the data warehouse • Description of source files, target tables, elements, and code values • Links source data elements to target data elements

27. Business Intelligence

28. Data Mart Considerations • Evaluate Users’ Requirements • Exploratory vs Pre-Defined • Evaluate the Audience • Is Data Already in the Warehouse? • If Data is not in the Warehouse… • What is the best source? • What is the best method? • Defining the Presentation • Canned Reports • Business Intelligence Interface

29. New Development and Initiatives • FCAT Data Mart • Developed and currently undergoing usability testing with a sampling of District FCAT Coordinators • Future Data Marts • K20 Pipeline • FETPIP Outcomes • PK12 Participation • Student Enrollment • AWI Program Participation and Outcomes • Facilities • Finance

30. Uses of School District Databy Integrated Education Data Systems

31. A Wide Array of Users

32. General Uses of School District Data • The Integrated Education Data Systems uses data provided by districts for many purposes including: • Policy decisions • Bill Analysis • Modeling for future accountability calculation • Existing Program Analysis • New programs • Response to Legislative Requests • Response to Media Requests • Research (Internal and External) • Having accurate data allows for better modeling and decision making

33. Examples of Specific Uses of School District Data • Performance Profiles – Reports performance data for students and schools statewide and for all school districts in a legislative district for comparison • Performance on the Common Placement Tests/College Readiness – Reports the need for remediation in postsecondary by state, district, school and student • High School Feedback Report – Reports on 22 items by state, district and school • Feedback to identify/verify Highly Qualified Teachers – Based on Pass/Not Pass results on the Florida Teacher Certification Examination • Access Task Force – Reports post secondary outcomes of high school graduates by award earned • College Reach-Out Program – Reports the performance and progress of CROP students in comparison to general student populations

34. Reporting and ExtractsThe Data Request Process

35. Request Process

36. Examples of Research Using Education Data Warehouse Data • Paul E. Peterson, ed. “Reforming Education in Florida – A Study Prepared by the Koret Task Force on K-12 Education,” Hoover Institution Press (2006) • Jay P. Greene, “Getting Ahead by Staying Behind: An Evaluation of Florida’s Program to End Social Promotion,” Education Next, No.2, Spring (2006) • “Third Grade Retention Policy Leading to Better Student Performance Statewide,” Office of Program Policy Analysis & Government Accountability (October 2006) • “Steps Can Be Taken to Reduce Remediation Rates: 78% of Community College Students, 10% of University Students Need Remediation,” Office of Program Policy Analysis & Government Accountability (April 2006)

37. Security and Access Levels of User Access • Open- Open access is to canned reports or predefined queries available on the FDOE web site. The canned reports will be viewable and printable, but cannot be manipulated. The pre-defined queries will be viewable and printable and can be manipulated us pre-defined parameters. • Intermediate- Intermediate users will use a browser based reporting tool for access to summarized or aggregated information contained in the data mart(s) (i.e., a subset of the information contained in the data warehouse). These data marts will contain particular information relevant to a specific subject. This access is password protected. • Advanced - The advanced user will have time-limited access to detailed extracts from the normalized data warehouse database. Access at this level will require approval by FDOE high level management.

38. For More Information K-20 Education Data Warehouse - http://edwapp.doe.state.fl.us/doe/ Phone (850) 245-0428 Suncom 205-0428

39. Questions?