Statewide Longitudinal Data Systems (SLDS) & Post-School Outcomes

1. Statewide Longitudinal Data Systems (SLDS) & Post-School Outcomes National Post-School Outcomes Center, OR SLDS Community of Practice September 9, 2013

2. Let’s introduce ourselves. • New NPSO Staff • Participants

3. Announcements • Mid-Year Check and Connect (co-hosted by NSTTAC, NPSO, NDPC-SD) • November 13, 2013 • Williamsburg, VA • CEC’s Division of Career Development and Transition (DCDT) conference • November 14-16 • Williamsburg, VA

4. SLDS Community of Practice • New Quarterly CoP dedicated to issues related to SLDS and Post-School Outcomes • SLDS CoP will not replace the regular Monthly NPSO COP calls • Next NPSO COP on September 12th • Topic: PSO Data Analysis

5. Outcomes Today • Learn about Arkansas’s process for dual data collection (i.e. SLDS and Survey methodology) • Learn about TA provided in reference to SLDS initiatives and Common Education Data Standards • Identify dates, possible topics and presenters for future NPSO-SLDS COP

6. NPSO has been charged with assisting states with embedding Indicator 14 data in their SLDS. • As part of this, the NPSO provides guidance and assistance to SEAs exploring using administrative data sources to report Indicator 14.

7. Arkansas’Post-school Outcomes Process Jody Fields, PhD Director, IDEA Data & Research

8. APR Data Set: Original Sampling Plan • Districts are sampled once every 6 years • Largest District Little Rock is surveyed twice every six years • Contact Information • Student Management System • PSO Collection • Phone survey conducted by LifeTrack Services

9. Results Original Collection • Located approximately 30 % of leavers • 95% plus responded to the survey • Not representative of leavers • Race/ethnicity • Disability • Exit reason • Districts not involved in the collection

10. How could the collection improve? • Districts not wanting to be involved; adds a burden to districts • NPSO Meeting in Denver (March 2011) • Maryland’s presentation • Administrative data mine • Rehab is part of DoE • HIE • National Student Clearinghouse • MOU with other state agencies

11. After Denver • Conference call with the Arkansas Research Center • Established with an IES SLDS grant • MOU with multiple state agencies • AR Department of Higher Education • AR Department of Workforce Services (Labor) • AR Department of Career Education • AR Department of Corrections • National Student Clearinghouse

12. APR Data Set: 1st Year Sampling Plan • Districts are sampled once every 6 years • Largest District Little Rock is surveyed twice every six years Contact Information • Student Management System PSO Collection • Phone survey conducted by LifeTrackServices • Administrative Data Mine • All leavers; not just the sample

13. What was reported in APR Year 1 of Dual Collection: • Actual data set reported for APR • Phone survey data • Secondary write up on data mining pilot • AR Department of Higher Education • AR Department of Workforce Services (Labor) Year 2 of Dual Collection: • Cross referenced both collections – unduplicated count • Actual data set reported for APR • Phone survey data and • Data mine • AR Department of Higher Education • AR Department of Workforce Services (Labor)

14. Results of the Dual Collection and Combined Reporting: Year 2 Responder Rate • LifeTrack began contacting former students in May 2012 and continued with phone surveys through July 2012. • Although steps were taken to verify contact information, 63.37% (391/617) of telephone numbers were either disconnected or had changed resulting in wrong numbers. • Contact information was valid for 226 of the 617 records or 36.63% of leavers. • Additional information was located for 212 students via an administrative data mine bringing the overall response rate to 70.99% (438/617).

15. Results of the Dual Collection and Combined Reporting: Year 2 Representativeness • No responders were under-or –over-represented in the racial/ethnic groups. • Analysis of disability representativeness found Intellectual Disability to be underrepresented and SLD to be over-represented. • Responders were over-represented in the exit category graduating with a regular diploma but slightly under-represented for dropped out.

16. Results of the Dual Collection and Combined Reporting: Year 2 • Reported on Sample Districts only • 55.92% engaged • Benefits of using both collections • Phone survey identifies actual not-engaged students • Phone survey identifies students who are engaged in other ways but do not meet the criteria for the indicator • Improves representativeness • Data mine locates more student records

17. Results of the Dual Collection and Combined Reporting: Year 2 • Issues of using data mining • Measurement uses the Denominator of the entire sample size not just those located • Reduced the engaged rate • Doesn’t account for students not found in databases • Non-cooperative agencies

18. Arkansas’ biggest challenge and next steps Challenges • Rehabilitation Services not cooperative • Locating other local, state, and federal agencies that students may be in programs Next steps • Meet with ARC to discuss additional MOUs • Job Corp ( 3 programs in AR) • DHS-Division of Services for the Blind • DHS – DDS Adult Services • AR Rehab - Services for the Deaf and Hard of Hearing (SDHH)  • National Student Clearinghouse

19. SLDS P-20W+ Data Use Collaborative Efforts Including CEDS DorothyjeanCratty State Longitudinal Data Systems (SLDS) Grant Program National Center for Education Statistics dorothyjean.cratty@ed.gov

20. SLDS Grant Rounds: Increasing Emphasis on P-20W and Data Use(See our website for more information: http://nces.ed.gov/programs/SLDS/) 2012 Competition 2006 & 2007 Competitions 2009 Competition 2009 ARRA Competition K12 + ONE of the following: PreK, Postsec, Workforce, OR Student-Teacher link K12 + ALL of the following: PreK, Postsec, Workforce, AND Student-Teacher link ONE of the following: K12, PreK, OR Postsec/ Workforce K12 24 $4.1M 20 $12.5M 14, 13 $3.7M, $4.8M 27 $5.6M # of grants: Avg. Award:

21. Postsecondary & Workforce Data in SLDS • Established K12 & PS Link (28) • Of those, NSC is Basis of K12/PS Link (16) • Tracking Postsecondary Completion (17) • Connected PS & Workforce Data (12)

22. Not just A Grant Program ^

23. Technical Assistance Resources and Topics • Regular TA visits to all states including non-grantees • TA Resources: • Effective Practices Conferences • Listservs, Workgroups, Webinars • Cross-state Regional Data Sharing Alliances, and CEDS • TA Topics: • Project planning & management • Data governance & quality, privacy/security • Stakeholder engagement, P-20W data linkage • Data Use

24. Complementary Programs Common Education Data Standards (CEDS) Privacy Technical Assistance Center (PTAC) National Forum on Education Statistics (the Forum) Department of Labor’s Workforce Data Quality Initiative

25. Common Education Data Standards (CEDS) • Specified sets of the most commonly used education and now workforce data elements drawn from NCES Handbooks, IPEDS, etc., similar to the NPSO Indicator 14 Data Dictionary • Tools • Mapping Tool (called “Align”) • How do my data elements compare to CEDS? • Policy and Program Question Tool (called “Connect”) • Which elements do I need to answer this question? • What questions could I answer if I had this data element?

26. Common Education Data Standards (CEDS) • Domains and Workgroups • Early Learning • K12 • Postsecondary • Career and Technical Education • Workforce • Adult Education • Connections Now Include EDFacts

27. Common Education Data Standards (CEDS) http://ceds.ed.gov

28. Contact Information Website: http://nces.ed.gov/programs/SLDS Website: http://ceds.ed.gov NCES Staff: Emily Anthony Program Officer, SLDS Grant Program Emily.Anthony@ed.gov, (202) 502-7495 Nancy Sharkey Program Officer, SLDS Grant Program Nancy.Sharkey@ed.gov, (202) 502-7494 Dorothyjean Cratty Program Officer, SLDS Grant Program Dorothyjean.Cratty@ed.gov, (202) 502-7443

29. Future Topics What topics would you like to see covered on future SLDS COP calls? Any special requests?

30. NPSO SLDS COP Dates? • Upcoming SLDS COP-2013 • December-6

31. Contacts Deanne Unruh, dkunruh@uoregon.edu Dawn Rowe, drowe3@uoregon.edu Caroline Magee, magee@uoregon.edu Valerie Mazzotti, vmazzott@uoregon.edu Charlotte Alverson, calverso@uoregon.edu http://www.psocenter.org