Data -Based Decision Making Brian Kelsey, Accelerating Connections to Employment & Accelerated Training for Illino

1. Data-Based Decision MakingBrian Kelsey,Accelerating Connections to Employment &Accelerated Training for Illinois Manufacturing

2. Accelerating Connections to Employment (ACE)

3. ACE Goals Cumulative across 9 sites in 4 states • Participants: 1281 treatment (1281 control) • Outcome Goals • 961 (75%) complete training • 721 (75%) employed at $9 - $15/hour • 576 (80%) retain employment six months • 70% retain employment twelve months

4. Data Is Critical for Management Assumption • Customized of the shelf database would meet the program and the evaluator’s needs in a timely manner • It would be relatively easy to manage, maintain, and produce reports Reality • Customizing a database for any new program, let alone a random control trial, is neither simple or quick • What is promised is not always what can be delivered • Be prepared with back-up options

5. ACE Data System & Monthly Dashboard • Data System – Participant Files • All participant information that normally goes in a customer file – potentials, treatment & control • Fairly limited (at this point) reports • Monthly Dashboard – Site Results • Excel spreadsheets to track wide range of relevant data specific to each site & rolled up for ACE overall • Completed by sites monthly until the data system reports are functional • More complex as the number of cohorts grows

6. Utilizing The Data • Independent Evaluation – Data System • Base line surveys • Participant contact information • Results • Grant Management - Dashboard • “Projection to actual” - participant numbers & cohorts • Goal results • Visual comparisons by site & ACE • Guidance - funding by performance

12. National Workforce Innovation Grantee MeetingWashington, D.C.March 27, 2014 • Michael BakerManager – Strategic Planning & GrantsOffice of Employment & TrainingIllinois Department of Commerce & Economic Opportunity • Jeanne KitchensAssociate DirectorCenter for Workforce DevelopmentSouthern Illinois University-Carbondale

13. Establishing Demand Where to invest limited resources

14. The Challenge 82% of Manufacturers in USA report moderate to severe shortages of skilled workers

16. Illinois Manufacturing SnapshotSource: IDES Economic Information & Analysis

17. Labor Market Information Illinois: Categories of manufacturing demand occupations Demand and specialization within categories varies across regions

18. Employers: “We need more skilled workers …NOW!” • Illinois Manufacturers: • Are struggling to fill skilled jobs vacant just through regular turnover and retirements • Must replace 30,000 production workers every year for the next 15 years (Source: Bureau of Labor Statistics) • Want better job candidates – that possess basic skills needed for manufacturing

19. Job Seekers: “I need a good paying job…NOW!”

20. Program Model OverviewMeeting the Demands of Employers and Jobseekers

21. ATIM is a DIFFERENT, Data-Driven Approach

22. Employer Demand-Driven “Pull Model” Q: What determines the type and quantity of training offered in a region? A: LMI & Employer Data Employer involvement CRITICALThe Workforce System must know: Occupations Skills / Competencies Timing Quantity Location

23. Accelerated – from Enrollment to Employment

24. Industry Recognized Stackable Credentials • Nationally portable • Provides known skill sets • Reduces uncertainty of technical qualifications • Uses DOL Advanced Manufacturing Competency Model • National Institute of Metalworking Skills • Mfg. Skills Standards Council • American Welding Society • American Production & Inventory Control Society

25. ATIM Regions NS CC • Regional Teams NC C SW

26. Benchmarking Our Efforts

27. www.ilworknetmanufacturing.com • Mobile friendly • Regional outreach to job seekers and employers • Online program application • Partner facilitation and engagement tools • Client planning and preparation tools ATIM Web Applications

28. Client Planning and Preparation Tools

29. Personalized Training and Employment Plan

30. Region Team Training and Guidance • In-person and online training • Online Guide • Ongoing technical assistance webinars

31. A Simple Dashboard Approach…

32. … to Managing the Client Pipeline

33. Client IntakeAllows state and regional teams to see any bottlenecks and loss rate by region or statewide from when application is submitted through Random Assignment.

34. Client Intake Can analyze applicants to planfor likely services that will be needed.

35. EXPORT feature creates a spreadsheet for even more flexible data analysis. CENSORED

36. Job Forecasts from Regional Employers To know regional employer demand, state and regional teams can view job forecasts by occupational type and time frame.

37. Current Placement Opportunities To meet regional employer demand, state and regional teamscan view job openings by occupational type and time frame.

38. How many are at each phase? Training to Job Placement Pipeline

39. State and LWIA Staff Drill Down to Participant Details Who is at each phase? CENSORED

40. Additional Service Status Detail Linked fromthe Official Participant Reporting System

41. Credentials Earned Linked from the Official Participant Reporting System

42. don’t get carried away… “Everything that can be counted does not necessarily count; everything that counts cannot necessarily be counted.” Albert Einstein