Workforce Investment Act Youth Measures

1. Workforce Investment Act Youth Measures Jacksonville Youth WorkshopJanuary 15, 2003 Agency for Workforce Innovation

2. Where are Workforce Investment Act Youth Measures Reported? • Red & Green Report quarterly. • Monthly Management Report monthly • USDOL Quarterly Summary Report ETA 9090 • USDOL Annual Report ETA 9091

3. Where Does the Data Come From? Records entered into the state’s WIA Management Information System (MIS) for Customer Group “21”, Younger Youth participants, and Customer Group “22”, Older Youth participants. Unemployment Insurance wage records as reported by FETPIP RWB AWI DATA FETPIP

4. Color CodeThis presentation will be posted in color athttp://www.floridajobs.org/pdg/wia/Default.htm • A red bulletusually means Red/Green, MMR • ABlue bulletusually means a USDOL measure Green text usually means Red/Green and/or MMR Measure/Report Text in this blue font is usually FETPIP Supplied Data or a USDOL Measure/Report Text in this red font is usually data entered into the administrative record by the RWBs

5. Older vs Younger Youth • Determined by age at registration • Once established – does NOT change • Older Youth are 19 and not yet 22 years old at registration • Younger Youth are 14 and not yet 19 years old at registration

6. Workforce Investment Act (WIA) Youth Performance Measures • Older Youth Entered Employment Rate • Older Youth Retention Rate • Older Youth Wage Change Rate • Older YouthCredential Rate • Younger YouthRetention Rate

7. Workforce Investment Act (WIA) Youth Performance Measures • Younger Youth Diploma Rate • Youth Positive Outcome Rate • Youth GoalAttainment • Rate

8. Reg-3 Reg-3 Reg-2 Reg-2 Jul 00 Jul 00 Oct 00 Oct 00 Jan 01 Jan 01 Apr 01 Apr 01 Jul 01 Jul 01 Oct 01 Oct 01 Jan 02 Jan 02 Apr 02 Apr 02 Jul 02 Jul 02 Reg-3 Reg-2 Oct 00 Jan 01 Apr 01 Jul 01 Oct 01 Jan 02 Apr 02 Jul 02 Reg-3 Reg-2 Jan 01 Apr 01 Jul 01 Oct 01 Jan 02 Apr 02 Jul 02 Reg-3 Reg-2 Apr 01 Jul 01 Oct 01 Jan 02 Apr 02 Jul 02 Youth Measure Cohorts & Data Collection Periods PY2001-2002 Exits during the BLUE quarters are reported. GREEN quarters are the quarters of the outcomes counted for the LATEST blue quarter. The PINK quarters are the quarters of the outcome information for the FIRST blue quarter. [Outcome quarter information for the other BLUE quarters have the same time relationships to exit as those of the FIRST & LATEST blue quarters.] Older Youth Wage Change Rate – Exiters from BLUE, Outcomes from PINK & GREEN Expanded example with one BLUE exit quarter perline Note: Reg-3 means the 3rd quarter before the quarter of registration in WIA

9. Reg-3 Oct 00 Oct 00 Oct 00 Oct 00 Reg-2 Jan 01 Jan 01 Jan 01 Jan 01 Jul 00 Oct 00 Apr 01 Apr 01 Apr 01 Apr 01 Jan 01 Jul 01 Jul 01 Jul 01 Jul 01 Apr 01 Jul 01 Oct 01 Oct 01 Oct 01 Oct 01 Oct 01 Jan 02 Jan 02 Jan 02 Jan 02 Jan 02 Apr 02 Apr 02 Apr 02 Apr 02 Apr 02 Jul 02 Jul 02 Jul 02 Jul 02 Jul 02 Youth Measure Cohorts & Data Collection Periods PY2001-2002 Oct 00 Jan 01 Apr 01 Jul 01 Oct 01 Jan 02 Apr 02 Jul 02 Oct 00 Jan 01 Apr 01 Jul 01 Oct 01 Jan 02 Apr 02 Jul 02 Oct 00 Jan 01 Apr 01 Jul 01 Oct 01 Jan 02 Apr 02 Jul 02 Exits during the BLUE quarters are reported. GREEN quarters are the quarters of the outcomes counted for the LATEST blue quarter. The PINK quarters are the quarters of the outcome information for the FIRST blue quarter. [Outcome quarter information for the other BLUE quarters have the same time relationships to exit as those of the FIRST & LATEST blue quarters.] Older Youth Entered Employment Rate –Outcome from GREEN - data: (FETPIP) [ Exclusions Administrative Record] Older Youth Retention – Outcome from GREEN - data: (FETPIP) [ Exclusions Administrative Record] Older Youth Wage Change Rate – Outcome from PINK & GREEN - data: (FETPIP) [ Exclusions Administrative Record] Older Youth Credential Rate – Outcome through participation & GREEN - data: [ Administrative Record] & (FETPIP) Younger Youth Retention Rate – Outcome from GREEN - data: [ Administrative Record] & (FETPIP) Younger Youth Diploma Rate – Outcome from participation, BLUE & GREEN - data: [ Administrative Record] Younger Youth Positive Outcome Rate – Outcome during participation reported through exit or BLUE - data: [ Administrative Record] Younger YouthGoal Attainments – Participants from BLUE , attainments during BLUE- data: [ Administrative Record]

10. Exclusions fromallperformancemeasures: Institutionalized at exit Health/medical exits Deceased Reservists to Active Duty National Emergency Grants only Global WIA Exclusions

11. Entered Employment Rate Number Employed in Quarter after Exit divided by Number of Exiters • Wage recordsthe primary data source • Supplemental data may be used for persons not found in wage records (Florida does not use) • Excludeolder youthemployedat registration or inadvanced training/ postsecondary education(but not employed)in quarter after exit.

12. YES Entered Employment Rate Older Youth Employed at Registration? Excluded YES NO Numerator Employed in Quarter After Exit YES YES NO InAdvanced Trainingor Postsecondary Education in Quarter After Exit Denominator NO Excluded

13. Employment Retention Of those employed in the quarter after exit: • Based on thoseemployedin quarter after exit • Wage recordsthe primary data source • Excludesolder youth inadvanced training/ postsecondary education(but not employed)in 3rd quarter after exit. Number Employed in 3rd Quarter after Exit divided by Number Employed in Quarter after Exit

14. YES Employment Retention RateOlder Youth Employed Quarter After Exit? Excluded NO YES Numerator Employed 3rd Quarter After Exit YES YES NO In Advanced Training or Postsecondary Education in 3rd Quarter After Exit Denominator NO Excluded

15. Earnings Change Older Youth Of those employed in the quarter after exit: • Wage recordsonly • Exclude older youth in advanced training/ postsec. education(but not employed)in 3rd quarter after exit. Earnings in 2nd and 3rd Quarters after Exit Earnings in 2nd and 3rd Quarters before Registration minus divided by Number employed in quarter after exit

16. YES YES Earnings Change Older Youth Excluded Employed Quarter After Exit? NO YES Employed 3rd Quarter After Exit YES Yes NO Included In Advanced Training or Postsecondary Education in 3rd Quarter After Exit NO

17. Older Youth Credential Rate • Flexible definition of credential • Standard credentials • Certificates that recognize the successful completion of training services …. • Credential attainmentby end of 3rd qtr after exit • Positive outcome isattain credentialand: • Enter employmentor inadvanced training/postsec. educ. in quarter after exit (older youth) • Includes: • All older youth

18. Credential--Older Youth Number whoattain credentialand [enter employmentor are inadvanced trainingorpostsecondary education in the quarter after exit] divided by Number of exiters

19. NO NO Credential Rate--Older Youth YES Employed in Quarter After Exit Attained a credential NO In Advanced Training or Postsecondary Education in Quarter After Exit YES YES Denominator YES Numerator

20. Younger Youth Retention • In one or more qualifying outcomes in 3rd quarter after exit • Postsecondary education • Advanced training • Military service • Qualified apprenticeship • Unsubsidized employment • Exclude youth in secondary school at exit • Not related to outcome in quarter after exit

21. NO Younger Youth Retention Rate In Secondary School at Exit? Excluded YES NO Retained in 3rd Quarter After Exit Numerator YES YES Denominator

22. HS Diploma/GED Attainment Of youth who werenotHS grads at registration: • Diploma can be attained during participation or by end of quarter after exit • Excludeyouth still in secondary school at exit Number of exiters whoattained diplomadivided by Number ofexiters not still in school at exit

23. YES Younger Youth Diploma Rate HS grad at registration? Excluded YES NO Numerator Attained Diploma? YES YES NO In Secondary School at Exit? Denominator NO Excluded

24. WIA Younger Youth Positive Outcome Rate In one or more qualifying outcomes at exit • Postsecondary education • Advanced training • Military service • Qualified apprenticeship • Remained in secondary school • Entered Employment on the administrative record • Earned a HS diploma or equivalent during participation divided by The number of younger youth exiters

25. WIA Younger YouthGoal Attainment Rate The percentage ofbasic skills,work readiness andoccupational skills goals attainedout of the number ofgoals due or required to be setin the report period Calculation: # of goals attained during a report period # of goals due or required to be set in a report period Data comes from theWIA MIS

26. WIA Younger YouthGoal Attainment Rate Groups of Goals Counted • Goals attained timely • Goals 1 year old and not attained • Goals not 1 year old and not attained at exit • Goals that should have been set and were not

27. Calculating the WIA YoungerYouth Goal Attainment Rate Which goals count in the Numerator: • All goals attainedin a report period • Exception: Goals attained late

28. Calculating the WIA YoungerYouth Goal Attainment Rate Goals Counted In The Denominator: • Goals attained timely in the period (before due date <365 days) [Numerator];+ • Goals due, not attained in period;+ • Exiters with goal set dates (less than 1 year) before exit and not attained at exit;+

29. Calculating the WIA YoungerYouth Goal Attainment Rate Denominator factors continued: • Basic Skills Deficient carryovers without BS goal set between 7/01/01-6/30/02;+ • BS deficient youth registered after 06/30/02 without BS goal set date = registration date;+

30. Calculating the WIA YoungerYouth Goal Attainment Rate Denominator factors continued: • BSD on anniversary date; without BS goal set date = anniversary (month/day of registration);+ • Youth Not Basic Skill Deficient; without goal set date = registration or anniversary date. Note: Permissible to set a Basic Skills goal for non-basic skills deficient youth

31. Strategies for Improving the Younger Youth Goal Attainment Rate • Record a goal for all younger youth with set date = Registration date • Set first goal within 30 days of Registration • Set only 3 goals per participation year • Set Basic Skills as first goal set for youth who are Basic Skills Deficient • Set a Basic Skills goal until youth is no longer basic skills deficient

32. Strategies for Improving the Younger Youth Goal Attainment Rate (Cont.) • Set a goal for every youth with a set date = anniversary date.[Goals set at anniversary (set date = anniversary date) can be set within 30 days before/after the anniversary date] • Younger Youth should have an open goal at all times (Exception: up to 90 days without a goal may occur) • If 3 goals set and attained in participation year, use ISS objectives to guide planning and skill tracking until anniversary date

33. Strategies for Improving the Younger Youth Goal Attainment Rate (Cont.) • Enter goal attainment data accurately and timely • Report all younger youth goal attainments as they occur • Enter attainment/non-attainment within 365 days of the goal set date Note: Attainments not recorded in the MIS timely are not counted in the performance measure.

34. Resources USDOL TEGL 7-99 Core and Customer Satisfaction Performance Measures http://wdr.doleta.gov/directives/attach/TEGL7-99.pdf AWI FG 02-029 9/20/2002 WIA Younger Youth Skill Attainment Rate http://www.floridajobs.org/pdg/guidancepapers/029YoungerYouth.rtf TEGL 14-00, Change 1 WIASRD http://wdr.doleta.gov/directives/attach/TEGL14-00-ch1AttachE.pdf Reports & Performance Measures and Standards http://www.floridajobs.org/partsvcs.htm

35. Questions or Additional Information AWI Website for WIA reports http://floridajobs.org/awi/pdg/reports/default

36. Let’s Play Positive Or Negative?

37. Scenarios – Bob Bob was unemployed and had no diploma or GED when he was registered asan Adult for services. He was served in an OJT and exited the program working for that employer, Wilder Widgets, at $11.00 per hour. Bob’s region did not award credentials for OJT. His career Manager checked up on him all along and at 6 months found out that Bob had earned his GED. In the 3rd quarter after exit, the Career Manager’s check in reveals that Bob has been promoted and is earning more money. This is positive, but why?

38. Why Bob is Positive…. • Bob was an unemployed Adult at entry who was found employed in the first quarter after exit – so, that’s an Entered Employment credit. • Bob was still employed in the 3rd quarter, so that’s Retention. • Bob is earning more money, so that gives you a positive indicator on earnings gain. • 4. Bob was served through training and earned a credential before the end of the 3rd quarter!

39. Billie Ann Billie Ann was a Dislocated Worker served through training. She earned a RN degree and got a job after training and was employed in her first quarter after exit. THEN, she met a rich doctor, married him and quit her job two months after starting it. What impact does she have on your performance?

40. Billie Ann’s Impact • Billie Ann counts in the Employment rate equation. She was found employed by the end of the first quarter after exit, so that’s a positive. • Since Billie Ann was employed in the first quarter, she counts in your retention equation. But she quit before the 3rd quarter after ext, so you lose on this one. • Again, since she was found employed in the first quarter she counts in earnings replacement – negative impact. • 4. Billie Ann got a credential through training and was found employed in the first quarter, so that’s positive!

41. Jeannie – Older Youth Jeannie was unemployed when she entered the program – she had a job 3 months earlier making $6.25 an hour but ditched it to spend more time with her Beau. Her case manager enrolled her into Leadership Development activities, and Jeannie got bored with the program. She dropped out, and got a job for herself making $9.00 per hour balancing tires. Her case manager, though not the best at selecting services, was a good detective and found her in that job and closed her. The CM found her still employed at the 6 and 9 month marks. What do you think?

42. Jeannie, The Tire-Tosser • Since she was unemployed at entry, she’s in the entered employment rate and is POSITIVE! • Jeannie was still employed at the retention check, so you’re good there. • Based on Jeannie’s pre-program wage and what you know she’s making now, she should be good on earnings gain. • Here’s the bad part: Credential Attainment is based on ALL Older Youth, regardless of the service. Jeannie didn’t get a credential, so she counts against you here.

43. Marina Marina was a Dislocated Worker served through the One Stop in Intensive Services. Pre-program she earned $8.50 per hour. She got a new job at $9.50 per hour and exited the program in that job. Four months later her employer paid for her to get trained and credentialled as a Microsoft Certified Engineer. Her boss formed his own company and hired her at an even higher wage, which is where the Career Manager found her in the third quarter after exit. What do you think?

44. Marina’s Impact • Marina entered employment and was found employed in the first quarter after exit, so she’s good on the Entered Employment rate. • Marina was still employed in the 3rd quarter after exit, another positive. Even though she moved to a new employer, she was still found employed. • You have a good indicator that if she entered the program at $8.50, left it at $9.50 and was earning more than that in the 3rd quarter she’ll have a positive impact on earnings gain. • 4. Sorry – no credential credit. She wasn’t served through training so she’s not in that equation.

45. Andrea Andrea was registered as an unemployed Adult and enrolled into training. She decided after a couple of days of being in the culinary arts program that she’d rather move to Albuquerque and watch Jerry Springer from the comfort of her mother’s couch. How does Andrea affect your performance?

46. Albuquerque Andrea • Since she was unemployed at entry, she’s in the Entered Employment rate - negative hit here. • No harm/no foul on Retention since she wasn’t found employed in the first quarter. • She won’t show up in earnings gain, either. • She was served in training and she neither earned a credential nor entered employment – so she’s negative here, too. • So, Andrea is two negatives and two no harm/no fouls!

47. Maynette Maynette entered the program employed part time as a Kiddie Entertainment Specialist ($6.75 an hour) at one of the resorts on the beach. She was placed in an OJT with Publix to learn to be a butcher. She successfully completed her OJT and was awarded a certificate of completion as as result. She was closed earning $10.50 an hour at Publix. At the 6 month follow up, her case manager found that Maynette had won a scholarship to the Ft. Lauderdale Institute of Art. AT 9 months, Maynette was still attending school and not working. What do you think?

48. Maynette – the Next Monet? • Maynette was employed at registration, so she is not in the Entered Employment equation. • As to retention, though Maynette was found employed in the first quarter after exit but not in the 3rd, she WAS found in post secondary education. She comes out of this equation. • Maynette comes out of earnings gain for the same reason as retention. • Maynette did get a credential, so she both counts and is positive in this equation.

49. Bryan the Burger Boss Bryan was working as a burger flipper for $6.75 an hour at the Big Cow Café when he registered as an adult for services. He was placed in training but only last through one semester, long enough to hit an OCP. That OCP helped him get hired as a manager for $9.75 an hour by Big Cow’s rival, the Kickin’ Chicken. Six months later his case manager found him back at Big Cow as the general manager making the princely sum of $15.00 per hour. This all sounds good and is good, but why?

50. Bryan’s Burger Success • Since Bryan was employed at entry, he won’t be in the entered employment rate. No harm here. • Even though Bruce changed employers, he was found employed – you get Retention points! • Bruce was earning more at placement and even more at six months, so you know your earnings gain should be good. • 4. Bruce was both employed and had earned a credential (he hit an OCP) so he’s a positive on the employment and Credential measure!