The Effort to Develop Disability Questions for the Current Population Survey Terence M. McMenamin U.S. Bureau of Labo

1. The Effort to Develop Disability Questions for the Current Population Survey Terence M. McMenaminU.S. Bureau of Labor StatisticsOctober 5, 2006

2. Development of questions • February 2006 test and results • Next steps

3. CPS Disability Data The goal of placing disability questions in the CPS is to measure the employment-population ratio of the disabled. Once the questions are in the CPS, the same data will be available for this group that the CPS provides for other demographic groups.

4. Definition of Disability The first prong of the ADA definition of disability: The term ''disability'' means, with respect to an individual, a physical or mental impairment that substantially limits one or more of the major life activities of such an individual. This definition was selected because it could be operationalized in a household survey like the CPS.

5. Selecting the Questions Test questions were drawn from the following surveys: • National Health Interview Survey on Disability (NHIS-D) • Survey of Income and Program Participation (SIPP) • World Health Organization Disability Assessment Survey (WHO-DAS) • National Organization on Disability/Harris Poll • Behavioral Risk Factor Surveillance System Quality of Life Module (BRFSS) • Census 2000

6. Initial Cognitive Interviews Three rounds of cognitive testing were conducted, first at BLS headquarters, then at the Westat Research Corporation. Several changes were made to the questions as a result of this process. At the end of the cognitive testing, the questions were placed in the National Comorbidity Survey (NCS).

7. The Test Vehicle The National Comorbidity Survey (NCS) • Nationally representative survey • Extensive questions on mental health • Many questions on physical well being BLS would be able to use the respondents’ answers to a fuller set of questions to evaluate the effectiveness of a smaller set.

8. Final Cognitive Interviews Three areas of concern: • How well do the questions work in the context of the CPS instrument? • How do the questions work as a set? • Should the questions be administered at the household or individual level?

9. The Question Set Does anyone in this household who is 15 years old or over have: • A hearing problem that prevents them from hearing what is said in normal conversation even with a hearing aid? • A vision problem that prevents them from reading a newspaper even when wearing glasses or contacts?

10. The Question Set -- continued • Any condition that substantially limits one or more basic physical activities, such as walking, climbing stairs, reaching, lifting, or carrying? • Any other physical disability? • Any emotional or mental disability?

11. The Question Set -- continued Because of a physical, mental or emotional condition lasting three months or longer, does anyone in the household who is 15 years old or over have: • Difficulty learning, remembering or concentrating? • Difficulty participating fully in school, housework, or other daily activities?

12. February 2006 Test Sponsored by the Office of Disability Employment Policy, and the National Institute on Disability and Rehabilitation Research Goals of the test • Assess impact on CPS response rates in subsequent months. • Evaluate the disability rate derived from the questions. Included 6 of 8 CPS rotations. Half of sample received disability questions, half did not.

13. Summary of results • Response rates were little affected. • Disability rates in CPS were lower than in NCS.

14. Data Analysis The sample distribution did not vary significantly by age or demographic group Differences were not found in completion rates by age or demographic group

15. Chart 9. “Yes” Response Rate by question Percent SOURCE: Bureau of Labor Statistics

16. Chart 7. Disability rates from CPS and NCS by race and Hispanic or Latino ethnicity Disability rate SOURCE: Bureau of Labor Statistics

17. Chart 6. Disability rates from CPS and NCS by age Disability rate SOURCE: Bureau of Labor Statistics

18. Chart 8. Disability rates from CPS by month in sample (MIS) Disability rate SOURCE: Bureau of Labor Statistics

19. Chart 10a. “Yes” Response Rate by question with CPS Self and Proxy Percent SOURCE: Bureau of Labor Statistics

20. Chart 10b. “Yes” Response Rate by question with CPS Self and Proxy Percent SOURCE: Bureau of Labor Statistics

21. Chart 11. Employment-population ratios by disability status and age Employment-population ratio SOURCE: Bureau of Labor Statistics

22. Chart 14. Comparison of disability rates NCS, CPS original algorithm, and CPS alternative algorithm (yes to any question) Disability rate SOURCE: Bureau of Labor Statistics

23. Next Steps Continue evaluation of test results • ASEC • Interviewer debriefing data • Observations during collection Examine results of ACS content test Goals for future work: • Learn more about the population identified • Learn more about the population missed • Determine possible improvements

24. Further Information A complete discussion of the effort to develop disability questions for the CPS is available online: http://www.bls.gov/ore/pdf/st050190.pdf A more extensive discussion and set of data tables from the February 2006 disability test is also available: http://www.bls.gov/ore/pdf/ec060080.pdf