January 2010 For more information, e-mail DMDCSurveyResults@osd.pentagon.mil

1. Human Resources Strategic Assessment Program (HRSAP)Survey Division at the Defense Manpower Data Center (DMDC) January 2010 For more information, e-mail DMDCSurveyResults@osd.pentagon.mil

2. Defense Manpower Data Center (DMDC) Mission DMDC is the Department of Defense (DoD) enterprise human resource information source, providing secureservices and solutions to supportthe Department's mission. Strategic Goals • Promote DMDC’s core values and sustain a highly skilled and motivatedworkforce • Be a leader in joint information sharing and decision support on DoD human resource issues • Be the central source to identify, authenticate, authorize and provide information on DoD affiliated personnel • Be the one, central access point for information and assistance on DoDentitlements, benefits and medical readiness for uniformed services’ members, veterans & their families • Expand Electronic Government, in the broadest sense, across the DoD and its partners

3. HRSAP Mission • Design, conduct, and analyze Joint-Service surveys for Office of the Under-Secretary of Defense (Personnel & Readiness) (OUSD(P&R)) • Provide the Department with fast, accurate assessments of the attitudes and opinions of the entire DoD community to: • Evaluate existing programs/policies • Establish baseline measures before implementing new programs/policies • Monitor progress of programs/policies and their effects on the total force • Review multi-component personnel surveys • Provide technical assistance to the Office of the Secretary of Defense (OSD)/Service personnel on surveys and studies • Chair Inter-Service Survey Coordination Committee (ISSCC)

4. HRSAP Surveys • Various types of surveys depending on subject matter and population of interest : Web-based surveys covering multiple topics that are regularly administered to provide data from representative samples of active duty and Reserve component members and DoD civilian employees : Web-based scientific polling designed to provide DoD leadership with fast turnaround information based on a few key questions concerning specific personnel policies and concerns : In-depth studies of topics and populations, often requiring both paper-and-pencil surveys and Web-based surveys, that take longer to develop, administer, and analyze

5. Examples of Recent DMDC Surveys • 2008 QuickCompass of Military Health System (MHS) Employees • Web-based poll fielded February 1 – 20, 2008 to 140K active duty and DoD civilians • Included measures assessing strengths and weaknesses within the MHS program for which data are needed for immediate program evaluation • December 2007 Reserve SOFS • Web-based survey fielded November 26, 2007 – January 17, 2008 to 82K members • Included a representative sample of 1st Brigade Combat Team, 34th Infantry Division (1/34 BCT) members from Minnesota, and a census of 1/34 BCT members from other states to evaluate the pilot “Beyond the Yellow Ribbon” reunion and reintegration program • Sampling 1/34 BCT members in June and November 2008 for longitudinal evaluation • 2008 Survey of Reserve Component Spouses • Web-based survey with paper-and-pencil option being fielded December 10, 2007 – March 19, 2008 to 56K spouses • Included similar sampling design to include spouses of 1/34 BCT members • Allows for matching to member results; no plans to follow spouses longitudinally

6. Examples of Recent DMDC Surveys(Continued) • DES Pilot Surveys • Data to be collected April 2008 to July 2010- as participants hit key DES milestones (MEB, PEB, transition) • Survey instruments will be prepared for self-administered paper-and-pencil and Web surveys, and by telephone for Program Participant Survey, Program Family Members Survey, and Program Non-Participant Survey; Stakeholders Surveys TBD • Employing National Guard and Reserve Surveys • Web-based poll to be fielded May-June, 2010 to 250K employers on their experiences with and attitudes on employing National Guard and Reserve members • Included measures assess impact of military absences on business procedures, policies on adapting to military absences, knowledge of laws protecting the employment of National Guard and Reserve members, and potential interventions to improve employer/member relations • 2008 QuickCompass of Military Members • Web-based poll fielded June 10 – 30, 2008 to 139K active duty and Reserve component members • Included measures assessing mental health and Post Traumatic Stress Disorder (PTSD)

7. Examples of Recent DMDC Surveys(Continued) • Military Family Life Project • Data to be collected from four surveys over a two year period starting in March 2010 • Sample will be of active duty spouses with members surveyed at least once to create a matched couple file • Included measures will assess family coping and the impact of deployments

8. Examples of the Use of Survey Results • Predatory Lending • April 2006 Active Duty Web survey results used for a report to Congress required by Section 579 of the National Defense Authorization Act for Fiscal Year 2006 • DoD Civilians • Results used to track attitudes and opinions as the Department transitions to the National Security Personnel System (NSPS) • Military Academy Sexual Harassment • 2006 survey results included in the Academic Program Year 2006 Report on Sexual Harassment and Violence at the Military Service Academies prepared by the Sexual Assault Prevention and Response Office • Military Spouses • 2006 survey results incorporated into a funding formula requesting Department of Labor’s extension of Workforce Investment Act funds (at an annual cost of $108M) to military spouses for education, training, and payment of certification/licensure fees

9. SOFS Frequency and Content • Current guidance and funding supports: • 3 active duty SOFS per year (April, August, December) • 2 Reserve component SOFS (June, December) • 1 DOD civilian employee SOFS (February) • Civilian SOFS content is largely the same from one survey administration to the next • Active duty and Reserve SOFS operate on cyclical plans to accommodate all requested content across multiple survey administrations • Although major topics cycle, each SOFS administration includes leading indicator items (i.e., retention intentions, overall satisfaction, stress, readiness, and tempo) • All SOFS leave room for “hot-button” items to be included at the time of survey administration

10. Status of Forces Surveys — Content Plans • Long-term plans outline a 2-year cycle of coverage for active duty and Reserve surveys and a 1-year cycle for DoD civilian surveys • Developed with P&R policy offices and approved by USD(P&R) • P&R policy offices also contribute to development of each survey and officially coordinate on surveys prior to USD(P&R) review and approval • Both the long-term content plans and the individual survey content development ensure HRSAP supports: • Metrics for Balanced Scorecard, Well-Being of the Force, and OPM-imposed Annual Employee Survey requirement • Operational priorities (e.g., November 2008 SOFS contained items to support Federal Voting Assistance Program and Quadrennial Review of Military Compensation) • DoD Human Capital Strategy (HCS) goals (e.g., civilian SOFS contain NSPS performance-based management measures)

11. FY10 Surveys • 3 active duty SOFS per year (spring, summer, fall) • 2 Reserve component SOFS (spring, fall) • 1 DOD civilian employee SOFS (February) • QuickCompass of Valor Awards • QuickCompass of Defense Travel System (DTS) Users • Living Patterns Survey • Department of Defense National Survey of Employers • Post-Election Federal Voting Surveys • Service Academy Survey • Active Duty Gender Relations Survey • Military Family Life Project (replaces 2010 Active Duty Spouse Survey)

12. Survey Products • Tabulation Volumes: Responses to each question reported by categories of interest • Briefings: Graphic display of results, trends when available, and summary of findings • Survey Notes: Special analyses written upon request • Overview Reports: Summary of Human Relation Survey findings, history of issues (i.e., EO, SH), graphic display of results, tables showing results by categories of interest • Web Site: Principal tool for disseminating survey results, downloadable survey products, results by population, topic search www.dmdc.osd.mil/surveys

13. Survey Process Planningand Design Execution Data Collection • Via direct Web input or optical scanning of paper surveys • Develop content • Population sampling • Questionnaire reviewand approval • Create survey instrument • Upload/print survey • Mail notification (postal and e-mail) • Develop coding scheme Survey Analysis Macro (SAM) Survey Authoring and Notation Tool (SURVANT) Survey Reporting Tool (SRT) Sampling Tool Sample and Survey Design Analysis and Reports Dataset Creation and Verification • Sampling Toolprovides least number of individuals needed to adequately sample each strata • SURVANTloads survey questions and creates skiplogic • SAM automates batch mode SUDAAN analyses • SRT used to convert statistical analysis output to survey products (i.e., tabulations and briefings) • Data editing • Input variables, including skips, notes, weights, etc. into SAS® • Create (1) confidential datasets for analytic purposes and (2) basic datasets for distribution

14. Survey Process – 1,000 Foot View

15. Sample and Weighting Process Design Population File Sample Allocation • DMDC Sampling Toolprovides least number of individuals needed to adequately meet precision constraints on analysis domains • Discuss goals with the sponsor • Determine population restrictions • Gather key characteristics • Calculate sample size options • Provide population request • Develop sampling frame • Confirm variables used in sample allocation Survey Analysis Macro (SAM) SAS® Customized software for weighting process DMDC Sampling Tool Typical DMDC sample is single stage, nonproportion random sample of individuals. Databases DEERS Active Duty Master File (ADMF) Reserve Component Common Personnel Data System (RCCPDS) Sample File Development Weighting & Variances Documentation • Attach Contact Information (postal and e-mail) • Create layouts for data processing • Export files for data collection • Weighting Steps • Case disposition resolution • Nonresponse adjustment • Post-stratification • SAM uses SUDAAN for data and variance analyses • Statistical Methods Reports • Codebooks • Create confidential datasets for analytic purposes and basic datasets for distribution

16. Status of Forces Survey Timelines-Stretch GoalsMust be Met for Key “Hot” Items Data Collection Execution Planningand Design Month 3 • Create Web-based survey instrument • Upload survey • Develop coding scheme • Test data collection programs Months 4 - 5 • Postal mail notification • Email announcement • Via direct Web input • Initial (Raw) data delivered Months 1 - 2 • Develop survey content • Population sampling • Questionnaire reviewand approval Web Accessibility of Survey Results Dataset Creation and Verification Analysis and Reports Month 6 • Data editing • Input variables, including skips, notes, weights, etc. into SAS® • Create (1) confidential datasets • for analytic purposes and (2) basic datasets for distribution • First weighted dataset Months 7 - 10 • Analyses conducted • Tabulations and briefings prepared • Sent to USD(P&R) as available for review and comment • Shortly thereafter sent to policy offices and ISSCC Month 11 • Made available to the DoD (i.e., .mil) community 6 weeks after USD(P&R) delivery • Site accessible from NPRNET and Web Guard

17. Human Relations Survey Timelines Data Collection Execution Planningand Design Month 3 • Create Web-based survey instrument • Format Paper survey instrument • Upload/Print survey • Develop coding scheme • Test data collection programs Months 4 - 6 • Postal mail notification • Email announcement • Paper survey mailed • Via direct Web input and optical scanning of paper surveys • Initial (Raw) data delivered Months 1 - 2 • Develop survey content • Population sampling • Questionnaire reviewand approval Web Accessibility of Survey Results Dataset Creation and Verification Analysis and Reports Months 7 - 9 • Data editing • Input variables, including skips, notes, weights, etc. into SAS® • Create (1) confidential datasets for analytic purposes and (2) basic datasets for distribution • First weighted dataset Months 10 - 13 • Analyses conducted • Tabulations, Report, and Briefing prepared • Sent to USD(P&R) and policy offices for review and comment Month 14 • Made available to the DoD (i.e., .mil) community after USD(P&R) delivery • Site accessible from NPRNET and Web Guard

18. QuickCompass Survey Timelines-Stretch Goals Execution Data Collection Planningand Design Weeks 1 - 4 • Population sampling • Sample file preparation • Develop survey content • Questionnaire review and approval Weeks 6 – 8 • E-mail announcement • Via direct Web input • Initial (Raw) data delivered Weeks 4 - 5 • Create Web-based survey instrument • Upload survey • Develop coding scheme • Test data collection programs Analysis and Reports Web Accessibility of Survey Results Dataset Creation and Verification Weeks 9 – 10 • Data editing and coding • Weighting • Input variables, including skips, notes, weights, etc. into SAS® • Create (1) confidential dataset for analytic purposes and (2) basic dataset for distribution Weeks 11 - 14 • Analyses Conducted • Tabulations and Briefing Prepared • Sent to USD(P&R) for review and comment • Shortly thereafter sent to policy offices and ISSCC Week 16 • Made available to the DoD (i.e., .mil) community 2 weeks after USD(P&R) delivery • Site accessible from NPRNET and Web Guard

19. Back-Up Slides

20. Active Duty SOFS Content Plan

21. Reserve SOFS Content Plan

22. DoD Civilian SOFS Content Plan

23. Details on Active Duty SOFS Administrations

24. Details on Reserve SOFS Administrations

25. Details on Civilian SOFS Administrations