1 / 29

The Q-suite: Q-Bank and Q-Notes

Justin Mezetin and Meredith Massey NCHS Questionnaire Design Research Laboratory. The Q-suite: Q-Bank and Q-Notes. FedCASIC 2014: Survey Evaluation Methods March 19, 2014. Outline. Introduction Analytical Framework Q-Notes: Qualitative Analysis software

iria
Download Presentation

The Q-suite: Q-Bank and Q-Notes

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Justin Mezetin and Meredith Massey NCHS Questionnaire Design Research Laboratory The Q-suite: Q-Bank and Q-Notes FedCASIC 2014: Survey Evaluation Methods March 19, 2014

  2. Outline • Introduction • Analytical Framework • Q-Notes: Qualitative Analysis software • Q-Bank: Question Evaluation library and resource • Next Steps

  3. Introduction • What is cognitive interviewing/question evaluation? • Benefits of Cognitive Interviewing • Validity studies showing all phenomena the question is capturing

  4. Analytical Framework

  5. Background Challenges • Time consuming to conduct a thorough analysis • Larger sample sizes (N > 20) • Multiple projects with over 100-150 interviews • Collaboration • Multiple Interview Locations • Researchers with varying levels of experience • Testing in Multiple Languages

  6. Q-Notes: Analysis Software

  7. Level One: Conducting Interviews • Interview guide • Consistency • Pre-selected Themes • Multiple Languages • Raw data storage

  8. Interview Guide

  9. Question Translation

  10. Level Two: Summarizing Interview Notes • Synthesizing raw data • Tagged videos • Researcher collaboration • Viewing data for a single respondent

  11. Summarizing Interview Notes

  12. Level Three: Comparing Across Respondents • Developing thematic schema • Project level themes • Question level themes • Flexibility • Consistency across coders • Cross interview comparison

  13. Viewing one question across all respondents

  14. Level Four: Comparing Across Groups • Development of Advanced Schema • Sub-group analysis • Comparative analysis

  15. Subgroup Analysis

  16. Subgroup Analysis Results

  17. Comparative Analysis

  18. Level Five: Drawing Conclusions • Report template • Summary tables • Thematic schema

  19. Report Template

  20. Q-Bank: Disseminating Findings

  21. Q-Bank Users • Data Analysts • Questionnaire Designers • Survey Methodologists • Survey Managers

  22. Q-Bank Benefits • Deeper understanding of what survey variables are capturing • Share/view findings from studies conducted at other organizations • Resource to learn more and dialog about Question Evaluation • Mechanism to compare different methods and findings

  23. Searching Q-Bank

  24. Q-Bank Search Results

  25. Question Selection

  26. Question Details

  27. Q-Suite Features • Collaboration • Consistency • Transparency • Q-Notes: Qualitative Analysis Software • Q-Bank: • Library of Evaluation studies • Resource on Question Evaluation

  28. Q-Suite Next Steps • Q-Notes • Run a public beta test Summer 2014* • Export feature to submit into Q-Bank • Q-Bank • Continue increasing content • Inclusion of all methods in Q-Bank • Pilot test with NHIS to link key variables to Q-Bank testing reports

  29. Questions or Feedback? • Contact Us: • QBank@cdc.gov • Visit: • www.cdc.gov/QBank • www.cdc.gov/QNotes

More Related