1 / 17

The Integrity of Data Management Responsible Conduct of Research Workshop

The Integrity of Data Management Responsible Conduct of Research Workshop. Howard University February 8, 2011. Peggy Carr, Ph.D. Associate Commissioner National Center for Education Statistics. 1. Overview of Statistical and Research Standards. 2.

zareh
Download Presentation

The Integrity of Data Management Responsible Conduct of Research Workshop

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. The Integrity of Data ManagementResponsible Conduct of Research Workshop Howard University February 8, 2011 Peggy Carr, Ph.D. Associate Commissioner National Center for Education Statistics 1

  2. Overview of Statistical and Research Standards 2

  3. OMB Guidelines for Federal Statistical Agencies • 16 Federal Statistical Agencies adhere to Office of Management and Budget Guidelines to maintain high standards of performance • Development of concepts and methods • Planning and design of surveys and other means of collecting data • Collection of data • Processing and editing of data OMB, Guidelines for Ensuring and Maximizing the Quality, Objectivity, Utility, and Integrity of Information Disseminated by Federal Agencies, February 22, 2002, (67 FR 8752-8460) 3

  4. Best Practices for the Conduct of Research 4

  5. Best Practices for the Conduct of Research • Conceptualize Research Problem • Operationalize Study Design • Engage in Peer Review and Networking Activities • Publish and Publish Early/Often • Be Ethical 5

  6. 1. Conceptualize Research Problem Literature Review Statement of Problem Definition of Terms, Concepts, and Constructs Conceptual Operational Hypotheses Research Question 6

  7. 2a. Operationalize Study Design The Concept of Study Design Explained Variance Hypothesis 1 Unexplained Variance Sampling Error Measurement Error Validity Reliability

  8. 2b. Operationalize Study Design • Validation of Constructs • Face – Content validation across judges • Criterion – Predictive and concurrent • Construct – Methodological approaches to validation Jealousy Envy 8

  9. 2c. Operationalize Study Design • Reliability of Measures • Test and Retest – stability over time • Equivalency – consistency across forms • Internal – internal consistency UNRELIABLE RELIABLE 9

  10. 2c. Operationalize Study Design • Research Design • Internal Validity – refuting rival plausible hypotheses • External Validity – generalizability of findings • Choice of Designs – experimental, quasi, survey, correlational Y X 10

  11. 2c. Operationalize Study Design • Quality Assurances of Data • Data Checks (e.g., out of range variance, criterion reference checks, replication) • Thoughtful and Appropriate Data Analysis • The nature of your data • Limitations of statistical technique • Discuss Findings and Conclusions with Colleagues • Relate back to literature review • Implications for future research • Flaws and limitations NEXT 11

  12. 2c. Operationalize Study Design Trend in fourth-grade NAEP mathematics average scores 12

  13. 2c. Operationalize Study Design Trend in fourth-grade NAEP mathematics percentile scores 13

  14. 3. Engage in Peer Review and Networking Activities • Find a specialty and stick with it • Attend professional meetings and conferences – share your research • Keep an open mind and learn from others 14

  15. 4. Publish and Publish Early/Often • Start your publication record early in peer reviewed journals • As first, second, or third author • Publish and/or present often • Regardless of professional focus • Annually 15

  16. 5. Be Ethical • Be committed and follow through • Adhere to • Subjects’ Rights • Institutional Review Board • Confidentiality and Privacy Rights 16

  17. Questions? 17

More Related