Survey development
This presentation is the property of its rightful owner.
Sponsored Links
1 / 13

Survey Development PowerPoint PPT Presentation


  • 56 Views
  • Uploaded on
  • Presentation posted in: General

Survey Development. Rita O'Sullivan Evaluation, Assessment, & Policy Connections (EvAP) School of Education, University of North Carolina-Chapel Hill [email protected] or 919/843-7878. Overview. Evaluation Theory & Practice Elements of an Evaluation Plan: Logic Models Evaluation Instruments

Download Presentation

Survey Development

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Survey development

Survey Development

Rita O'Sullivan

Evaluation, Assessment, & Policy Connections (EvAP)

School of Education,

University of North Carolina-Chapel Hill

[email protected] or 919/843-7878


Overview

Overview

  • Evaluation Theory & Practice

  • Elements of an Evaluation Plan: Logic Models

  • Evaluation Instruments

  • Q & A


Surveys for a purpose

Surveys for a Purpose

  • What information is needed?

  • Who needs the information?

  • How will it be used?

  • Who has the information you need?

  • What’s the best way to get it?

  • What resources are available?


Evaluation planning logic models

Evaluation Planning - Logic Models


Guide to instrument selection

Guide to Instrument Selection


Logic model all stars

Logic Model –All Stars


Validity and reliability

Validity and Reliability

  • VALIDITY: Is the degree to which the assessment is appropriate to its purpose.

  • RELIABILITY: Will this assessment get the same response every time.

  • TRIANGULATION: Verifying findings through multiple data sources.


Sampling

Sampling

QUALITATIVE DATA COLLECTION

HIGH

Lack of Information about the Topic

Need for Explanation/Rich Description

Issue Complexity

Difficulty around Obtaining Information

LOW

QUANTITATIVE DATA COLLECTION


Types of sampling

Types of Sampling

  • Simple Random

  • Stratified

  • Cluster

  • Systematic

  • Purposeful

  • Convenience

  • Snowball


Response rates

Response Rates

  • Factors that influence response rates

    • Saliency

    • Reminders

    • Ease of response

  • Increasing sample size will not increase response rates


Ensuring data quality

Ensuring Data Quality

  • Sample representativeness?

  • Consistent across individuals?

  • Appropriate to purpose?

  • Collected in a culturally appropriate manner?


Draft program student survey

Draft Program Student Survey


Sample focus group protocol

Sample Focus Group Protocol

  • SCALE wants to know how the Student to Student program is working and what impact it is having on your campuses and with your community partners. They have asked us to conduct this focus group to begin exploring these areas. After we talk, we will summarize what you’ve said to capture the essential points of our discussion; we will make sure that individuals cannot be identified from the summary. Before we share the summary with SCALE, we will share it with you to make sure that what we’ve summarized fits with what you intended to say. If no one objects we’d like to record this focus group so that we won’t lose any detail of the discussion.

  • Start-Up/Campus Recruitment

  • What kinds of expectations are realistic and reasonable in terms of initial campus start up?

  • What barriers to recruitment of community partner(s) did campuses face?

  • What barriers to recruitment of tutors did campuses face?

  • Tutor Training:

  • What worked in terms of the initial tutor training SCALE did on your campuses?

  • How can this initial tutor training be improved?

  • What kinds of expectations are realistic and reasonable in terms of initial tutor training?

  • What ongoing training do tutors need?

  • What ongoing tutor training opportunities are being offered at campus sites?

  • How, if at all, is the tutoring manual being used during ongoing tutor training?


  • Login