Surveys and questionnaires l.jpg
This presentation is the property of its rightful owner.
Sponsored Links
1 / 18

Surveys and Questionnaires PowerPoint PPT Presentation


  • 67 Views
  • Uploaded on
  • Presentation posted in: General

Surveys and Questionnaires. M. Burns FCS 5470. A few fine points…. Survey (method) v. questionnaire (tool) Assumptions Can read Willing and able Will complete to the best of his/her ability Usability . Advantages Inexpensive & easy Large, diverse groups Familiarity Anonymous

Download Presentation

Surveys and Questionnaires

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Surveys and questionnaires l.jpg

Surveys and Questionnaires

M. Burns

FCS 5470


A few fine points l.jpg

A few fine points…

  • Survey (method) v. questionnaire (tool)

  • Assumptions

    • Can read

    • Willing and able

    • Will complete to the best of his/her ability

  • Usability

Russ-Eft & Preskill, 2001


Usability l.jpg

Advantages

Inexpensive & easy

Large, diverse groups

Familiarity

Anonymous

Quantitative

Disadvantages

Low response rate

Literate groups

Validity/reliability issues

Quantitative

Usability

Russ-Eft & Preskill, 2001


Types of surveys l.jpg

Types of Surveys

  • Post-course reaction forms

  • Behavioral or skill measures

  • Employee satisfaction

  • Knowledge tests

Russ-Eft & Preskill, 2001


Post course reaction surveys l.jpg

Post-course Reaction Surveys

  • Quality of instructional methods, facilities, materials, and instructors/facilitators

  • Many times poorly developed, thus limiting usability

  • Addresses what level in Kirkpatrick’s model?

Russ-Eft & Preskill, 2001


Post course reaction surveys do not measure l.jpg

Post-course reaction surveys do not measure…

Russ-Eft & Preskill, 2001


Behavioral or skill measures l.jpg

Behavioral or Skill Measures

  • Evaluates performance and change initiatives

  • Self-reported learning

  • May be used pre and/or post course or long-term post

  • Addresses what level in Kirkpatrick’s model?

Russ-Eft & Preskill, 2001


Employee satisfaction survey l.jpg

Employee Satisfaction Survey

  • Focuses on the impact that the intervention had on employee satisfaction

  • Commercially or self-developed

  • Administered pre and/or post course

  • Addresses what level in Kirkpatrick’s model?

Russ-Eft & Preskill, 2001


Knowledge test l.jpg

Knowledge Test

  • Evaluates learning, such as certification examination

  • Typically completed post-course, but could use the pre-course design

  • Example is RD exam

Russ-Eft & Preskill, 2001


Guidelines for constructing surveys l.jpg

Guidelines for Constructing Surveys

  • Anonymity and confidentiality

  • Determining question type

    • open-ended, fill-in-the-blank, dichotomous or two-choice question, multiple-choice, rating scales, and ranking

  • Question construction

Russ-Eft & Preskill, 2001


Factors to consider when determining question type l.jpg

Factors to consider when determining question type

  • Who will be answering the question?

  • How much time will respondents be able and willing to spend?

  • How many respondents will be involved?

  • How much is known about the range of possible answers?

Russ-Eft & Preskill, 2001


Question types l.jpg

Question Types

  • Open-ended

  • Fill-in-the-blank

  • Dichotomous

  • Multiple-choice

  • Rating

    • Likert, behaviorally anchored, behavior observation scale

  • Ranking

Russ-Eft & Preskill, 2001


Question construction l.jpg

Question Construction

  • Use understandable terms

    • No acronyms or double negatives

  • Avoid leading or loaded questions

    • Leads to biased responses

  • Avoid ‘double barreled’ questions

    • May only respond to one part

Russ-Eft & Preskill, 2001


Common errors of question items l.jpg

Common Errors of Question Items

  • Double barreled questions 78%

  • Leading/loaded questions36%

  • Already know answer21%

  • Use non-neutral wording17%

  • 1+ response categories17%

  • Not clear, concise, and simple17%

Lee, 1998


Format considerations l.jpg

Format Considerations

  • One-page – if not use attractive cover page

  • Colored paper – numbered pages and items

  • Letter of instructions/support/usability

  • Visual appearance

  • Grouping of questions

  • Clear directions at beginning and at different sections

  • NO Tipo’s

Russ-Eft & Preskill, 2001


Pilot testing l.jpg

Pilot Testing

  • Purpose is to identify any weaknesses that you may have overlooked

  • Time to take the survey

  • Do the questions asked really address your evaluation goals?

  • Measure of validity and reliability

Russ-Eft & Preskill, 2001


Logistics l.jpg

Logistics

  • Paper v email v online

  • List of ‘possibles’ or sampling frame

  • Timeline for data collection, analysis, and reporting

  • Cover letter

    • Purpose, uses, sponsors/approvals, signatures, directions, and due date

Russ-Eft & Preskill, 2001


Increasing response rate l.jpg

Increasing Response Rate

  • Importance of survey

  • Keep it short!

  • Personal touch

  • Appearance

  • Incentives

  • Deadlines

  • Follow-up procedures

Russ-Eft & Preskill, 2001


  • Login