Asking the Right Questions: Developing Effective Surveys. An evaluation capacity-building training from the Tobacco Control Evaluation Center by Robin Kipke & Travis Satterlund June 10, 2011. What We’ll Be Covering. 10:00 Introductions, take knowledge pre-test 10:40 End-use strategizing
An evaluation capacity-building training
from the Tobacco Control Evaluation Center
by Robin Kipke & Travis Satterlund
June 10, 2011
10:00 Introductions, take knowledge pre-test
10:40 End-use strategizing
11:35 Question types
11:50 Dillman principles for writing questions
12:15 Lunch break
1:15 Dillman continued
1:35 Writing Questions -- Practice
2:25 Survey sequencing & construction
3:00 Field testing surveys
3:10 Learning recap, setting action plans
3:20 Complete exit survey
3:30 Optional consultation with TCEC associates
Participants can explain and apply these concepts:
Begins with an introduction
Needs to capture respondent’s interest
Starts with easy-to-answer ?s, builds to more substantial
Follows logical order, uses transitions to change topic
Finds a delicate way to raise sensitive issues
Winds down with less consequential subject
Indicates end with a sign offA survey is like a conversation in that…
Photo by Robert Thivierge
Source: Youth Media Evaluation Toolkit 2005
To inform your project about
Apply process to evaluation planning and development of data collection instruments
Try it out – pair activity
Think of the project you work on and how a survey could inform your efforts
Discuss with your team what you might want a survey to tell you, how it could be used
Work together to fill in each of the boxes of the End-use Strategizing worksheet
Zero (Studio) One Two Three
___ Health care
___ Environmental protection
___ Safe neighborhoods
___ Quality of education
___ Fair wages
“Survey design is all about motivating people adequately so they complete the cognitive steps necessary for answering questions accurately and return the questionnaire.”
~ Don Dillman
Don A. Dillman. 2007. Mail and Internet Surveys: The Tailored Design Method, 2nd ed. Hoboken, NJ: John Wiley & Sons.
To what extent do you agree or disagree with the statement “Smokers have a right to smoke”?
Local lead agency Service organization
Law enforcement Educational institution
Other ____________ I don’t represent an organization
Ok for list
When you have watched movies where actorswere smoking, did it make smoking seem more appealing to you?
Think about the last three movies you saw.
1. What type of movies were they? (mark all that apply)
Action Comedy Drama Documentary
2.In any of those movies, did any of the characters smoke?
No (go to question 4)
3. Did seeing the characters smoking make cigarettes seem more appealing to you?
How old are you?
15-18 yrs. old 18-30 yrs. old 30-50 yrs. old 50+ yrs. old
When you tried to quit, where did you turn to for help? my doctor support group
online service quitline
clinic or hospital on my own
In the last year, how many tenants complained about drifting tobacco smoke?
How long have you lived in this apartment?
In which areas of the apartment complex should people not be able to smoke?
v1 Which areas of the apartment complex would you like to be non-smoking?
v2 In which areas of the apartment complex should smoking be prohibited?
Is either of these double-barreled?
Write one question using each of these formats:
START ❶ Circle the response