Questionnaire Construction. Assessment Team November 6, 2007 PowerPoint by JD White and Joel H. Scott. When using a Questionnaire…. Think about the purpose of your assessment. Then, think about the data you want to collect.
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
November 6, 2007
PowerPoint by JD White and Joel H. Scott
This step likely started with your assessment plan.
Think about what, specifically, you want to know, why a questionnaire is appropriate, and what you want to do with the data.
Your purpose will assist in keeping you focused while developing your questionnaire.
This is a multi-step process and will include a great deal of brain storming.
Step 1: List all the questions/areas you might want to know
Step 3: Define these categories
Did you start to list the Seven Wonders of the World or did you just say “yes” or “no”?
The most appropriate answer would be either yes or no. Question wording matters because it will affect the data you will collect.
This step can be challenging because it asks us to rethink how we ask questions.
Questions have two distinct parts.
1. Question Wording
2. Response Format
Tip: Think about why you are asking a question and if you really need the information.
Open response formats don’t limit/influence responses, but they can create data management issues.
Closed response formats can limit/influence responses, but they provide some control.
Ordinal and Interval: Use the items to measure the intensity of attitudes or opinions and think about what scaling you should use (e.g., Likert, Uni-Dimensional, Semantic Differential).
To Neutral or Not to Neutral.
Think about how a respondent enters a response scale and how many decisions the person must make.
Pre-coding can save time with data entry.
There is more than one way to ask a question. Use a variety of question formats.
Were you satisfied with the quality of our services and programs?
Double Barrel: Ask only one question at a time
What brand of television do you own?
Too exclusive: What about other TVs?
What about the use of “Other”?
In the past two years, approximately how many times have you been to the gym?
A. 1-10 times
B. 11-20 times
C. 21-30 times
D. More than 30 times
Can you recall things from 2 years ago? What about the past two weeks?
Where did you grow up?
Confusing Response Options: What if I live on a farm?
Are you in favor of Proposition 13?
Assumptive Question: Does everyone know what Prop 13 is? Also, what if you “don’t know”?
What percent of your annual budget do you spend on advertising for student programs?
Too difficult: You don’t want your respondents to pull their hair out.
Don’t you think this administration is spending too much money in the Iraq war?
Leading Question: Be careful of sharing your agenda.
What income tax bracket do you report under to the IRS?
A. under 30,000
B. between 30,000-99,000
C. 100,000 to 500,000
Threatening question/Be careful of using abbreviated terms-spell them out!
1. Do you currently own a vehicle? If no, go to question 3.
2. How many miles do you drive on a daily basis? ______
Be careful of BRANCHING Q’s
How many miles do you drive on a daily basis?
A. none, I do not own a vehicle
B. 1-10 miles
C. 11-20 miles
D. 21 or more miles
What do you think about this report?
A. It’s the worst report I’ve read
B. It’s somewhere between the worst and best
C. It’s the best report I’ve read
Little variability in responses…How are you going to measure this?
Please respond to the degree you agree or disagree with the following statements.
I think this report is well written.
I think this report should be shared with everyone in the company.
I think this report has the potential to improve working conditions.