Survey Research. Considerations of Survey Research. Surveys produce close estimates of what people think or do (at best) More accurate surveys would involve Every member of population having equal chance of being selected Coverage error
Require least amount of resources
Minimize sampling error at low cost
Provides more anonymity
Sensitivity to coverage error
Can produce most nonresponses
Researcher lacks control over process
Avoids pitfalls of other methods (i.e., reading, no phone)
Need good interviewers
Produces results quickly
Greater interviewer control
Exclusion of individuals, particularly certain populations
Sample challenged by incomplete information
Need knowledgeable interviewersConsiderations of Survey Research
Keep survey brief and concise
Place confidential or personal information at the end of the survey
Have response categories in progressive order (lowest to highest)
Write an introduction to the survey
Use filtering questions
Divide surveys into sections
Use a convention similar to paper surveys
Provide adequate instructions
Pay close attention to physical layout
Don’t (i.e. avoid):
Use open-ended questions
Have the response category of “other”
Use response scale proliferation (i.e. 6 or 7 point scale)
Ask respondents to rank responses
Design long (excessive) surveys
Overuse “fancy” featuresThings to consider with web surveys
Bradley, R. V., & Sankar, C. S. (n.d.). Outcomes assessment: Electronic surveys versus paper-based surveys. ASEE Southeast Section Conference.
Carini, R. M., Hayek, J. C., Kuh, G. D., Kennedy, J. M., & Ouimet, J. A. (2003). College student responses to web and paper surveys: Does mode matter? Research in Higher Education, 44, 1-19.
Chatman, S. (2002). Going beyond the conversion of paper survey forms to web surveys. Student Affairs Online, 3. Retrieved November 21, 2005, from http://www.studentaffairs.com/ejournal/Winter_2002/surveys.html.
Dillman, D. A., Tortora, R. D., Conradt, J., Bowker, D. (n.d). Influence of plain vs. fancy design on response rates for web surveys.
Gunn, H. (2002). Web-based surveys: Changing the survey process. First Monday, 7(12). Retrieved November 21, 2005, from http://www.firstmonday.org/issue7_12/gunn/.
Salant, P., & Dillman, D. A. (1994). How to conduct your own survey. John Wiley & Sons, Inc: New York.
Smither, J. W., Walker, A. G., & Yap, M. K. T. (2004). An examination of the equivalence of web-based versus paper-and-pencil upward feedback ratings: rater-and ratee-level analyses. Educational and Psychological Measurement, 64, 40-61.
Solomon, D. J. (2001). Conducting web-based surveys. Eric Digest. Retrieved November 21, 2005, from http://www.ericdigests.org/2002-2/surveys.htm