Annemieke Rice Assessment Consultant StudentVoice

1. StudentVoice Fundamentals Training Annemieke Rice Assessment Consultant StudentVoice

2. About StudentVoice • Designed for higher education • Alliances with professional organizations • Growing network of member campuses

3. Member Campus Network Bemidji State University Binghamton University Bloomsburg University Brock University Cal Poly Pomona California State University, Chico California State University, Dominguez Hills California State University, Monterey Bay California State University, Northridge California State University, Pomona California State University, Sacramento Canisius College Carleton College Case Western Reserve University Catholic University of America Central Washington University College of Southern Nevada Colorado State University East Carolina University East Stroudsburg University Eckerd College Erie Community College Florida Gulf Coast University Florida International University – Career Center Fordham University George Mason University Gonzaga University Hofstra University Idaho State University Illinois State University Indiana University of Pennsylvania Kent State Kutztown University Long Beach City College Long Island University Loyola University Chicago McMaster University University of Georgia (Career Center) University of Kansas University of Miami University of Michigan, Ann Arbor University of Missouri, Columbia University of New Mexico University of North Carolina, Charlotte University of North Carolina, Pembroke University of North Carolina, Wilmington University of North Dakota University of Oklahoma University of Oregon University of Richmond University of San Diego University of South Carolina University of Tennessee – KnoxvilleUniversity of Texas at Arlington University of Texas at Austin University of Toronto University of Toronto at Scarborough University of Utah University of Wisconsin Madison University of Wisconsin Milwaukee University of Wyoming Villanova University Virginia Commonwealth University Virginia Polytechnic University Washington University in St. Louis Wayne State University Weber State University West Virginia University Western Kentucky University Western Oregon University William Paterson University Wright State University York University As of January 2009 Metro State University of Denver Michigan Technical University Michigan State University Morgan State North Dakota State University Northeastern University Northwestern University Ohio State University Ohio University Oklahoma State University Oregon State University Pratt Institute Prince George's Community College Purdue University, Calumet Queen’s University Regis University Saint Cloud State University Saint Joseph's University Saint Louis Community College Saint Louis University Salt Lake Community College Sam Houston State University San Diego State University Seattle University Slippery Rock University Southern Illinois University, Carbondale SUNY Fredonia SUNY Oswego Texas A&M University Kingsville Towson University Tulane University University of Alaska, Anchorage University of Arizona University of Arkansas University of Buffalo University of Calgary University of Colorado, Boulder

4. Types of Assessment • Tracking/usage • Needs and gap analysis • Satisfaction/importance • Outcomes • Environmental and campus climate • Program and policy evaluation • Benchmarking/peer institution comparisons

5. Populations to Assess • Students • Staff/administrators • Faculty • Employers Community members Alumni Other constituents

6. StudentVoice Features and Support • Consultation from an assessment expert • Remote training and professional development workshops • Access to assessment resources and template projects • Open participation in all benchmarking studies • Web-based data collection • PDAs for onsite data collection • Upload existing data • Online reporting

7. Consultation At any point during the process, experienced StudentVoice professionals can provide assistance. • Define measurable outcomes based on goals and objectives • Survey design • Exposure to best practice • Assistance with launching studies • Gauging response rates • Full technical support • Reacting to data • Using analysis tools • Incorporating data into reports and presentations Preparation Administration Analysis

8. Professional Development • Webinar Series: • Designing an Assessment Project • Learning Outcomes • Survey Design • Methods and Measurements • Building a Culture of Assessment • Reporting and Statistics • Survey Fatigue • …and more! www.studentvoice.com/training

9. Community Features • Shared Projects - example assessment projects • Resource Centers - department specific resources • Wiki - easy access to assessment information • Forums - discussion boards • Blogs - posts from assessment experts • …and more to come!

10. StudentVoice Benchmarking • Orientation Outcomes • Campus Recreation Impact • Leadership Development • Career Services/Graduating Students • Campus Activities • Diversity/Inclusion/Climate • Campus Safety/Student Conduct • Profile of Today's College Student • https://www.studentvoice.com/app/views/about/partnerships/consortium.aspx

11. Benchmarking Reports

12. Project Process • Design an assessment study • Existing survey • Template or shared project • In consultation with a StudentVoice staff member • Submit project request form in the portal • StudentVoice prepares the study for PDA, web, or upload • Institution previews and approves study • Study is administered • Data is available in real time for web assessments and after hot syncing for PDA assessments

13. Data Collection: Web • Send an e-mail invitation with a link to the project. • Post the project onto a website. • Data is automatically updated when completed.

14. Web-based Survey Functionality • Open-ended responses • Branching /skips • Required vs. optional responses • Min and max responses (select one or select all) • Ranking • Autosum • Looping • Customizable appearance (logos and colors) • Customizable finish page • Graphic integration • Collecting identifying information/authentication • ADA compliant

15. What makes for a ‘good’ question? • Clearly understood • Short (both the question and the answer choices) • Asking only one question per question • Make all definitions, assumptions, and qualifiers clear • Avoid making significant memory demands • Avoid asking for very precise responses, as well as very broad generalizations • Avoid biased, loaded, leading questions • Avoid questions that people are uncomfortable answering honestly • Let people admit they don’t know or can’t remember

16. Web Survey Practices • Possible ways of motivating respondents to continue: • Make it relevant to the respondent • Keep design simple • Make directions clear • Include questions on the first page • Watch length and type of questions • Break the survey up into multiple pages • Utilize a progress tool • Utilize skip patterns so that respondents do not have to see questions that do not apply to them

17. Contact/Invitation Checklist • Should convey the importance of the study • Should include a request for help • Should guarantee confidentiality (as appropriate) • Should provide information on how long it will take to complete the survey • Should indicate the time period for which the survey will be accepting responses (set deadline) • Include information on incentives • Come from a recognizable and credible entity

18. Survey Basics: Response Rate • Develop a sampling strategy so each student gets asked to participate in only a certain percentage of surveys • Send a prenotification e-mail • Send reminders • Consider smaller incentives with higher chances of winning (give out three $10 gift cards instead of one $30) as well as immediate incentives, which have shown to be more effective • Incentives may be especially important in longitudinal studies • Create a culture of sharing results with students; over time they will see the value in thoughtful responses • Follow-up email sharing some findings • Cite assessment results in publicizing new programs/decisions

19. Data Collection: PDA • Randomly approach students at busy campus locations. • Position PDAs at points of service. • Use multiple PDAs after a campus event or program.

20. PDA Survey Functionality • Palm: • Multiple choice questions • Limited open ended entry • Skips/branching • Optional vs. required • Min and max responses • iPod touch: • Coming soon!

21. Administering PDA surveys • Avoid bias • Don’t get one specific age • group, ethnicity, or gender, • unless that is your sampling • method • Can read questions to those with visual disabilities • The wider the array of participants the more the results will vary and become more accurate • Keep privacy/sensitivity in mind when selecting content and location

22. Data Collection: Upload • Paper Forms • Collect data with paper and pencil • Manually enter data into web or PDA survey • Projects Outside of StudentVoice • Incorporate reports from: • NSSE • CIRP • Other studies • Import data files: • Student demographics • Past survey data • Upload reports from non-survey methodologies

23. Online Reporting • Frequency tables • Graphs • Basic statistics (mean, median, mode, standard deviation,…) • Filters • Save views • Export report view to • Word, PDF or Excel • Export raw data to Excel • or text file

24. Online Portal Demonstration • Project Request • Project Listing • Project Dashboard • Mass Mailing • Results • Shared Projects • Resource Centers • User Guide • PDA Support • Training

25. Questions? • Check out the User Guide • (Login and click on Help  User Guide) • Contact your Assessment Consultant • 716-652-9400 • Annemieke Rice • Assessment Consultant • StudentVoice • arice@studentvoice.com