Jocelyn Milner ( jlmilner@wisc.edu ) Director of Academic Planning and Analysis

1. Essential Learning Outcomes And Post-Graduation Plans Jocelyn Milner (jlmilner@wisc.edu) Director of Academic Planning and Analysis Sara Lazenby (sllazenby@wisc.edu) Associate Policy and Planning Analyst Mo Noonan Bischof (mabischof@wisc.edu) Assistant Provost Aaron Brower (ambrower@wisc.edu) Vice Provost for Teaching and Learning UW System President’s Summit April 15, 2011

2. ELOs and Post-Grad Plans Before 2008 No institutional exit survey for bachelor’s degree recipients Why implement a survey? Voluntary System of Accountability question on post-graduation plans AAU Data Exchange Senior Exit Survey Higher Education Opportunity Act of 2008 Essential Learning Outcomes (adopted in 2008) Campus leaders asked for it (AAC)

3. ELOs and Post-Grad Plans Criteria • Stage 1. • Include the VSA question, AAUDE questions • Cost-effective and sustainable • Integrated into the student record • Potential for very high response rate • Reporting considerations – InfoAccess • Stage 2. • Need for indirect measure of ELOs

4. ELOs and Post-Grad Plans Have any of you solved this challenge? How did you do it? (5-7 minutes)

5. ELOs and Post-Grad Plans Many contributions to this project’s success: Questionnaire Development Voluntary System of Accountability AAU Data Exchange Senior Exit Survey Team NSSE John Ory, University of Illinois UW-Madison Convergence Team AACU’s LEAP UW-Madison Assessment Fund John Stevenson, UW Survey Center Jennifer Dykema, UW Survey Center Jeremy Beach, UW Survey Center Student participants in focus groups Technical Development and Implementation Michael Fay, DoIT James Helwig, DoIT Rob Lauer*, DoIT Wanjiru Pontes, DoIT Stephan Wahe, DoIT Bob Mayville, DoIT Betty McIlwee, DoIT Jim Steele, Registrar’s Office Kay Steiner, InfoAccess, DoIT

6. ELOs and Post-Grad Plans • Implementation * • Integrated into My UW student portal • Developer coded the questionnaire • Module is live from 10 days before the last day of the term until 20 days after the end of the term • Email notice goes to all graduating seniors on opening day • Module (annoyingly) stays live in student’s MyUW portal until student responds • Responses are saved in an ISIS/PeopleSoft bolt-on table • During the survey period, the data is extracted into an InfoAccess data warehouse table and refreshed nightly. This is available to anyone who also has access to the relevant tables *Clever solution! Thanks to all who noodled this out!

9. Subsequent questions on • - Work plans • - Schooling plans • - email address • “is there anything else you want to tell us?”

10. ELOs and Post-Grad Plans

11. http://www.provost.wisc.edu/content/WI_Exp_ELOs.pdf

12. ELOs and Post-Grad Plans University of Illinois-Urbana Champaign, 2010 Senior Exit Survey Excerpt

13. University of Illinois-Urbana Champaign, 2010 Senior Exit Survey Excerpt

14. ELOs and Post-Grad Plans • Question Development • Indirect measures of learning, student perceptions • ELOs, UI-UC, NSSE were all influences • UW Survey Center did review and pre- testing, including layout and syntax (~2 months, ~$2,000) • Added questions to the post-graduation plans survey in December 2010 and into the future

17. ELOs and Post-Grad Plans PIILOT RESULTS FOR ILLUSTATION ONLY – NOT FOR REFERENCE

18. ELOs and Post-Grad Plans • About using the data: • census fielding • fairly high response rates allows school/college and by major/program summaries • analysis delayed until October for May graduates

19. So far, it’s working! We involved a lot of creative people with a wide range of skills and experience. We took inspiration from our peers/competitors. We made use of our existing enterprise systems ISIS/PeopleSoft MyUW student portal InfoAccess (data warehouse) Census approach that has potential for high response rate. Cost-effective, sustainable collection and reporting system.