ASSESSMENT@AU Helping Your Department Advance and Implement Effective Assessment Plans

1. ASSESSMENT@AUHelping Your Department Advance and Implement Effective Assessment Plans Presented by: Karen Froslid Jones Director, Institutional Research and Assessment And Woubet Kassa Graduate Assistant Co-sponsored by the Committee on Learning Assessment (COLA)

2. Our Expected Outcomes Today As a result of participating in this workshop participants will be able to: • Describe the assessment process and identify why it is so important to AU’s success. • Read their department’s assessment plans and know how to identify actions that the department needs to take this spring in order to implement the plan. • Gain insights into how staff can help with the assessment process, including how to organize data collection, report findings, and upload supporting documents. • Learn the basics of how to use “TracDat”, AU’s Assessment Software

3. What is Assessment? “Assessment is an ongoing process aimed at understanding and improving student learning.”

4. What is Assessment? It involves: • making our expectations explicit and public; • setting high standards for learning quality; • systematically gathering, analyzing, and interpreting evidence to determine how well performance matches those standards; • using the resulting information to document, explain, and improve performance. “…Assessment can help us focus our collective attention, examine our assumptions, and create a shared academic culture dedicated to assuring and improving the quality of higher education.” AAHE Bulletin, November 1995, p. 7.

5. The Program Assessment Process FACULTY The “Assessment Plan”

6. Why Assess? • Create a shared vision for the goals of the major; • Know whether students are learning what we want them to learn; • Identify ‘best practices’ in instruction; • Focus efforts on curriculum issues that are most important to us; • Provide evidence for why additional resources are needed; • Demonstrate to students, perspective students and others the value of majoring in our discipline; • Meet accreditation requirements, which focus on accountability; and • Ensure that decisions about programs are in the hands of the faculty. IMPROVE STUDENT SUCCESS

7. What Assessment is Not • Used to evaluate faculty or the program • Something only done for accreditation purposes • Something ‘extra’ or outside the regular processes used to develop and improve curriculum

8. Assessment puts the focus on Learning!

9. Setting Learning Outcomes • Faculty have identified the learning outcomes students should gain as a result of graduating in each of your department’s majors. • Accreditors also expect learning outcomes to be articulated at the course level. These expected outcomes should be on syllabi.

10. “Mapping” program outcomes to individual courses • Where are students getting the opportunity to learn what we want them to learn? • This is not something that departments have been asked to do but it is considered “best practice”. • TracDat enables departments to do this should they like to do so.

11. Ways to Assess • Direct vs. Indirect Measures of Assessment • Direct – Tangible, visible evidence of learning, often reflected in examples of student work. • Indirect – Proxies of student learning. This might include evidence that is less clear than an evaluation of student work. For example, methods that solicit student opinion on whether they learned. • Qualitative vs. Quantitative Measures • Quantitative – Measures that can be put into numbers and analyzed. • Qualitative – Measures that can be reflective and usually non-numeric. Used to look for themes and for identifying the “why” behind quantitative results (so usually helpful in identifying recommendations for improvement.)

12. What are some specific ways that programs assess student learning? • Indirect • Surveys • Focus groups • Direct • Review of Student Papers • Quizzes or Exams • Student Presentations

13. Overall:When done right assessment… • Engages the entire faculty • Engages students • Is tied to other curriculum improvement processes already in place • Is planned and organized • Is useful

14. What does an assessment plan look like? • The case of underwater basket weaving! • Your department’s assessment plans. • Reporting: • Departments submit updates to the Senate Committee on Learning Assessment each October.

15. Six Suggestions for How Department Staff Can Help Contribute to Successful Assessment

16. 1. Communicating Learning Outcomes and Assessment Plan • Can you help ensure that all faculty and students know what the learning outcomes are for their program? • Is the website a good spot? Do you have an email listserv/news letter? • Can you help track whether or not courselearning outcomes are on the syllabi? (A Middle States Accreditation Requirement) • Does your department have an interest in mapping how your courses link to the overall program outcomes?

17. 2. Keeping Track of Assessment Schedule • What activities are planned for this spring? • How can you help remind faculty about the assessment schedule? • Does schedule need to be clarified in TracDat?

18. 3. Organizing for Assessment • What faculty need to get together to plan the assessment? • Can you help plan a faculty meeting? • Direct Measures: How can you help collect, store and distribute examples of student work?

19. Nuts & Bolts of Collecting Student Work • Sampling • What a “representative” sample means • Make sampling easy for faculty. (A certain number from each section then every other student by id, every third student, etc.) • Make submission of examples easy • Find out if faculty require (or could require) electronic submission of papers • Can you run over and pick up the examples, copy them, then return them right away? • Removing identifying information

20. Nuts & Bolts of Surveys • Can you help identify who should get the survey? • Typically seniors • Can you help distribute survey? • Zoomerang.com and surveymonkey.com • Can be used for distribution and for data entry!

21. 4. Summarizing Results • Can you help make copies of the evaluation sheet or rubric that faculty will use to review student work? • Can you help summarize the results of a rubric or survey? Add up the responses and put it in one report? • The importance of linking questions with specific learning outcomes.

22. 5. Reporting Results • Can you help share the findings with the department? Can you add findings into TracDat? • Is it appropriate to print out the latest report for faculty once the results are in TracDat? • Can you help ensure that the supporting documentation is added to TracDat? • Can you collect these examples?

23. 6. Keeping Track of ‘Best Practices’ in the Field • Can you help you department find examples of assessment plans from other institutions? • Does the disciplinary association provide guidance? • Can you help find resources in the library or elsewhere to help with the assessment efforts?

24. Resources • Assessment website: http://www.american.edu/provost/oira/assessment • Library reference material • CTRL – training on learning outcomes on syllabi • OIRA (Office of Institutional Research and Assessment) • Discipline/professional organizations

25. Staff in Action! • Basket weaving example: • What would you put on the ‘to do’ list to help your department organize for assessment this spring? In what ways might you be able to help? • What are some other things you might be able to do to help?

26. The Nuts and Bolts of ‘TracDat’ • TracDat is the system AU uses to report its assessment plans, organize documents related to assessments, and document results. • Plans are organized around the major. • You have been given access to TracDat but ask your department chair for permission before entering or changing anything in your plans.

27. Next Steps • Have a conversation with your department chair: • Review the six suggestions. How do you think you can contribute? • What role does your department chair want you to play? • What are your short term (before end of semester), medium term (before October) and longer term goals?

28. QUESTIONS? Karen Froslid Jones kfroslid@american.edu X6155 Woubet Kassa wk0423a@student.american.edu>