1 / 51

Leveraging AoL to Create Value

Misty Bennett, Assistant Dean, Central Michigan University Brandon Shields, Assessment and Accreditation Analyst, Kent State University. Leveraging AoL to Create Value. Our session will demonstrate how you can use AoL to…. Educate students on their performance Motivate students

strauch
Download Presentation

Leveraging AoL to Create Value

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Misty Bennett, Assistant Dean, Central Michigan University Brandon Shields, Assessment and Accreditation Analyst, Kent State University Leveraging AoL to Create Value

  2. Our session will demonstrate how you can use AoL to… • Educate students on their performance • Motivatestudents • Engagestudents in the AoL process • Engagefaculty in the AoL process • Savefacultytime • Finally, we will engage you as the audience in surveying where our schools are at in how we value AoL through several Kahoot questions.

  3. Kahoot! • Please download the Kahoot App on your mobile device to participate in today’s polling questions • When prompted, enter the Kahoot! ID: • 703430

  4. Communicating to students their role and individual performance in the Assurance of Learning Process Leveraging AoL to Create Value Brandon Shields, Assessment and Accreditation Analyst College of Business Administration Kent State University

  5. College of Business Administration AoL Scope 1 BBA (10 Majors) 3 MBA (FT, Online, Executive) 1 MSA 1MAE 1MSBA 1 Ph.D. (5 concentrations) 3,800+ students  85 FT Faculty 8 campus system *based on Fall 2018 data

  6. How do we as educators engage students in Assurance of Learning if... • They are unaware of their role in AoL • Results are not shared/meaningful • They do not take the assessments seriously

  7. Kahoot ID: 703430How aware are your students about the AoL process by the time they graduate? • Not aware at all • Slightly aware • Somewhat aware • Very aware

  8. Students have questions! What is Assurance of Learning? Why is AoL important? How do I benefit from AoL? Why should I try? How is this information used? What was my score? How did my peers do?

  9. Kahoot! At my institution, an administrator/faculty member specifically talks about AoL in how many classes? • 0 • 1 • 2 • 3 or more

  10. Communicating Value: From the Beginning 

  11. Kent State’s BBA Assessment Program • Junior Level  • Course:  • Advanced Professional Development • Learning Outcomes: • Oral Communication • Ethical Decision-Making  • Assessment: • Ethics Presentation • Performance Motivation: • Grade  • Senior Level • Course:  • Integrated Business Policies and Strategies • Learning Outcomes: • Overall Business Knowledge • Written Communication • Understanding Globalization • Assessment: • 70 Question MC Exam • Writing Case • Performance Motivation: • Bonus Points/Timing is critical

  12. Kahoot!How do you primarily motivate your students to perform their best on AoL assessments? • No mechanism for motivation • Bonus points • A grade • Setting a minimum retake score • Other

  13. How do we make the AoL process valuable for the College and Students?  • Focused on learning outcomes  • Focused on meeting targets • Looking for program strengths and weaknesses • Comparing results across time   • Focused on overall performance • Focused on individual score • Looking for individual strengths and weaknesses • Comparing results amongst peers

  14. Individualized Student Dashboard   • Looking for individual strengths and weaknesses​ • Assessments scored with rubrics show performance breakout • Focused on learning goals​ • Business Knowledge • Oral Communication  • Written Communication • Managing Ethical Dilemmas • Global Business Knowledge  • Focused on individual score​ • Students receive score for all assessments taken for the College • Comparing Results • Results show average score for college and for student major

  15. Kahoot!What do you think is most important to your students with regard to their AoL performance? • My students are not concerned with their AoL performance • Their individual performance overall • Identifying individual strengths and weaknesses • How they compare to their peers • How their program performed overall

  16. Individual Student Dashboard 

  17. How to create the Dashboard? Software needed: Micrsoft Word and Microsoft Excel • Get all assessment data into one spreadsheet. Use vlookup to bring data easily into one spreadsheet. • 2. Layout Dashboard on Word: • Create headings, write explanations. • Add any charts or visuals from excel. Numbers are dynamic but charts are not. • Keep spaces available for data that will change with each student: • Name  • Major • Scores • 3. Create a mail merge on Word and bring in data. • 4. Print

  18. Part of Template created before the mail merge Data from Excel through mail merge

  19. Kahoot!Do you think you could implement an individualized student dashboard? • No • Seems cool but I do not have the time • Maybe? I have more questions • Absolutely

  20. We have Answers! What is Assurance of Learning? Why is AoL important? How do I benefit from AoL? Why should I try? How is this information used? What was my score? How did my peers do?

  21. Leveraging AoL to Create Value for Faculty and Students Misty M. Bennett, Ph.D., Assistant Dean College of Business Administration Central Michigan University

  22. Kahoot!How aware are your faculty of your AoL process? Not at all; they think AoL is a reference to an early instant messaging system They have heard of it! Faculty reluctantly administer our assessments in their classes Faculty are involved in every step of the process

  23. How we ValueAssessment as a College:

  24. How we Value Assessment

  25. What does assessment mean to our students?

  26. What does assessment mean to our students?

  27. What does assessment mean to our faculty?

  28. What does assessment mean for assessment directors, analysts, or administrators?

  29. How do we create value for faculty, students, and the college???

  30. A Brief History…College of Business Administration at Central Michigan University

  31. Once upon a time…

  32. Step 2: Restructure! – Communicate and Coordinate

  33. Our Journey

  34. Kahoot!Which of the following is your biggest barrier to faculty participation in AoL? Not enough time Worried it might be used punitively Faculty aren’t knowledgable about AoL/assessment Faculty view it as service credit; not added value

  35. Creating Value for Faculty… Opportunities Assessment can save you time! Assessment won’t be used punitively (tenets), assessment counts for service, and names are redacted What can they use from your class in later classes or when they graduate? (training) Built research opportunities and teams Barriers Assessment takes time! Assessment data might be used against me! But I assess my own students already… Service won’t get you tenure

  36. Increasing AoL value for faculty… • Teaching resources • Communication - Newsletter • CBA AoL webpage: https://www.cmich.edu/colleges/cba/faculty/Pages/Assurance-of-Learning.aspx

  37. Increasing AoL value for faculty: rubrics • Faculty offered professional development funds to attend rubric creation session • Separate faculty group evaluated and revised rubrics • Faculty tested in courses and allowed to adapt them

  38. Increasing rewards/recognition for faculty • Service values increased through faculty participation • Offered rewards for tracking improvement activities • Giraffe Award

  39. From service to scholarship • Published case studies of process • Content analysis of department bylaws and procedures for “service” value • Rubrics for specific areas; e.g., technology • Hold open research hours on Fridays

  40. Increasing Value for Students • Communicating assessment results with students • Involving students in focus groups • Student advisory council • Celebrating assessment successes, assessment day

  41. We care aboutstudent learning! What are your CBA professors looking for? • Problem-solving Skills • Oral Communication & Presentation Skills • Written Communication Skills • Basic Business Knowledge • IT Skills

  42. Did You Know? Problem solving is assessed in your MGT 258 course. Problem Solving: Points of Pride

  43. Tip: Remember, only you think your solution is the best! Don’t forget to consider good alternatives and to explain why you wouldn’t choose them. Problem Solving: Areas for Improvement

  44. Did You Know? Oral communication is assessed using BIS 101 presentations. Oral Communication: Points of Pride

  45. Tip: Difficulty making eye contact?Try looking audience members between the eyes! (This creates an illusion of eye contact and is less stressful.) Oral Communication: Areas for Improvement

  46. Did You Know? Written communication is measured in MGT 258 and BUS 301. Written Communication: Points of Pride

  47. Tip: Readers quickly forget earlier information. Make sure to repeat the most important takeaways in the Conclusion section of your report! Written Communication: Areas for Improvement

  48. Kahoot!Do you involve students in the AoL process? Yes, they see their results and give feedback to make change Yes, they see their results Yes, they are involved in a minor way No students are not involved and don't see their results

More Related