How did the NSYSU College of Management assure students ’ learning outcomes

1. How did the NSYSU College of Management assure students’ learning outcomes San-Pui Lam Director, Learning Assurance Center (LAC) Chair, Institute of Public Affairs Management College of Management, NSYSU

2. Outline of presentation • The College’s learning goals for students • Resources from the university • Functions of the LAC • The Continuous Improvement Process • Efforts of the College and LAC

3. Our College’s learning goals for students • Ethics • organizational, work, research • Communication • writing, oral • Problem Solving • Global Vision • Professionalism

4. Resources from the University • Teaching Development and Resources Center • Faculty evaluation • Teaching awards • Alumni survey • Teaching survey

5. History of LAC • Started January 2009 • Received grant from University • 1,380,090 NTD (42,000 USD) in 2009 • Continual support

6. Functions of LAC • Assist the departments and institutes in assessing students’ learning effectiveness • Give recommendations based on the assessment results • Sponsor and organize activities for teaching improvement

7. The Continuous Improvement Process Learning goals/ objectives (The College) Assessment of learning(LAC and faculty) Discussions and decisions(College Executive Committee) Curriculum improvement (Curriculum Committee) Faculty development (Faculty Development Committee)

8. The Continuous Improvement ProcessCycle of Learning Goals Assessment

9. 評量方式 • 直接 • 入學時的篩選（selection) • 結合於課程的量測（course-embedded measures） • 課程外的測驗或表現要求（stand-alone testing or performance） • 間接 • 對學生、校友及校友雇主的調查

10. Efforts of the College and LAC(before 2010)Inquiry about the ways of assessment • 大部分之學習目標都是透過考試或是作業的方式來衡量

11. Efforts of the College and LAC(before 2010) • Exit survey and alumni survey • Stand-alone tests (pilot) • Suggested rubrics for course-embedded assessments • Improvement of faculty's teaching skills

12. Efforts of the College and LAC(before 2010) Exit survey • College exit survey, June 2009 • 385 students from BBA, MBA, IBMBA, and EMBA • Students agreed they had achieved their programs' goals (Appendix 4)

13. A sample of items in exit survey(BBA)

14. Efforts of the College and LAC(before 2010)College's alumni survey • 517 alumni who graduated between 2006 and 2008 responded • response rate = 25.4% • Most alumni agreed they attained the learning goals (Appendix 5)

15. A sample of items in alumni survey(EMBA)

16. Efforts of the College and LAC(before 2010)Stand-alone Testing • Pilot test, June 2009 • 4 domains: ethics, communication, problem-solving, and global vision • Satisfactory performance except the subdomain logical reasoning • LAC revised the tests and tried it on a larger sample (N = 90) in January 2010

17. A sample of items in stand-alone tests: critical thinking

18. A sample of items in stand-alone tests: work ethics

19. Efforts of the College and LAC(before 2010)Design suggested rubrics forcourse-embedded assessment • Ethics • organizational, work, research • Communication • writing, oral • Problem Solving • Global Vision

20. Course-embedded AssessmentSuggested rubrics: Writing as an example

21. Course-embedded AssessmentSuggested rubrics: Writing as an example

22. Course-embedded AssessmentSuggested rubrics: Writing as an example

23. Efforts of the College and LAC(before 2010)Improvement of teaching skills • Feedback to programs • Organize workshops or sponsor attendance • AACSB: 6 (2009) 2 (2008) • Harvard • 3 GCPCL (2009) 18 PCMPCL (before 2009) • College: 56 (2009)

24. 困難與挑戰 (一) • 溝通 • 課程外的測驗 、意義與作法 • 說服改變評量方式 • 從最簡單開始 • 調查 • 課程外測驗 • 課程內評量範例

25. 困難與挑戰 (二) • 如何衡量 • 倫理觀 • 國際觀 • 如何設定課程外測驗的難度 • 難度 vs. 信度 • 通過率的標竿訂定 • 如何讓評量結果落實到體制

26. 感謝聆聽，敬請指教