BUILDING A CULTURE OF ASSESSMENT AT ALBANY STATE UNIVERSITY

1. BUILDING A CULTURE OF ASSESSMENT AT ALBANY STATE UNIVERSITY Ian Sakura-Lemessy Ruth Salter Amitabh Singh

2. Workshop Goals • Explain and describe new assessment process and timeline • Illustrate key elements of new five-column reporting format • Describe and explain new web-based submission process • Detail key aspects of new assessment plan due September, 2008

3. What is Assessment? Academic Assessment is the systematic and ongoing method of gathering, analyzing and using information from measured outcomes to improve student learning. Academic assessment involves three tasks: • Identify student learning outcomes • Measure whether the department is achieving the student learning outcomes, and • Provide steps for improvement based on the results of data

4. What is Evaluation? Evaluation uses assessment information to support decisions on maintaining, changing, or discarding instructional or programmatic practices. These strategies can impact: • The nature and extent of learning or the provision of academic support services • Curricular decision making • Correspondence between learning and the aims and objectives of teaching and service provision • The relationship between learning and the environments in which learning takes place

5. Changes in ASU’s Assessment Reporting (2008-2010) • Converted from a one-year reporting cycle to a two-year cycle • Implementation of a new web-based submission format for all assessment reports • New five-column reporting format • Assessment activities coordinated by Dr. Ruth Salter and Mr. Amitabh Singh

6. New timeline • Summer, 2008 : Assessment workshops • September, 2008: Submit plans • September ‘08 - April ’09: Implement plans and provide mid-term results • August ’09 - April ‘10: Continue implementation • April 2010: Submit findings and changes to be implemented based on the findings

7. Assessment TimelineSeptember 2008 • Assessment plan must be submitted via ASU’s new electronic submission process in the five-column format that is available on ASU’s assessment website. • Be sure to use the form that applies to your academic or administrative unit. • You can also view a demo at the accreditation website that explains the online submission process in greater detail. URL: http://asu-sacs.asurams.edu/assessment.aspx

8. Elements of the Assessment Plan Department or Program Goals: • Each academic unit must submit an assessment plan with one major unit goal. • Each Administrative or educational support unit must submit two goals. Outcomes: • For each goal, all units must submit three objectives (student learning or administrative outcomes) for each goal. Means of Assessment: • Each academic unit must submit three means of assessment for each student learning outcomes. • Each administrative unit must submit at least one means of assessment for each objective.

9. Spring 2009 Each unit must submit an annual progress report indicating action steps toward closing the loop on the 2008-2010 assessment cycle.

10. Spring 2009 Describe and discuss the evaluation method (means of assessment) for each outcome. • Target Audience • Data Collection • Tools Used • Data Analysis

11. Spring 2009 Implementation of Assessment Describe who will be doing what and when they will be doing it. • data collection • analysis of data • writing the results • reporting them • making decision on results and in what time frame?

12. Spring 2009 This is also an opportunity to list your resource or research limitations, if there are any • Who is responsible for what? • Time Line: this time-line should demonstrate action steps taken in meeting critical tasks related to completing assessment report • Allocation of Resources • Data, technical support, surveys and other needs

13. Spring 2010 Full report documenting results of 2008-2010 two-year assessment plan submitted via the web-based submission process. The final report should include goals, objectives, expected outcomes and documentation of use of results (closing the loop). • What did the results of your assessment show? • What did you learn about the outcomes assessed? • What was your assessment plan not able to tell you? • Based on your results, what decisions were made about program, planning, policy and your assessment plan? • What was changed? What was kept? And how have they affected: Planning, Budgeting and Policy

14. WHO NEEDS TO COMPLY • All degree granting programs • All administrative and academic support units

15. Elements of the Nichols five-column Reporting Format • See Handout

16. Assessment Plan Due September 2008 • See Handout • Only three columns of the five-column format should be filled • Goal • Objectives • Means of assessment

17. How to develop goal statements • Must be linked to your unit’s mission and the overall mission of Albany State University • Must be general and broad

18. Goal or Objective? • Both are used to describe intended results of education activities • Both provide direction for assessment • What’s the difference: level of precision

19. Goals • Express results in general terms • Describe broad learning concepts like clear communication, problem solving, ethical awareness • Often come from the University’s mission statement

20. ASU’s mission The primary mission of Albany State University is to educate students to become outstanding contributors to society. Offering Bachelor's, Master's and Education Specialist degrees and a variety of non-degree educational programs, the University emphasizes the liberal arts as the foundation for all learning by exposing students to the humanities, fine arts, social sciences and the sciences. Global learning is fostered through a broad-based curriculum, diverse University activities and the expanding use of technology.

21. Sample goals from ASU’s mission The primary mission of Albany State University is to educate students to become outstanding contributors to society. Offering Bachelor's, Master's and Education Specialist degrees and a variety of non-degree educational programs, the University emphasizes the liberal arts as the foundation for all learning by exposing students to the humanities, fine arts, social sciences and the sciences. Global learning is fostered through a broad-based curriculum, diverse University activities and the expanding use of technology.

22. Sample Goals from the Mission Upon completion of the baccalaureate degree ASU graduates will: • Contribute to society • Apply a strong foundation in the liberal arts to work and life activities • Think globally • Use technology effectively

23. Objectives/Outcomes • Express results in specific terms • Describe specific behaviors students should exhibit • Always come from the faculty who teach and assess the program or staff who implement and assess the service

24. Elements of Expected Outcomes (Objectives) • Describe and outline expected outcomes in clear and concise language • Expected outcomes may include the following: • Intended Program Outcomes • Intended Process Outcomes • Intended Student Learning Outcomes • Intended Student Development Outcomes • Intended Faculty Development Outcomes • Intended Staff Development Outcomes

25. Blooms Taxonomy • Knowledge • Comprehension • Application • Analysis • Synthesis • Evaluation

26. Cite Define Describe Identify Indicate Know Label List Match Memorize Name Outline Recall Recognize Record Select Knowledge Verbs

27. Arrange Classify Convert Describe Defend Diagram Discuss Distinguish Estimate Explain Extend Generalize Infer Locate Outline Paraphrase Predict Restate Summarize Translate Comprehension Verbs

28. Apply Change Compute Construct Demonstrate Discover Dramatize Employ Illustrate Modify Organize Operate Practice Prepare Solve Use Schedule Manipulate Application Verbs

29. Analyze Appraise Break down Calculate Categorize Debate Determine Diagram Test Relate Differentiate Distinguish Examine Experiment Identify Infer Outline Question Select Solve Analysis Verbs

30. Arrange Assemble Collect Combine Compile Compose Construct Create Design Devise Explain Formulate Generate Perform Re-construct Revise Synthesis Verbs

31. Appraise Assess Choose Compare Conclude Contrast Evaluate Grade Rate Evaluation Verbs • Criticize • Decide • Relate • Revise • Score • Select • Summarize • Support • Value

32. Sample Outcomes/Objectives from the Goals Upon completion of ASU 1200 • 100% of the students will document completion of 120 hours of community service • 100% will communicate clearly in a 2 page written paper • 90% of the students will have a passport • 100% will use RamMail for course activities

33. Means of AssessmentAcademic units Academic units must submit three means of assessment for each student learning outcome (objectives) • One means of assessment must be a “direct” measure of evaluation • Require students to display their knowledge and skills as they respond to the instrument itself. • Examples: Objective tests, essays, presentations, and classroom assignments • One means of assessment may be “indirect” • Students reflect on their learning rather than to demonstrate it • Examples: Surveys, interviews and focus groups • The final means of assessment can either be a direct or indirect measure

34. Means of AssessmentSupport units Non-Academic units (support units) must submit at least one means of assessment for each learning outcome

35. RESOURCES • Assessment Workshops • Survey design and analysis assistance, data resources, and other support from IR&E • Resources available on the web

36. Your turn… • Questions? • Comments? • Suggestions?

37. Demonstration Amitabh Singh will demonstrate the submission process

38. Contacts Assessment Support: Ruth Salter, ACAD 383G ext. 3986 Technical Support: Amitabh Singh, President’s Building ext. 7845