Developing assessment plans
Download
1 / 32

Developing Assessment Plans - PowerPoint PPT Presentation


  • 153 Views
  • Uploaded on

Developing Assessment Plans. Mi-Suk Shim, Ph.D Spring 2006 DIIA. Outline of Workshop. Review of previous workshop Assessment methods overview & resources Syllabus, exam, & assignment analysis for each course Assessment map, matrix, & assessment plan at program level. SACS Criteria.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' Developing Assessment Plans' - geoffrey-mcclain


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Developing assessment plans

Developing Assessment Plans

Mi-Suk Shim, Ph.D

Spring 2006

DIIA


Outline of workshop
Outline of Workshop

  • Review of previous workshop

  • Assessment methods overview & resources

  • Syllabus, exam, & assignment analysis for each course

  • Assessment map, matrix, & assessment plan at program level


Sacs criteria
SACS Criteria

CS 3.3.1 Institutional Effectiveness

The institutionidentifies expected outcomes for its educational programsand its administrative and educational support services;

assesses whether it achieves these outcomes;

andprovides evidence of improvement based on analysis of those results


Ut schedule
UT SCHEDULE

  • Program Educational Objectives and Program Outcomes

    • Complete by end of Spring 2006 and document

  • Assessment Plan

    • Complete by end of Spring 2006 and document

  • Progress Toward Completion of One Assessment Cycle and Closing the Loop

    • Complete documentation by Spring Break 2007


Learning outcomes
Learning Outcomes

  • statements that describe what students are expected to know, think, and be able to doby the time of graduation


Learning outcomes1
Learning Outcomes

Students will

DO WHAT (how)



Assessment plan
Assessment Plan

University of Texas at Austin

Academic Unit Assessment Plans Format (tentative version)

I. School and Degree Program

School Name and College:

Degrees awarded:

Contact person:

Date:

II. Program Mission Statement

III. Program Educational Objectives

IV. Program Learning Outcomes

V. Strategies, Methods, and Level of Competence

VI. Implementation Plan

VII. Assessment of Results

VIII. Evaluation of Results

IX. Recommendations

X. Actions


Assessment methods
Assessment Methods

  • Multiple methods & sources recommended

    (increase validity)

  • One method does NOT fit ALL (each has pros & cons)

  • Practicality? Time, effort, money

  • Do not have to measure everything or everybody (sampling)

  • Capitalize on what you are already doing

  • Quantity of data does not equate to Quality


Direct vs indirect
Direct vs. indirect

  • Direct measures: Assess student knowledge or skills, that is student learning outcomes

  • Indirect measures: Assess students’ learning experiences or perceptions of their learning


Inventory of assessment methods

Direct (Required)

Class Assignments

(paper, presentation, report…)

Capstone Project

Performance Project

Direct Observation

Portfolios

External examiner

Standardized exam

Locally developed exam

Certification and licensure exams

Simulations

Theses/Senior papers

Indirect (Supplemental)

Surveys

Student survey

Alumni survey

Employer survey

National survey

Interview

Focus group

Case study

Inventory of assessment methods


Guiding questions for methods
Guiding Questions for Methods

Does the method……

  • Measure your learning outcomes?

  • Measure your learning outcomes accurately?

  • Provide useful information (implications for educational evaluation and improvement)?

    If you answered YES to all of the above, it can be used to demonstrate Institutional Effectiveness


Level of competence
Level of competence

  • Your decision

  • What do you consider a success?

    Example:

    90% of students will meet “acceptable” level of competence using a rubric


Resources
Resources

  • UT SACS website

    https://www.utexas.edu/provost/planning/assessment/sacs/resources.html

  • Gloria Roger’s materials from October workshop (handouts)

  • DIIA Instructional Assessment Resources (IAR) Website

    http://www.utexas.edu/academic/diia/assessment/iar/how_to/methods/index.php


Where to start
Where to start?

  • Course related:

    • Course descriptions

    • Syllabi

    • Course objectives

    • Course assignments

    • Course exams

  • Other activities:

    • Student exit survey

    • Alumni survey

    • Employer survey

    • National Standardized Exams

      **Key is to “Make use of existing sources”


What can individual faculty do
What can individual faculty do?

  • Syllabus analysis

  • Exam analysis

  • Assignment analysis

  • For more detailed information;

    http://www.utexas.edu/academic/mec/research/workshopsummary.html


Syllabus analysis
Syllabus analysis

  • Identify course objectives

  • Document those objectives in a table

  • Faculty complete table for each of their courses



Exam analysis
Exam analysis

  • Identify test items that match course objectives

  • Calculate overall student performance for each item

  • Calculate the average performance for items assessing same objective

  • Determine the level of competence



Assignment analysis
Assignment analysis

  • Identify assignment components that match course objectives

  • Assess student performance for each component

  • Determine the level of competence

  • Using rubrics



Rubrics
Rubrics

  • Scoring guidelines

  • A set of categories which describe the important components of the work assessed.


Rubrics1
Rubrics

  • Scale

  • Descriptors

    Criteria (with indicators)---Things to look for

    Standard --- Description of degree of each level

  • Type

    Holistic

    Analytic


Resources for rubrics
Resources for Rubrics

  • Sample handouts from Relearning by Design Inc.

    http://www.relearning.org/resources/PDF/rubric_sampler.pdf

  • DIIA workshop material http://www.utexas.edu/academic/mec/research/pdf/rubricshandout.pdf





Where when who
Where when who

  • Where --- context for assessment (sample)

  • When --- time of data collection

  • Who ---responsible person

    --- who interprets results?


Results recommendation action
Results/Recommendation/Action

  • State in future tense

  • What do you expect as results?



Further assistance
Further assistance

  • Dr. Neal Armstrong

    Vice Provost for Faculty Affairs

    Office: MAI 201

    Email: neal_armstrong@mail.utexas.edu

    Phone: (512) 232-3305; (512) 471-4716


ad