Designing your own course assessments
This presentation is the property of its rightful owner.
Sponsored Links
1 / 21

Designing Your Own Course - Assessments PowerPoint PPT Presentation


  • 77 Views
  • Uploaded on
  • Presentation posted in: General

Designing Your Own Course - Assessments. Monica A. Devanas, Ph.D. Director, Faculty Development and Assessment Programs Center for Teaching Advancement and Assessment Research. Assessment. Three essential questions 1 ) What do we want our students to learn?

Download Presentation

Designing Your Own Course - Assessments

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Designing your own course assessments

Designing Your Own Course - Assessments

Monica A. Devanas, Ph.D.

Director, Faculty Development and Assessment Programs

Center for Teaching Advancement and Assessment Research


Assessment

Assessment

Three essential questions

1) What do we want our students to learn?

2) Are students learning what we want them to learn?

3) How can we modify our class so more students as possible are successful?


Assessment1

Assessment

Three essential questions

1) What do we want our students to learn?

2) Are students learning what we want them to learn?

3) How can we modify our class so more students as possible are successful?


What do we want our students to learn

What do we want our students to learn?

Learning Goals

University-wide

School-wide

Department mission and goals

Overarching goals – two or three

BIG ideas

Specific course goals


What are the practices in your department

What are the practices in your department?

  • What are your Department’s learning goals?

  • Are you teaching now?

  • What are your course goals?


What do we want our students to learn1

What do we want our students to learn?

Course Goals – Three Domains for Learning

  • Cognitive: What does the student know?

  • Performance/Skill: What can the student do?

  • Affective: What does the student care about?


Designing your own course assessments

Rutgers University

Mission

Goals

School of Arts and Science

Goals

Core Curriculum

Department

Goals

Course

Goals


Learning goals need to be specific

Learning Goals Need to be Specific

Goal: Students will “understand economics”


Learning goals need to be specific1

Learning Goals Need to be Specific

Goal: Students will “understand economics”

NOT “understand”

BUT: Define terms. Describe in context of discipline.

Test theoretical concepts with empirically.

Clearly identify a research problem.

Evaluate a particular circumstance or scenario.

Make falsifiable predictions based on evidence.

Summarize research findings into coherent.

Select tools for empirical use.

Model abstractly in a meaningful way.

Need to be “specific actions”


Designing your own course assessments

Bloom’s Taxonomy of the Cognitive Domain

=> Design

=> Recommend

=> Compare

=> Demonstrate

=> Interpret

=> Define

http://ww2.odu.edu/educ/roverbau/Bloom/blooms_taxonomy.htm


Are students learning what we want them to learn

Are students learning what we want them to learn?

Measureable Learning Goals

Determine - Knowledge, Skills, and/or Values

Decide – Through what activities will students “practice” and “learn”? i.e. Assignments

Assess = Measure = Collect Feedback


Assess measure collect feedback

Assess = Measure = Collect Feedback

Kinds of Assessment

Formative = Assessment for improvement

Summative = Assessment for grading (final)

Quantitative = methods using numbers, statistical analysis (surveys, tests, i.e. T/F, multiple choice)(What)

Qualitative = interpretive, not easily converted to numbers (essays, open-ended questions, observations)(Why)


Formative assessments

Formative Assessments

Classroom Assessment Techniques –

  • Angelo, Thomas A. and Cross, K. Patricia (1993). Classroom Assessment Techniques. Jossey- Bass.

    questioning, observation, discussion, concept test, concept map, self-assessments, practice, one-minute paper, summary, paraphrase, interviews, performance assessment


Scoring rubrics

Scoring Rubrics

Expectations for completeness and quality in assignments

  • Define criteria for task

    • Clarify with definition or example

  • Define rating scale for quality

    • Add descriptions of expectations for quality in each criterion


Summative assessment

Summative Assessment

  • Evaluate student learning at end of unit

  • Use standards or benchmarks for expectations

    • Tests

    • Projects

    • Major research paper

    • Senior project

    • Presentation

    • Performance


Multiple choice questions

Multiple Choice Questions

  • Stem – state problem

  • Alternatives – suggested solutions

    • Answer – correct solution

    • Distractor – incorrect solution

  • Analysis of Multiple Choice Questions


Multiple choice questions1

Multiple Choice Questions

Analysis of Multiple Choice Questions

  • Test Item Analysis

    • Difficulty - % students choosing correct answer

      • 90% = easy 40% = hard

    • Discrimination = effectiveness

      • student’s score on one question compared to total score

      • Range between -1.0 and +1.0

        Target = moderate difficulty, high discrimination


What are your proposed assessments

What are your proposed assessments?

  • Student Learning Goal or Objective

  • Knowledge, Skills, Values

  • Formative vs. Summative

  • Qualitative vs. Quantitative

  • Scoring Rubric


Student assessment of learning goals

Student Assessment of Learning Goals

  • “SALG”

  • Student self-assessment

  • Pre-course baseline, post-course assessment

  • Statistical analysis of class responses

  • Free, online, supported by National Science Foundation

  • http://salgsite.org

  • Elaine Seymore, Stephen Carroll


Assessment2

Assessment

Three essential questions

1) What do we want our students to learn?

2) Are students learning what we want them to learn?

3) How can we modify our class so more students as possible are successful?

Examine feedback from students, design changes for specific improvement, collect feedback, incorporate changes = SOTL =

Scholarship of Teaching and Learning

http://sotl.illinoisstate.edu

http://www.issotl.org/SOTL.html


Questions

Questions?

Thank you

[email protected]


  • Login