Evaluating cai lessons
This presentation is the property of its rightful owner.
Sponsored Links
1 / 24

Evaluating CAI Lessons PowerPoint PPT Presentation


  • 57 Views
  • Uploaded on
  • Presentation posted in: General

Evaluating CAI Lessons. Dr. Ennis-Cole CECS 5020. Lesson Objectives. Have the expected outcomes been realized ? Were the desired outcomes a result of the lesson ?. Purpose of Evaluation. 1. Confirmation of Decisions 2. Lesson Improvement

Download Presentation

Evaluating CAI Lessons

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Evaluating cai lessons

Evaluating CAI Lessons

Dr. Ennis-Cole

CECS 5020


Lesson objectives

Lesson Objectives

Have the expected outcomes been realized ?

Were the desired outcomes a result of the lesson ?


Purpose of evaluation

Purpose of Evaluation

1. Confirmation of Decisions

2. Lesson Improvement

“An ongoing process used to determine whether lesson objectives have been met, identify reasons for the observed performance, and identify areas of modification.” p. 299 Hanafin & Peck


Evaluation techniques

Evaluation Techniques

Informal - advice from experts, ideas from users, observations, interviews (simplistic- anecdotal data)

Formal - planned evaluation models, formal analysis, attitudinal questionnaires, data collection & collation (formal tabulation - empirical evidence)


Levels of evaluation

Levels of Evaluation

Formative

Summative


Levels of evaluation1

Levels of Evaluation

Formative - identification of lesson features that need modification -

ongoing process

lesson improvement is the goal


Levels of evaluation2

Levels of Evaluation

Summative - signature authority

not used for modification, used for purchase or adoption decisions


The formative evaluation

The Formative Evaluation

- - - - - - - - - -

Issues addressed:

Design Logic

Selection of Vocabulary

Clarity of Graphics & Branching Issues

Interrogation of Student/User Responses


Stages of formative evaluation

Stages of Formative Evaluation

  • 1. One-to-One:

    • Initial lesson design & development

    • Informal procedures

    • Identify potential problems

  • 1a. Assets of One-to-One Evaluations:

    • Insight gained before coding or implementation

    • Identification of problems

    • Expansion of lesson features or redirection


Stages of formative evaluations

Stages of Formative Evaluations

  • 2. Small-Group Evaluation:

    • Conducted at the lesson’s completion

    • Determines effectiveness

    • Collection & Interpretation of Student Performance Data

  • 2a. Assets of Small-Group Evaluations:

    • Use Informal techniques & data

    • Identify areas of improvement

    • Generalized results from small-group interaction


Stages of formative evaluations1

Stages of Formative Evaluations

  • 3. Field Testing:

    • Conducted in semi or actual settings

    • Occurs when lessons are “final quality”

    • Conducted to confirm lesson effectiveness

  • 3a. Assets of Field Testing:

    • “Real Life” Simulations of Lesson Use

    • Rely heavily on both formal and informal techniques

    • Minimal Changes can be made


Evaluating cai

Evaluating CAI

Instructional Adequacy Cosmetic Appeal

Program Adequacy

Curriculum Adequacy


Instructional adequacy

Instructional Adequacy

  • Directions

  • Content

  • Navigation

  • Text Presentation

  • Logical Organization


Instructional adequacy1

Instructional Adequacy

  • Does the lesson:

    • have good procedures and activities ?

    • amplify important terms & concepts ?

    • emphasize important sections & content ?

    • promote meaningful user interaction ?

    • match the learner with the appropriate learning task ?


Instructional adequacy2

Instructional Adequacy

  • Does the lesson:

    • stress retention & transfer ?

    • pace base on the learner’s characteristics ?

    • motivate the learner ?

    • correctly track and record learner performance ?

    • provide learner control ?


Cosmetic adequacy

Cosmetic Adequacy

  • Is the lesson:

    • appealing in a visual sense?

    • using technology effectively ?

    • presenting a consistent and cohesive picture ?

    • supporting learning via “special effects ?”

    • free from grammatical and mechanical errors ?

    • effectively communicating objectives, outcomes, and procedural information ?


Cosmetic adequacy1

Cosmetic Adequacy

  • Is the lesson:

    • well structured ?

    • presenting a psychologically safe learning environment ?

    • supporting the student’s learning ?


Program adequacy

Program Adequacy

  • Is the lesson:

    • free from conceptual loops ?

    • free from technical details ?

    • performing as intended ?

    • processing efficiently ?

    • secure ?

    • accurate ?

    • managing resources wisely ?


Curriculum adequacy

Curriculum Adequacy

  • Does the lesson:

    • relate to other lessons & activities ?

    • use consistent procedures ?

    • incorporate teacher & learner preferences ?

    • facilitate the development of other lessons ?

    • become obsolete quickly ?


Curriculum adequacy1

Curriculum Adequacy

  • Does the lesson:

    • match user expectations ?

    • augment or supplement the curriculum ?

    • permit completion within the allotted time ?

    • require “special” hardware or additional software ?

    • provide flexibility ?


Complete software evaluations

“Complete” Software Evaluations

  • Courseware Evaluation Form:

    • Background of the User

    • Lesson Description

    • Hardware Requirements

    • Evaluator’s Name & Date

    • Criteria Above-mentioned

    • Summary Recommendation


Web activity

“Web” Activity:

  • Search for:

    • Software Reports

    • PC Clearinghouse Software Directory

    • Educational Products Information Exchange (EPIE)

    • Swift’s Educational Software Directory


Web activity1

“Web” Activity:

  • What are the advantages of commercial software reviews ?

  • How can these be used ?

  • What did you find on the WWW ?


The end

The End

  • “That’s all folks.”


  • Login