effective implementation formative and summative project evaluation n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
Effective Implementation Formative and Summative Project Evaluation PowerPoint Presentation
Download Presentation
Effective Implementation Formative and Summative Project Evaluation

Loading in 2 Seconds...

play fullscreen
1 / 27

Effective Implementation Formative and Summative Project Evaluation - PowerPoint PPT Presentation


  • 175 Views
  • Uploaded on

Effective Implementation Formative and Summative Project Evaluation. When Bad things happen to Good projects!. Great ideas become ruined with bad implementations! Brad Wiley English teacher case-text Innovations get bad press with bad implementations! Failed “good ideas”.

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Effective Implementation Formative and Summative Project Evaluation' - odell


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
when bad things happen to good projects
When Bad things happen to Good projects!
  • Great ideas become ruined with bad implementations!
    • Brad Wiley English teacher case-text
  • Innovations get bad press with bad implementations!
  • Failed “good ideas”
role of implementation
Role of Implementation
  • Diffusion
  • Dissemination
  • Adoption
  • Stakeholders
adoption process
Adoption Process
  • Awareness
  • Interest
  • Evaluation
  • Trial
  • Full Adoption
  • Integration
adoption models
Adoption Models
  • Research based
  • CBAM--Concerns-Based Adoption Model
    • Focuses on the concerns of the users
      • Stages of Concern Questionnaire
      • Level of Use Questionnaire
implementation
Implementation
  • Role as a designer
    • Recommendations
    • Experiences
  • Role as a teacher/user/learner
    • Limitations
    • Experiences
assignment
Assignment
  • Using the case of Brad Wiley in Chapter 17, identify what principles of good implementation were ignored or violated and write a short implementation plan for Mr. Wiley’s project.
formative and summative evaluation of design
Formative and Summative Evaluation of Design
  • Assessments were used to determine student achievement
  • Evaluation of the design and the instructional materials is the current topic.
occurs at 2 times
Occurs at 2 times
  • Evaluation of the materials and processes for the purpose of revisions--Formative
  • Once materials and processes in place-they are evaluated in terms of their effectiveness-Summative
formative
Formative
  • Occurs during development of materials
  • Revisions are expected!
  • In business-skipped due to cost!
formative evaluation is especially important if
Formative evaluation is especially important if…
  • Designer is novice
  • Content is new
  • Technology is new
  • Audience is new
  • Designer new to ID
  • New or unfamiliar instructional strategy
  • Task performance is critical
  • Client expectations and later revision is not possible
formative review stages
Formative Review Stages
  • Design reviews--before development
  • Expert reviews--after development before use
  • Learner validation--during use
  • Ongoing evaluation--during use
design reviews
Design Reviews
  • Goal Review
  • Environment and Learner Analysis Review
  • Task Analysis Review
  • Assessment Specifications Review
expert reviews
Expert Reviews
  • Content experts
  • ID experts
  • Educational specialists
  • Teachers
  • Target audience specialist
one to one evaluation
One-to-One Evaluation
  • Tries materials with 2-3 members of target audience
  • Sits down one-to-one--observation and questions
    • Typos, unclear directions, bad examples, poor illustrations, bad URLs
small group evaluation
Small Group Evaluation
  • Uses more learners…usually after the one-to-one revisions were made.
  • Usually only observation, data gathered through charting
  • Survey after can be used with learners.
    • pg336
field trials
Field Trials
  • Determine effectiveness of revisions made after small group eval
  • Find problems with administration of materials in real life situations
  • Validate instruction with larger group to predict effectiveness
which stage of the formative evaluation procedure does each statement describe
Which stage of the formative evaluation procedure does each statement describe?

Teachers/trainers report the appropriateness of the documentation that accompanies a package of computer based instructional software..

which stage of the formative evaluation procedure does each statement describe1
Which stage of the formative evaluation procedure does each statement describe?

Experts in the content area for which a slide-tape set was developed review the materials for accuracy and currency.

which stage of the formative evaluation procedure does each statement describe2
Which stage of the formative evaluation procedure does each statement describe?

Individual students review the storyboards of an instructional videotape with the designer.

which stage of the formative evaluation procedure does each statement describe3
Which stage of the formative evaluation procedure does each statement describe?

At least 30 students go through the instruction.

which stage of the formative evaluation procedure does each statement describe4
Which stage of the formative evaluation procedure does each statement describe?

Designer only assists students when they encounter severe difficulties.

which stage of the formative evaluation procedure does each statement describe5
Which stage of the formative evaluation procedure does each statement describe?

Students read and think aloud as they interact with written instructional materials.

which stage of the formative evaluation procedure does each statement describe6
Which stage of the formative evaluation procedure does each statement describe?

Test materials are tried out with groups of individuals some of whom are “masters” of the content, some of whom are “nonmasters.”

which stage of the formative evaluation procedure does each statement describe7
Which stage of the formative evaluation procedure does each statement describe?

Data are collected regarding problems with the instructionafter the instruction is implemented in the target contexts.

summative evaluation
Summative Evaluation
  • Final evaluation of effectiveness of the design, materials and learning.
  • Usually will impact continued use
  • Determine goals of the evaluation--usually determined by client
group assignment
Group Assignment
  • Determine what formative evaluation process you could use with your instructional design.
  • Discuss and decide as a group
  • Complete Formative Evaluation Documents and submit to Cheryl by e-mail…one per group