1 / 9

Designing and Conducting Formative Evaluations

Designing and Conducting Formative Evaluations. April 7, 2008. FEs DO NOT… Evaluate learners’ ability to achieve performance objectives. Evaluate instructor delivery methods. Present a replica of what instruction will actually be like. FEs DO… Evaluate instructional materials.

marcie
Download Presentation

Designing and Conducting Formative Evaluations

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Designing and Conducting Formative Evaluations April 7, 2008

  2. FEs DO NOT… Evaluate learners’ ability to achieve performance objectives. Evaluate instructor delivery methods. Present a replica of what instruction will actually be like. FEs DO… Evaluate instructional materials. Generate feedback on methods of learner participation. Evaluate assessment instruments. Provide data that can shape instructional revision. How to Think About Formative Evaluations (FEs)

  3. Phases of FEs One-to-One (clinical) evaluations Small-Group evaluations (8-20 learners) Field Trial (real-world testing) FE Audiences Subject Matter Experts (SMEs) Learners Phases (and Audiences) of Formative Evaluations

  4. Developing FE Tools • Useful to frame FE tools using the instructional strategy developed in Phase 2. • Pre-Instructional Activities • Content Presentation/Examples • Learner Participation • Assessment • Follow-through Activities • Different audiences (i.e., SMEs, learners) require different tools

  5. Focusing FEs for SMEs • When developing criteria for SMEs to assess materials, consider: • Accuracy: Is the information/process/theory accurate? • Emphasis: Does the information emphasize the right components of the process? • Audience: Will the pretest measurements collect the necessary information we need about learners?

  6. Focusing FEs for Learners • When developing criteria for learners to assess materials, consider: • Clarity: Is the message/content clear to target learners? • Impact: What is the impact of the instruction on the learners’ attitudes? • Feasibility: How feasible is the instruction given the available resources?

  7. FE Data Collection Measures The following research tools can be used to collect data: • Interview (collected by designer) • Observations (collected by designer and/or manager/supervisor) • Sample Tests (completed by users) • User questionnaire (completed by users) • Others?

  8. Managing the FE Process • Identify and contact users who will be tested. • Identify major issues/components of instruction that you’d like feedback on. • Construct FE tools to use with SMEs and learners. • Conduct FE. • Review results for areas of similarities and differences. • Revise ID based on FE feedback.

  9. FOR WEDNESDAY Create one sample data collection tool that you plan to use with either your SME/learners.

More Related