E assessment acceptance usage 2005 2006
Download
1 / 17

e-Assessment Acceptance & Usage 2005-2006 - PowerPoint PPT Presentation


  • 73 Views
  • Uploaded on

e-Assessment Acceptance & Usage 2005-2006 . Geoff Chapman Thomson Prometric. Overview. The UK e-Assessment market Compare 2005 with 2006 Measure industry change in acceptance and usage Document new emergent issues. Methodology. Qualitative (face-to-face) interviews

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' e-Assessment Acceptance & Usage 2005-2006 ' - alair


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
E assessment acceptance usage 2005 2006

e-Assessment Acceptance & Usage 2005-2006

Geoff Chapman

Thomson Prometric


Overview
Overview

The UK e-Assessment market

Compare 2005 with 2006

Measure industry change in acceptance and usage

Document new emergent issues


Methodology
Methodology

Qualitative (face-to-face) interviews

Document key and emergent issues

Formulate quantitative study

Quantitative (telephone) interviews

Compare and contrast with 2005


The 2006 market position
The 2006 market position

  • 38% of ABs surveyed are delivering e-assessment in some form

  • 33% of the remaining 62% are developing or piloting

  • 70% believe e-Assessment will deliver a Return on Investment

  • 72% believe QCA vision of full implementation by 2009 is not achievable

    • 11% believe their entire program will be delivered through e-assessment


Industry issues
Industry issues

Candidate satisfaction

Candidate identity & eligibility authentication

Value of multiple-choice at higher levels of assessment

‘Test When Ready’ versus Fixed Testing Windows

Use of psychometrics in developing item banks & data management


Advantages of e assessment 2005 2006
Advantages of e-Assessment 2005-2006

Q. What are the three main advantages or benefits of using e-Assessment, in your opinion, overall?

Base: 87 (2005), 93 (2006)


Disadvantages of e assessment 2005 2006
Disadvantages of e-Assessment 2005-2006

Q. What are the three main disadvantages of using e-Assessment, in your opinion, overall?

Base: 87 (2005), 93 (2006)


E assessment risks 2005 2006
E-Assessment risks 2005 - 2006

Q. What risks do you associate with the introduction of e-Assessment, if any?

Base: 87 (2005), 93 (2006)


E assessment importance factors 2005 2006
E-Assessment Importance Factors 2005-2006

Q. On a scale of 1-10 where 10 is extremely important and 1 is not important at all, how important are each of the following factors to you in relation to e-Assessment?

Base: 87 (2005), 93 (2006)


Driving uptake 2005 2006
Driving Uptake 2005-2006

Q. Across the assessment industry, what do you believe to be the top three factors currently driving the uptake of e-Assessment?

Base: 87 (2005), 93 (2006)


Suitability of multiple choice higher learning
Suitability of Multiple Choice – higher learning

Responses from the remaining 48% are opposite

Q. Do you believe that MCQs are suitable for higher level learning?

52% of respondents believed that MCQ’s are suitable for use in higher level learning

Base: 93


Suitability of multiple choice high stakes exams
Suitability of Multiple Choice – high stakes exams

Q. Do you believe that MCQs are suitable for high stakes exams?

54% of respondents believed that MCQs are suitable for use in high stakes exams

Responses from the remaining 46% are opposite

Base: 93


Use of psychometrics
Use of Psychometrics

Q. What do you understand to be the implications or advantages of using psychometrics to develop exam questions?

Base: 93


Return on investment
Return on Investment

Q. If yes, when do you believe you will, or did you, see ROI?

Q. Do you believe that e-Assessment will deliver a Return on Investment?

Yes 70%

No 7%

Don’t know 23%

Base: 93

Base: 65


The future view from 2005 vs 2006
The Future – view from 2005 vs. 2006

Q. Approximately what percentage of your assessment programme do you realistically expect to be e-Assessment by 2009?

Base: 87 (2005), 93 (2006)


Summary
Summary

Acceptance & usage grown at a substantial rate since 2005

Strong confidence in e-Assessment being able to deliver ROI

MCQs suitability at higher levels more widely accepted

Emergent usage of psychometrics

Needs of candidates/learners remain at the forefront

Copies of the research are available on the Thomson Prometric stand or download at www.prometric.com/uk or http://tinyurl.com/fyhbt


Acceptance usage e assessment in 2006

Acceptance & Usage -e-Assessment in 2006

Geoff Chapman

Thomson Prometric

[email protected]


ad