Chapter 12 13 evaluation decide framework l.jpg
This presentation is the property of its rightful owner.
Sponsored Links
1 / 18

Chapter 12/13: Evaluation/Decide Framework PowerPoint PPT Presentation


  • 227 Views
  • Updated On :
  • Presentation posted in: General

Chapter 12/13: Evaluation/Decide Framework. Why Evaluate?. Why: to check that users can use the product and that they like it. Designers need to check that they understand users’ requirements. Avoid wasting money. What to Evaluate.

Download Presentation

Chapter 12/13: Evaluation/Decide Framework

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Chapter 12 13 evaluation decide framework l.jpg

Chapter 12/13: Evaluation/Decide Framework


Why evaluate l.jpg

Why Evaluate?

  • Why: to check that users can use the product and that they like it.

  • Designers need to check that they understand users’ requirements.

  • Avoid wasting money


What to evaluate l.jpg

What to Evaluate

  • What: a conceptual model, early prototypes of a new system and later, more complete prototypes.


Where to evaluate l.jpg

Where to Evaluate

  • Where: in natural and laboratory settings.


When to evaluate l.jpg

When to Evaluate

  • When: throughout design; finished products can be evaluated to collect information to inform new products.


The language of evaluation l.jpg

Analytical evaluation

Controlled experiment

Formative evaluation

Heuristic evaluation

Predictive evaluation

Summative evaluation

Usability laboratory

User testing

The language of evaluation


Evaluation approaches l.jpg

Evaluation approaches

  • Usability testing

  • Field studies

  • Analytical evaluation

  • Combining approaches

  • Opportunistic evaluations


Characteristics of approaches l.jpg

Characteristics of approaches


Evaluation approaches and methods l.jpg

Evaluation approaches and methods


Six evaluation case studies l.jpg

Six evaluation case studies

  • Evaluating early design ideas for a mobile device for rural nurses in India.

  • Evaluating cell phones for different markets.

  • Evaluating affective issues: challenge and engagement in a collaborative immersive game.

  • Improving a design: the Hutch World patient support system.

  • Multiple methods help ensure good usability: the Olympic messaging system (OMS).

  • Evaluating a new kind of interaction: an ambient system.


Team extra credit l.jpg

Team Extra Credit

Book Exercise in Chapter 12(Interaction Design Book). Due November 1st in class.


Decide a framework to guide evaluation l.jpg

DECIDE: a framework to guide evaluation

  • Determine the goals.

  • Explore the questions.

  • Choose the evaluation approach and methods.

  • Identify the practical issues.

  • Decide how to deal with the ethical issues.

  • Evaluate, analyze, interpret and present the data.


Determine the goals l.jpg

Determine the goals

  • What are the high-level goals of the evaluation?

  • Who wants it and why?

  • Some examples of goals:

    • Check to ensure that the final interface is consistent.

    • Investigate how technology affects working practices.

    • Improve the usability of an existing product .


Explore the questions l.jpg

Explore the questions

  • All evaluations need goals & questions to guide them.

  • What questions might you ask about the design of a cell phone?


Choose the evaluation approach methods l.jpg

Choose the evaluation approach & methods

  • The evaluation approach influences the methods used, and in turn, how data is collected, analyzed and presented.

  • E.g. field studies typically:

    Involve observation and interviews.

    Do not involve controlled tests in a laboratory.

    Produce qualitative data.


Identify practical issues l.jpg

Identify practical issues

For example, how to:

  • Select users

  • Stay on budget

  • Stay on schedule

  • Find evaluators

  • Select equipment


Decide about ethical issues l.jpg

Decide about ethical issues

  • Develop an informed consent form

  • Participants have a right to:- Know the goals of the study;- Know what will happen to the findings;- Privacy of personal information;- Leave when they wish; - Be treated politely.


Evaluate interpret present data l.jpg

Evaluate, interpret & presentdata

  • The approach and methods used influence how data is evaluated, interpreted and presented.

  • The following need to be considered:- Reliability: can the study be replicated?- Validity: is it measuring what you expected?- Biases: is the process creating biases?- Scope: can the findings be generalized?- Ecological validity: is the environment influencing the findings? - i.e. Hawthorn effect.


  • Login