1 / 27

Data-collection techniques

Data-collection techniques. Contents. Types of data Observations Event logs Questionnaires Interview. Two types of data. Usability Measures. Use/problem Descriptions. Observations. Observe in real-time or from video recordings Can be used both for measures and descriptions.

brandi
Download Presentation

Data-collection techniques

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Data-collection techniques

  2. Contents • Types of data • Observations • Event logs • Questionnaires • Interview

  3. Two types of data Usability Measures Use/problem Descriptions

  4. Observations • Observe in real-time or from video recordings • Can be used both for measures and descriptions Usability Measures Use/problem Descriptions

  5. http://www.mangold.de/english/intoverview.htm

  6. Measures from observations • Particularly suitable for measuring effectivity and efficiency • How many tasks were performed? • How quickly was the task performed? • Were the goals achieved? • How many errors were made? Effectivity Efficiency

  7. Use/problem descriptions from observations • Description of breakdowns • Describe situations when there is a ”breakdown” in the users interaction with the product • Description of use • Describe how the user actually used the product

  8. Event logs • Logging of the user’s interaction with the product • Typically collected automatically • Can be used both for measures and descriptions Usability Measures Use/problem Descriptions

  9. http://zing.ncsl.nist.gov/WebTools/WebVIP/overview.html

  10. http://zing.ncsl.nist.gov/WebTools/FLUD/example-pretty.html

  11. http://zing.ncsl.nist.gov/WebTools/VisVIP/overview.html

  12. http://zing.ncsl.nist.gov/hfweb/proceedings/etgen-cantor/

  13. http://zing.ncsl.nist.gov/hfweb/proceedings/etgen-cantor/

  14. http://zing.ncsl.nist.gov/hfweb/proceedings/etgen-cantor/

  15. http://www.mangold.de/english/patternexample.htm

  16. http://zing.ncsl.nist.gov/WebTools/VisVIP/overview.html

  17. Measures from event logs • Suitable for measuring effectivity and efficiency Effectivity Efficiency

  18. Use/problem descriptions from event logs • Visualise interaction patterns • (Quantify use)

  19. Questionnaire • Self-made or validated • Most useful for collecting measures Usability Measures

  20. Self-made or validated? • Designing your own questionnaire allows you to address issues of particular interest; however, it is difficult to create good items • Validated questionnaires (e.g. SUMI) have typically gone through extensive testing. Thus, test items are generally good, but they may not address the issues you are particularly interested in.

  21. http://www.acm.org/~perlman/question.cgi?form=NAU

  22. http://www.acm.org/~perlman/question.cgi?form=ASQ

  23. http://www.acm.org/~perlman/question.cgi?form=PUEU

  24. Measures from questionnaires • Can be used for measuring all attributes, but is particularly suitable for measuring satisfaction; we are interested in the user’s subjective opinion Satisfaction

  25. Interview • Structured, semi-structured, open • Most useful for use/problem descriptions Use/problem Descriptions

  26. Use/problem descriptions from interviews • Information about previous experiences and knowledge that might explain the user’s performance • Obtain explanations: • the user’s preferences • Breakdowns • errors

  27. Student tasks • What data-collection techniques do you think are suitable for testing your product? • What do you believe are the strengths and weaknesses of the technique?

More Related