Evaluating electronic textbooks: a methodology
Download
1 / 20

Download It - PowerPoint PPT Presentation


  • 267 Views
  • Updated On :

Evaluating electronic textbooks: a methodology Ruth Wilson and Monica Landoni ECDL 2001 5 th September 2001 The Visual Book The WEB Book EBONI’s methodology for evaluating electronic textbooks Outline

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Download It' - oshin


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Slide1 l.jpg

Evaluating electronic textbooks: a methodology

Ruth Wilson and Monica Landoni

ECDL 2001

5th September 2001


Outline l.jpg

The Visual Book

The WEB Book

EBONI’s methodology for evaluating electronic textbooks

Outline


The visual book l.jpg

Studied the application of the paper book metaphor to the design and production of electronic books

Found that users were able to rely on their experience with paper books to interact with the electronic book.

The Visual Book


The web book l.jpg

Focused on the impact of appearance on the usability of textbooks on the Web.

Comparison of two versions of a textbook chapter:

Original version: very plain, one “page” per chapter, basic use of hyperlinks.

Revised, “scannable” version: chapter divided between 10 “pages”, heavier use of hyperlinks, extra headings, indented lists, coloured keywords.

Revised version was 92% more usable.

The WEB Book


Eboni aims l.jpg

EBONI aims to: textbooks on the Web.

Evaluate the different approaches to the design of electronic textbooks

Identify and report on the individual requirements of students and academics in learning and teaching using electronic textbooks

Compile and promote a set of best practice guidelines for the publication of electronic textbooks

EBONI: aims


Experiments psychology web books l.jpg

Peter K textbooks on the Web.aiser. The Joy of Visual Perception. http://www.yorku.ca/eye/thejoy.htm

Eric Chudler. Neuroscience for Kids. http://faculty.washington.edu/chudler/neurok.html

C. Robin Timmons and Leonard W. Hamilton. Drugs, Brains and Behaviour. http://www.rci.rutgers.edu/~lwh/drugs/

Experiments:psychology Web books


Experiments hypertext in context l.jpg

Cliff McKnight, Andrew Dillon and John Richardson. textbooks on the Web.Hypertext in Context.

Print

Original electronic version

Revised electronic version

Experiments:Hypertext in Context


Experiments commercial formats l.jpg

Rosa Ainley (ed.). textbooks on the Web.New Frontiers of Space…

MobiPocket Reader

Adobe Acrobat eBook Reader

Microsoft Reader

Paperback

Experiments:commercial formats


Experiments e encyclopaedias l.jpg

Britannica textbooks on the Web.

Columbia

Encarta

Experiments:e-encyclopaedias


Experiments portable ebooks l.jpg

HP Jornada textbooks on the Web.

Franklin eBookMan

PalmPilot

Rocket eBook

Softbook

Experiments:portable ebooks


Ebook evaluation model l.jpg

Selection of material textbooks on the Web.

Selection of participants

Selection of tasks

Scavenger hunt, memory tasks, high cognitive skill tasks

Selection of evaluation techniques

Questionnaires, observation, think-aloud, interviews

Ebook evaluation model


Selection of material 1 l.jpg

Electronic books offer a diverse array of textbooks on the Web.

material for evaluation:

Hardware devices, e.g. REBs, eBookMan, goReader

Ebook reader software, e.g. Microsoft Reader, Adobe Acrobat Ebook Reader

“Web books”

Selection of material (1)


Selection of material 2 l.jpg

EBONI aims to identify design techniques which maximise information intake by users, in order to provide guidance to creators of digitised educational material.

Texts can be compared according to three parameters:

Format

Content

Medium

Selection of material (2)


Selection of actors l.jpg

Four main roles can be distinguished: information intake by users, in order to provide guidance to creators of digitised educational material.

Participant

Evaluator

Task developer

Task assessor

Selection of actors


Selection of tasks l.jpg

Tasks are a way of bringing together participants and the test material in a structured manner. Three types are suggested:

“Scavenger Hunts”, or retrieval tasks

Memory tasks

High cognitive skill tasks

Selection of tasks


Selection of evaluation techniques l.jpg

Qualitative feedback can be obtained via: test material in a structured manner. Three types are suggested:

Subjective satisfaction questionnaires

Behaviour observation

Think-alouds

Interviews

Selection of evaluation techniques


Slide18 l.jpg

Technique complexity test material in a structured manner. Three types are suggested:

Study X

Interviews

Think-aloud

Covert observation

WEB Book

Questionnaires

Task

complexity

Scavenger hunt

Memory tasks

High cognitive skill tasks


Guidelines l.jpg

Sophisticated experiments can be “mapped” to simple experiments.

Results of all evaluations will be comparable at some level.

Results will feed into a set of best practice guidelines for producing electronic textbooks.

Guidelines


Contact details l.jpg

Ruth Wilson: [email protected]

EBONI Web site: http://eboni.cdlr.strath.ac.uk/

To join the EBONI mailing list, follow the instructions at: http://www.jiscmail.ac.uk/lists/open-eboni.html

Contact details


ad