1 / 12

An evaluation of the prototype mobile phone app Pugh a 3D cartoon character designed

An evaluation of the prototype mobile phone app Pugh a 3D cartoon character designed to help deaf children to speech read. Dawn Shaw Marianne Patera Eleni Paparidou Robin Wolff. University of Salford, U.K. School of Computing, Science & Engineering, . Inspiration. The Problem.

holly
Download Presentation

An evaluation of the prototype mobile phone app Pugh a 3D cartoon character designed

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. An evaluation of the prototype mobile phone app Pugh a 3D cartoon character designed to help deaf children to speech read Dawn Shaw Marianne Patera EleniPaparidou Robin Wolff University of Salford, U.K. School of Computing, Science & Engineering,

  2. Inspiration

  3. The Problem • Visual cues are very important for communicating messages to the deaf • Using a signer at the bottom of the screen may disengage viewers from being immersed in the story • Some of the visual cues & messages may not be “translated” successfully • This technique is not effectively engaging deaf children

  4. “When people observe agents, they do not just care about what the is agent doing; they want to understand the relations between the agent’s actions at various points in time.” (Phoebe Sengers, 1999, p. 5)

  5. Baldi Accurate speaker Non-accurate speakers Talking Tom Cat Talking Ben the Dog

  6. Concept • A 3D Cartoon Character • Smartphone Application • Believable • Friendly • Engaging • The Ability to Sign

  7. Design Vicon markers 44 phonemes Visemes Mouth structure

  8. Video of Pugh

  9. Preliminary Evaluation Online Test The test consisted of: • 5 visible Consonants (p, b, m, f, v) • 5 Vowels (a, e, i, o b) in VCV, CVC, CV, VC words • 15 high frequency words (primary school level) & • 3 sentences Participants Only a small number of participants (6) evaluated Pugh All adults 2 deaf and 4 speech therapists

  10. Findings At the moment Pughis not an accurate speaker. Speech-reading from the existing version is very difficult For the first 3 parts of the test (VCV, CVC, CV, VC) a sufficient proportion of the speechreading of the consonants was correct The vowel ‘a’ was perceived correctly by all the participants Pugh cannot articulate the vowel ‘o’ Inaccuracies were caused by the limitations in the technology to animate Pugh’s lips more accurately Its eyes, eyebrows and hands do not move properly which can be misleading (expressionless face) Limitations – small number of participants, test design

  11. The findings have reinforced a need for further development of the lip movement & the facial expressions. The Challenge Is it possible for a cartoon character to speak accurately & sign? The Plan More programming needed Further testing Work closely with specialists Collaborate with animators working on children‘s programmes

  12. Thank you! Dawn Shaw d.m.shaw@salford.ac.uk Pugh @

More Related