TOUCHSPEAK

1. TOUCHSPEAK

2. The PCAD Project of 1996-2000 introduced speech therapists to the first touch-screen Augmentative and Alternative Communication Aid Feature rich – MicroSoft Windows platform Its central, fully customisable vocabulary design enhances its user’s communication, literacy and general life skills and assists in maximising and realising their existing competences Systems can be configured to behave as a totally dedicated aid or to introduce the Microsoft applications as and when they are required TouchSpeakTMCommunication AidTypeSpeakTM

3. TouchSpeak Designer Philosophy • The main client group are adults with acquired conditions, which were initially those with aphasia • Its core design philosophy and comprehensive toolkit makes it easily and successfully adaptable for other client groups • Such as: MND, Parkinson’s, CP, Dysarthria, Dyspraxia, etc., • TouchSpeak is available in two discrete; but combinable, forms • For lower functioning users requiring all the symbolic, text etc., support features and: • TypeSpeak for higher-functioning, more literate users with limited or impaired speech output etc. • Plus integrated SMS and Telephony mobile access

4. Topic Vocabulary • A coherently organised set of interactive pages which contain all the symbols and/or text that allows the user to generate speech directly and QUICKLY • Symbolic & Pictorial Aid • An aid where the communication method is via symbols such as, PCS (Boardmaker), PICTO, photos and on-board sketches etc., • Dynamic • An aid where the communication screen changes when selections are made. • Text-based Aid • Communication is via TTS Text to Speech input (e.g.: word prediction, completion etc.,) • Mobile-enabled • Communication is via the device’s mobile/cellular network using TypeSpeak’s TTS Text to Speech module

5. General core design and implementation concepts • Designs created within TouchSpeak Designer, with minimal Computer skills • Designs are held in the central database • This central resource is therefore available to all • Therapists can share vocabularies and all their respective elements • Vocabulary transferred to the PDA via MicroSoft ActiveSync or Memory Card • The therapist builds the vocabulary collaboratively with their client • The vocabulary is tested in real-time using the on-screen PDA Simulator • The client has a real, positive and motivational role in the process • Therapists and the Departments are the primary beneficiaries • Different versions of the client’s vocabulary can be deployed for their practical evaluation • Normative vocabularies • Import and Export vocabularies • Export to a Word file, in Text or as Pictures for the client’s case notes • Vocabularies are securely stored for easy recovery

6. Configuring a Topic Vocabulary with the Simulator

7. Building the multi-level Vocabulary hierarchy with the central dynamic design module Virtually every facet is user designable • CONTENT • The Levels • Appearance • Font sizing • Behaviour • Toolbars • Colours • Etc. Even more of my features

8. Scalable (symetric or asymetric) Topic buttons – to further emphasise a particular key Multiple, unlimited multi-level topics Topics introduced as required Comprehensive dynamic, symbolic, text vocabulary Images categorised for easy searching and browsing e.g: symbolic, semantic, functional, photos etc., actually anything which is machine readable Hotspots to identify and speak a special ‘spot’ Simple consistent navigation (scrolling) toolbar Repositioning to accommodate visual problems such as Hemianopia Synthesised and Digitised voice output Phonemic Cueing Fishing and Voice over Essential Vocabulary building direct on to the PDA Scanning and switch access ... the Key Features Examples

9. Examples of various screen content configurations

10. An alternative method of expression Personal Motivational - great fun Drawing Gallery Annotate drawings Embody into the News Page or Vocabulary Print results Drawing Gallery

11. NEWS • Multi-level on-the fly News • Add a Photo • Add a personalised drawing • Record a spoken message • Create a Talking Album

12. Scanning (example shown – by Row) • Switch or Bluetooth access • Extensive control • Automatic • Row/column etc., • Timings • Appearance • Shape, colour etc., • Fully supported in the Simulator

13. Quick Objective Summary • AAC devices generally require a prepared set of generalised predictive messages, questions and possible appropriate responses for basic needs and preferences, to a listening ‘partner’. • Suitable for someone with only moderate comprehension skills • Who has reasonable dexterity • Scanning and switch assisted • Limited or impaired voice output • Where speed of response is not necessarily a primary objective

14. TypeSpeak • Communication is not Conversation • TypeSpeak delivers • Real-time, interactive spontaneous conversation • Empowers social networking • Supporting existing competencies • In acceptable ‘more natural’ and less-robotic sounding female and male voices

15. Text input to Voice output Scalable user-definable screen area On-screen scalable soft keyboard Sophisticated, comprehensive keyboard designer Standard QWERTY, ABC, 123, EARDU, keyboards External Bluetooth keyboard Transcriber – cursive hand written text to speak Etc. Text to Speech

16. Portrait or Landscape mode Word prediction and in reverse order Dynamic re-sizing Spelling suggestions - word completion 2 dictionaries supplementary or personal Colour highlight next probable / possible letter Speak on just the letter, word or complete phrase Message Gallery for repeat use Phrase/Abbreviation Topic/Vocabulary style structure Full expansion Auditory feedback Recency Frequency etc

17. Who could use and benefit from this type of AAC ? • Someone with higher functioning skills • Whose language and comprehension skills are reasonably intact • Who has reasonable dexterity or can use the external keyboard (scanning switch assisted) • But limited, impaired, unintelligible, or no voice output.

18. Thanks to Homer Simpson

19. TouchSpeak – TypeSpeak Establishing new AAC platforms Windows Mobile Pocket PC Ultra high specification Large touch screen 5” VGA display 8GB hard disk 3 mega pixel camera Separate Keyboard Wallet ETC.

20. TouchSpeak – TypeSpeak e.g. HTC 7500 Series in TouchSpeak mode in TypeSpeak mode

21. TouchSpeak – TypeSpeak UMPC Windows XP Tablet Self-contained, fully configurable dedicated device Large 7” touch screen 20Gb Hard Disk Separate USB Keyboard Connectivity 1 watt speaker Media centre ETC.

22. TouchSpeak Mobile • SMS • One-to-One ‘Telephony’ conversation • Requires TypeSpeak • Requires MicroSoft Phone Edition Mobile 5.0 • PAYG or contract • Subject to prevailing Network Tariff

23. TouchSpeak Mobile Speak One-to-One in real-time • User ‘speaks’ via their keyboard directly to their ‘listener’ • Mix existing and prepared stored messages • Compose questions and responses • Benefits the user and their listening ‘partner’ • SMS texting provides a familiar, secure and unambiguous method to communicate • Ideal in resolving risk situations • Etc.,

24. Who could benefit from this type of fully ‘Telephony-enabled’ AAC ? • Someone with higher functioning skills • Whose language and comprehension skills are reasonably intact • Who has reasonable dexterity • Who wants to be in the mainstream • But limited, impaired, unintelligible, or no voice output

25. In summaryWhy TouchSpeak & TypeSpeak ? • Solution delivered in a contemporary ergonomic and stylish designs • Solution thoroughly tested - with 10 years of professional therapist and clinical partnership involvement • Organic benefit of UK and European clinical partnerships • Continuing development