Engineering dialog for gadgets l.jpg
Sponsored Links
This presentation is the property of its rightful owner.
1 / 15

Engineering Dialog for Gadgets PowerPoint PPT Presentation

Engineering Dialog for Gadgets. Thomas K Harris September 12, 2003. ???Questions???. Motivation: Is speech a useful modality for electronic devices? Hardware: How would one get speech in “other” devices? Architecture: What should the system look like?

Related searches for Engineering Dialog for Gadgets

Download Presentation

Engineering Dialog for Gadgets

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript

Engineering Dialog for Gadgets

Thomas K Harris

September 12, 2003


  • Motivation: Is speech a useful modality for electronic devices?

  • Hardware: How would one get speech in “other” devices?

  • Architecture: What should the system look like?

  • Dialog: What should/will these conversations be like?

Current Speech Application Concept

Phone Client

PDA Client

Computer Client

Speech Application


Current Electronic Devices




Speech Application


Protocol-based Architecture



Speech Graffiti






Speech Graffiti Dialog

  • Artificial subset language

  • Tree-structured functions

  • Universal conversational primitives

  • User-directed

  • Great for recognition

  • Entirely declarative (and automatic)

Minimal Keywords

  • hello-james

  • options

  • where-am-i, where-was-i

  • go-ahead, ok

  • status

  • goodbye

  • what-is, what-is-the

  • how-do-i

  • more

Session Management

  • hello-james/goodbye

  • User: blah blah blah...System: ignoring userUser: hello-jamesSystem: stereo, digital cameraUser: stereoSystem: stereo hereUser: goodbyeSystem: goodbyeUser: blah blah blah...System: ignoring user


  • what-is path/status

  • User: what-is-the am frequencySystem: the am frequency is five hundred thirtyUser: what-is randomSystem: random is offUser: what-is-the stereoSystem: the stereo is tuner

help/exploration/implicit navigation

  • how-do-i.../options/path options

  • User: control alarm clock radio optionsSystem: alarm, clock, radio, sleep...User: moreSystem: x10, stereoUser: stereo optionsSystem: while turning stereo on: off, am, fm, auxiliary, cd...

invocation/specification/implicit exploration/navigation

  • Path

  • User: stereo auxiliarySystem: while turning the stereo on and switching to auxiliary: auxiliaryUser: cdSystem: while switching to cd mode: cdUser: playSystem: while playing a cd: play

list navigation

  • More

  • User: radio band am optionsSystem: bracketed list [frequency, kabc, k001, k002, k003, k004, k005][fm][off, volume][alarm, clock, sleep][x10, stereo] rendered: frequency, kabc, k001, k002...User: moreSystem: k003, k004, k005...User: moreSystem: fm, off, volume...


  • where-am-i

  • User: what is the discSystem: the disc is threeUser: where am iSystem: stereo cd disc

Research Questions

  • Is the subset language learnable?

  • Once learned, is it efficient?

  • Are user mistakes infrequent enough?

  • Are system mistake infrequent enough?

  • Can one generalize from one device to another?

  • Is the subset language well retained?

  • Login