Engineering dialog for gadgets
Download
1 / 15

Engineering Dialog for Gadgets - PowerPoint PPT Presentation


  • 381 Views
  • Updated On :

Engineering Dialog for Gadgets. Thomas K Harris September 12, 2003. ???Questions???. Motivation: Is speech a useful modality for electronic devices? Hardware: How would one get speech in “other” devices? Architecture: What should the system look like?

Related searches for Engineering Dialog for Gadgets

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Engineering Dialog for Gadgets' - arleen


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Engineering dialog for gadgets l.jpg

Engineering Dialog for Gadgets

Thomas K Harris

September 12, 2003


Questions l.jpg
???Questions???

  • Motivation: Is speech a useful modality for electronic devices?

  • Hardware: How would one get speech in “other” devices?

  • Architecture: What should the system look like?

  • Dialog: What should/will these conversations be like?


Current speech application concept l.jpg
Current Speech Application Concept

Phone Client

PDA Client

Computer Client

Speech Application

Backend


Current electronic devices l.jpg
Current Electronic Devices

???

???

???

Speech Application

Frontend


Protocol based architecture l.jpg
Protocol-based Architecture

Havi

adapter

Speech Graffiti

Personal

Universal

Controller

X10

adapter


Speech graffiti dialog l.jpg
Speech Graffiti Dialog

  • Artificial subset language

  • Tree-structured functions

  • Universal conversational primitives

  • User-directed

  • Great for recognition

  • Entirely declarative (and automatic)


Minimal keywords l.jpg
Minimal Keywords

  • hello-james

  • options

  • where-am-i, where-was-i

  • go-ahead, ok

  • status

  • goodbye

  • what-is, what-is-the

  • how-do-i

  • more


Session management l.jpg
Session Management

  • hello-james/goodbye

  • User: blah blah blah...System: ignoring userUser: hello-jamesSystem: stereo, digital cameraUser: stereoSystem: stereo hereUser: goodbyeSystem: goodbyeUser: blah blah blah...System: ignoring user


Query l.jpg
Query

  • what-is path/status

  • User: what-is-the am frequencySystem: the am frequency is five hundred thirtyUser: what-is randomSystem: random is offUser: what-is-the stereoSystem: the stereo is tuner


Help exploration implicit navigation l.jpg
help/exploration/implicit navigation

  • how-do-i.../options/path options

  • User: control alarm clock radio optionsSystem: alarm, clock, radio, sleep...User: moreSystem: x10, stereoUser: stereo optionsSystem: while turning stereo on: off, am, fm, auxiliary, cd...


Invocation specification implicit exploration navigation l.jpg
invocation/specification/implicit exploration/navigation

  • Path

  • User: stereo auxiliarySystem: while turning the stereo on and switching to auxiliary: auxiliaryUser: cdSystem: while switching to cd mode: cdUser: playSystem: while playing a cd: play


List navigation l.jpg
list navigation

  • More

  • User: radio band am optionsSystem: bracketed list [frequency, kabc, k001, k002, k003, k004, k005][fm][off, volume][alarm, clock, sleep][x10, stereo] rendered: frequency, kabc, k001, k002...User: moreSystem: k003, k004, k005...User: moreSystem: fm, off, volume...


Orientation l.jpg
orientation

  • where-am-i

  • User: what is the discSystem: the disc is threeUser: where am iSystem: stereo cd disc


Research questions l.jpg
Research Questions

  • Is the subset language learnable?

  • Once learned, is it efficient?

  • Are user mistakes infrequent enough?

  • Are system mistake infrequent enough?

  • Can one generalize from one device to another?

  • Is the subset language well retained?


ad