1 / 6

I think we should work on recognizing gestures in a really constrained situation.

I think we should work on recognizing gestures in a really constrained situation. Why gestures?. They can reveal themes of discourse Gestures “give clues to the underlying thematic organization of … the speaker's perspective” (Cassell, 1998) They can reveal hidden reasoning

ryder-acosta
Download Presentation

I think we should work on recognizing gestures in a really constrained situation.

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. I think we should work on recognizing gestures in a really constrained situation.

  2. Why gestures? • They can reveal themes of discourse Gestures “give clues to the underlying thematic organization of … the speaker's perspective” (Cassell, 1998) • They can reveal hidden reasoning Gestures “identify underlying reasoning processes that the speaker cannot articulate” (Church and Goldin-Meadow, 1986) • They can point to given tasks Gestures can be made for functional reasons: to pick up objects, to use the phone.

  3. Which gestures? Gestures made on the desktop. Why these? • Because they can indicate office tasks: • (typing, sorting papers, using the stapler) • Because they can be used to command: • (acknowledgement, drill down, deferral, delegation) • Because the situation is constrained. • (planar desktop, limited workspace) • Because maybe they can indicate more.

  4. OK, so how? 1. Track an arm on the desktop. Fod, Mataric and Jenkins (2000)

  5. OK, so how? 2. Track the motion of the hand and make segments where velocities are zero. Fod, Mataric and Jenkins (2000)

  6. And what does this get you? • Information regarding the principal hand motions made on the desktop (‘primitives’). • Information regarding principal regions of the desk that are most frequently used. • Information that allows you to recognize new gestures quickly. • Information as to what motions are rare, and hence easy to recognize (for the purpose of deferral, etcetera). • A base upon which to think about: hierarchical segmentations, probabilistic gesture models, and so on.

More Related