1 / 8

Challenges in Multi-Modal and Context-Aware UI

Challenges in Multi-Modal and Context-Aware UI. (the 5 minute version). Multi-Modal. I’m using multiple output media (audio, visual, gestural, stance, posture, eye gaze, etc.). Challenge : apply this same fluidity, range, and artful redundancy/overlap to computer input techniques.

delilah
Download Presentation

Challenges in Multi-Modal and Context-Aware UI

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Challenges in Multi-Modal and Context-Aware UI (the 5 minute version) Ken Fishkin;SoftBook Press;fishkin@softbook.com

  2. Multi-Modal • I’m using multiple output media (audio, visual, gestural, stance, posture, eye gaze, etc.). • Challenge: apply this same fluidity, range, and artful redundancy/overlap to computer input techniques. Ken Fishkin;SoftBook Press;fishkin@softbook.com

  3. Context-Aware • Where am I? • What room? • What noise level? • What lighting level? • What elevation? Ken Fishkin;SoftBook Press;fishkin@softbook.com

  4. Context-aware (2) • Who am I? • Biometrics • best tailoring extreme interfaces • Who else is nearby? Ken Fishkin;SoftBook Press;fishkin@softbook.com

  5. Context-aware (3) • What is around me? • Other devices (IR/RF communication networks) • true plug-n-play (Handspring). Ken Fishkin;SoftBook Press;fishkin@softbook.com

  6. Context-aware (4) • How do you know what I mean? • Clutching problem • How far back does context apply? • Affects all the other issues (what, when, etc.) Ken Fishkin;SoftBook Press;fishkin@softbook.com

  7. 2 modest proposals • get 20 itsy’s (or similar technology), “embrace and extend” them. • Lego Mindstorms • Study sign language Ken Fishkin;SoftBook Press;fishkin@softbook.com

  8. Hmmm…. • When two fluent speakers of North American Indian Sign Language communicate • 60% - redundant • 30% - augment • 10% - disjoint! Ken Fishkin;SoftBook Press;fishkin@softbook.com

More Related