Loading in 2 Seconds...
Loading in 2 Seconds...
Dialog Design - Gesture & Pen Interfaces, Mobile Devices
Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.
Dialog Design - Gesture & Pen Interfaces, Mobile Devices This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory Abowd, Jim Foley, Elizabeth Mynatt, Jeff Pierce, Colin Potts, Chris Shaw, John Stasko, Bruce Walker, and Melody Moore Jackson. Comments directed to email@example.com are encouraged. Permission is granted to use with acknowledgement for non-profit purposes. Last revision: October 2007. CS / Psych 6750
Dialog Styles CS / Psych 6750 1. Command languages 2. WIMP - Window, Icon, Menu, Pointer 3. Direct manipulation 4. Speech/natural language 5. Gesture & pen
Agenda CS / Psych 6750 PDA overview Pen input styles
How to use a PDA CS / Psych 6750
Personal Digital Asst. (PDA) Apple iPhone Palm Treo Dell / Asus A639 GPS PDA Apple Newton (1993) Blackberry Curve CS / Psych 6750
PDAs CS / Psych 6750 • Now ubiquitous • Small displays • Often touch and pen interfaces • Small thumb-based keyboards • Recent Improvements • Wi-Fi, GPS, more memory, better CPU, better OS, BlueTooth
Is it a PDA? Phone? GPS? Camera? Computer? CS / Psych 6750 • Line between devices is blurred today • Apple iPhone – phone, MP3 player, PDA, camera • Palm Treo 700w – phone, Windows computer, PDA, camera • Asus MyPal – Windows computer, GPS device
No Shredder… CS / Psych 6750
Input Options CS / Psych 6750 • Pen / Stylus is dominant form • Main techniques • Free-form ink • Soft keyboard • Numeric keyboard => text • Stroke recognition - strokes not in the shape of characters • Hand printing / writing recognition • Sometimes have or can connect keyboard
Free-form Ink CS / Psych 6750 Ink is the data, take as is Human is responsible forunderstanding andinterpretation Like a sketch pad
Soft Keyboards CS / Psych 6750 Common on PDAs and mobile devices
Soft Keyboard • Presents a small diagram of keyboard • You click on buttons/keys with pen or finger • QWERTY vs. alphabetical • Tradeoffs? • Alternatives? Apple iPhone soft keyboard CS / Psych 6750
Numeric Keypad -T9 CS / Psych 6750 Tegic Communications developed You press out letters of your word, it matches the most likely word, then gives optional choices Faster than multiple presses per key Used in mobile phones www.tegic.com/t9
Stroke Recognition - Graffiti CS / Psych 6750 • Graffiti - Unistroke alphabet on Palm PDA • What are yourexperienceswith Graffiti? • Graffiti demo: • mms://126.96.36.199/pub/hcirep/demos/DEMO-palm.wmv
Stroke Recognition - Cirrin CS / Psych 6750 Developed by Jen Mankoff (GT -> Berkeley CS Faculty) Word-level unistroke technique UIST ‘98 paper Use stylus to go from one letterto the next ->
Hand Printing & Hand Writing Recognition CS / Psych 6750 • Recognizing letters and numbers and special symbols • Lots of commercial systems • English, kanji, etc. • Not perfect, but people aren’t either! • People - 96% handprinted single characters • Computer - >97% is really good • OCR (Optical Character Recognition)
Recognition Issues CS / Psych 6750 • Off-line vs. On-line • Off-line: After all writing is done, speed not an issue, only quality. • Work with either a bit map or vector sequence • On-line: Must respond in real-time - but have richer set of features - acceleration, velocity, pressure • Use best-guess pattern matching, including digram, trigram probabilities and word lists to remove ambiguity • 1 I l
More Issues CS / Psych 6750 • Boxed vs. Free-Form input • Sometimes encounter boxes on forms • Printed vs. Cursive • Cursive is much more difficult to impossible • Letters vs. Words • Cursive is easier to do in words vs individual letters, as words create more context
Pen Gesture Commands • Might mean delete • Insert • Paragraph Define a series of (hopefully) simple drawing gesturesthat mean different commands in a system CS / Psych 6750
Pen Use Modes CS / Psych 6750 • Often, want a mix of free-form drawing and special commands • How does user switch modes? • Mode icon on screen • Button on pen • Button on device
Error Correction CS / Psych 6750 • Having to correct errors can slow input tremendously • Strategies • Erase and try again • When uncertain system shows list of best guesses • ...
A Different Application CS / Psych 6750 Signature verification But not with a mouse :)
Multi-touch interfaces Capacitive touchscreen: http://www.apple.com/iphone/features/index.html#touch Gestures: flick, tap, pinch, un-pinch http://www.apple.com/iphone/features/index.html#map CS / Psych 6750 • Apple iPhone