Dialog design gesture pen interfaces mobile devices
Download
1 / 23

Dialog Design - Gesture & Pen Interfaces, Mobile Devices - PowerPoint PPT Presentation


  • 583 Views
  • Updated On :

Dialog Design - Gesture & Pen Interfaces, Mobile Devices

Related searches for Dialog Design - Gesture & Pen Interfaces, Mobile Devices

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Dialog Design - Gesture & Pen Interfaces, Mobile Devices' - elina


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Dialog design gesture pen interfaces mobile devices l.jpg

Dialog Design - Gesture & Pen Interfaces, Mobile Devices

This material has been developed by Georgia Tech HCI faculty, and continues to evolve. Contributors include Gregory Abowd, Jim Foley, Elizabeth Mynatt, Jeff Pierce, Colin Potts, Chris Shaw, John Stasko, Bruce Walker, and Melody Moore Jackson. Comments directed to foley@cc.gatech.edu are encouraged. Permission is granted to use with acknowledgement for non-profit purposes. Last revision: October 2007.

CS / Psych 6750


Dialog styles l.jpg
Dialog Styles

1. Command languages

2. WIMP - Window, Icon, Menu, Pointer

3. Direct manipulation

4. Speech/natural language

5. Gesture & pen

CS / Psych 6750


Agenda l.jpg
Agenda

  • PDA overview

  • Pen input styles

CS / Psych 6750


How to use a pda l.jpg
How to use a PDA

CS / Psych 6750


Personal digital asst pda l.jpg
Personal Digital Asst. (PDA)

Apple iPhone

Palm Treo

Dell / Asus A639 GPS PDA

Apple Newton (1993)

Blackberry Curve

CS / Psych 6750


Slide6 l.jpg
PDAs

  • Now ubiquitous

  • Small displays

  • Often touch and pen interfaces

  • Small thumb-based keyboards

  • Recent Improvements

    • Wi-Fi, GPS, more memory, better CPU, better OS, BlueTooth

CS / Psych 6750


Is it a pda phone gps camera computer l.jpg
Is it a PDA? Phone? GPS? Camera? Computer?

  • Line between devices is blurred today

    • Apple iPhone – phone, MP3 player, PDA, camera

    • Palm Treo 700w – phone, Windows computer, PDA, camera

    • Asus MyPal – Windows computer, GPS device

CS / Psych 6750


No shredder l.jpg
No Shredder…

CS / Psych 6750


Input options l.jpg
Input Options

  • Pen / Stylus is dominant form

  • Main techniques

    • Free-form ink

    • Soft keyboard

    • Numeric keyboard => text

    • Stroke recognition - strokes not in the shape of characters

    • Hand printing / writing recognition

  • Sometimes have or can connect keyboard

CS / Psych 6750


Free form ink l.jpg
Free-form Ink

  • Ink is the data, take as is

  • Human is responsible forunderstanding andinterpretation

  • Like a sketch pad

CS / Psych 6750


Soft keyboards l.jpg
Soft Keyboards

  • Common on PDAs and mobile devices

CS / Psych 6750


Soft keyboard l.jpg
Soft Keyboard

  • Presents a small diagram of keyboard

  • You click on buttons/keys with pen or finger

  • QWERTY vs. alphabetical

    • Tradeoffs?

    • Alternatives?

Apple iPhone soft keyboard

CS / Psych 6750


Numeric keypad t9 l.jpg
Numeric Keypad -T9

  • Tegic Communications developed

  • You press out letters of your word, it matches the most likely word, then gives optional choices

  • Faster than multiple presses per key

  • Used in mobile phones

  • www.tegic.com/t9

CS / Psych 6750


Stroke recognition graffiti l.jpg
Stroke Recognition - Graffiti

  • Graffiti - Unistroke alphabet on Palm PDA

    • What are yourexperienceswith Graffiti?

  • Graffiti demo:

    • mms://199.77.128.107/pub/hcirep/demos/DEMO-palm.wmv

CS / Psych 6750


Stroke recognition cirrin l.jpg
Stroke Recognition - Cirrin

  • Developed by Jen Mankoff (GT -> Berkeley CS Faculty)

  • Word-level unistroke technique

  • UIST ‘98 paper

  • Use stylus to go from one letterto the next ->

CS / Psych 6750


Hand printing hand writing recognition l.jpg
Hand Printing & Hand Writing Recognition

  • Recognizing letters and numbers and special symbols

  • Lots of commercial systems

  • English, kanji, etc.

  • Not perfect, but people aren’t either!

    • People - 96% handprinted single characters

    • Computer - >97% is really good

  • OCR (Optical Character Recognition)

CS / Psych 6750


Recognition issues l.jpg
Recognition Issues

  • Off-line vs. On-line

    • Off-line: After all writing is done, speed not an issue, only quality.

      • Work with either a bit map or vector sequence

    • On-line: Must respond in real-time - but have richer set of features - acceleration, velocity, pressure

  • Use best-guess pattern matching, including digram, trigram probabilities and word lists to remove ambiguity

    • 1 I l

CS / Psych 6750


More issues l.jpg
More Issues

  • Boxed vs. Free-Form input

    • Sometimes encounter boxes on forms

  • Printed vs. Cursive

    • Cursive is much more difficult to impossible

  • Letters vs. Words

    • Cursive is easier to do in words vs individual letters, as words create more context

CS / Psych 6750


Pen gesture commands l.jpg
Pen Gesture Commands

  • Might mean delete

  • Insert

  • Paragraph

Define a series of (hopefully) simple drawing gesturesthat mean different commands in a system

CS / Psych 6750


Pen use modes l.jpg
Pen Use Modes

  • Often, want a mix of free-form drawing and special commands

  • How does user switch modes?

    • Mode icon on screen

    • Button on pen

    • Button on device

CS / Psych 6750


Error correction l.jpg
Error Correction

  • Having to correct errors can slow input tremendously

  • Strategies

    • Erase and try again

    • When uncertain system shows list of best guesses

    • ...

CS / Psych 6750


A different application l.jpg
A Different Application

  • Signature verification

  • But not with a mouse :)

CS / Psych 6750


Multi touch interfaces l.jpg
Multi-touch interfaces

  • Apple iPhone

Capacitive touchscreen:

http://www.apple.com/iphone/features/index.html#touch

Gestures:

flick, tap, pinch, un-pinch

http://www.apple.com/iphone/features/index.html#map

CS / Psych 6750