Pen based stuff
Download
1 / 24

Pen-based stuff - PowerPoint PPT Presentation


  • 382 Views
  • Uploaded on

Pen-based stuff Ink as data Agenda Questions Project selection Natural data types Pen, Audio, Video Pen-based topics Technology Ink as data Recognition Natural Data Types As we move off the desktop, means of communication mimic “natural” human forms of communication

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Pen-based stuff' - Olivia


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Pen based stuff l.jpg

Pen-based stuff

Ink as data


Agenda l.jpg
Agenda

  • Questions

    • Project selection

  • Natural data types

    • Pen, Audio, Video

  • Pen-based topics

    • Technology

    • Ink as data

    • Recognition

CS 4470/6456 - Fall 2002


Natural data types l.jpg
Natural Data Types

  • As we move off the desktop, means of communication mimic “natural” human forms of communication

    • Writing, Speaking, Seeing

    • Ink, Audio, Video (today and Wed)

  • Understanding these data types leads to interesting applications

    • e.g., capture applications (Friday)

CS 4470/6456 - Fall 2002


Pen computing l.jpg
Pen Computing

  • Use of pens has been around a long time

    • Light pen was used by Sutherland before Engelbart introduced the mouse

  • Resurgence in 90’s

  • Types of “pens”

    • Passive (same as using a finger)

    • Active (pen provides some signal)

CS 4470/6456 - Fall 2002


Example pen technology l.jpg
Example Pen Technology

  • Passive

    • Touchscreen (e.g., PDA, some tablets)

    • Contact closure

    • Vision techniques

  • Active

    • Pen emits signal(s)

    • e.g. IR + ultrasonic

  • Where is sensing? Surface or pen

CS 4470/6456 - Fall 2002


Questions about pens l.jpg
Questions about Pens

  • What operations detectable

    • Contact – up/down

    • Drawing/Writing

    • Hover?

    • Modifiers? (like mouse buttons)

    • Which pen used?

    • Eraser?

  • Difference between pen and mouse.

CS 4470/6456 - Fall 2002


Example expansys chatpen l.jpg
Example: Expansys Chatpen

  • Reads dot pattern on paper

  • Transmits via Bluetooth

  • http://www.expansys.com/product.asp?code=ERIC_CHATPEN

CS 4470/6456 - Fall 2002


Example mimio l.jpg
Example: mimio

  • Active pens

    • IR + ultrasonic

  • Portable sensor

    • Converts any surfaceto input surface

  • We have chained theseto create big surface

  • http://www.mimio.com

CS 4470/6456 - Fall 2002


Pen input l.jpg
Pen input

  • Free-form ink

  • Soft keyboards

  • Recognition systems

    • generalize to gesture-based systems

CS 4470/6456 - Fall 2002


Free form ink l.jpg
Free-form ink

  • ink as data

  • humans can interpret

  • time-stamping

  • implicit object detection

  • special-purpose “domain” objects

CS 4470/6456 - Fall 2002


Free form ink examples l.jpg
Free-form ink examples

  • Ink-Audio integration

    • Tivoli (Xerox PARC)

    • eClass (GT)

    • FlatLand (Xerox PARC)

    • Dynomite (FX-PAL)

    • The Audio Notebook (MIT)

CS 4470/6456 - Fall 2002


Soft keyboards l.jpg
Soft Keyboards

  • common on small mobile devices

  • many varieties

    • tapping interfaces

    • Key layout (QWERTY, alphabetical, … )

    • learnability vs. efficiency

CS 4470/6456 - Fall 2002


T9 tegic communications l.jpg
T9 (Tegic Communications)

  • Alternative tapping interface

  • phone layout plus dictionary

  • Soft keyboard or mobile phone

CS 4470/6456 - Fall 2002


Quickwrite perlin l.jpg
Quickwrite (Perlin)

  • “Unistroke” recognizer

CS 4470/6456 - Fall 2002


Cirrin mankoff l.jpg
Cirrin (Mankoff)

  • Word-level unistroke recognizer

CS 4470/6456 - Fall 2002


Recognizing pen input l.jpg
Recognizing pen input

  • Graffiti

    • unistroke alphabet

  • Other pen gesture recognizers

    • for commands

      • Stanford flow menus; PARC Tivoli implicit objects

    • measure features of strokes

      • Rubine, Long

    • usually no good for “complex” strokes

CS 4470/6456 - Fall 2002


Handwriting recognition l.jpg
Handwriting recognition

  • Lots of resources

    • see Web

    • good commercial systems

  • Two major techniques:

    • on-line

    • off-line

CS 4470/6456 - Fall 2002


Mixing modes of pen use l.jpg
Mixing modes of pen use

  • Users want free-form and commands

    • or commands vs. text

  • How to switch between them?

    • (1 mode) recognize which applies

    • (2 modes) visible mode switch

    • (1.5 modes) special pen action switches

CS 4470/6456 - Fall 2002


Error correction l.jpg
Error correction

  • Really slows effective input

    • word-prediction can prevent errors

  • Various strategies

    • repetition (erase and write again)

    • n-best list

    • other multiple alternative displays

CS 4470/6456 - Fall 2002


Other interesting applications l.jpg
Other interesting applications

  • Signature verification

  • Note-taking

    • group (NotePals by Landay @ Berkeley)

    • student (StuPad by Truong @ GT)

    • meetings (Tivoli and other commercial)

  • Sketching systems

    • early storyboard support (SILK, Cocktail Napkin)

CS 4470/6456 - Fall 2002


Toolkits for pen based interfaces l.jpg
Toolkits for Pen-Based Interfaces

  • SATIN (Landay and Hong) – Java toolkit

  • MS Windows for Pen Computing

  • MS Pocket PC, CE.net

  • Apple Newton OS

  • GO PenPoint

  • Palm Developer environments

  • GDT (Long, Berkeley) Java-based trainable unistroke gesture recognizer

  • OOPS (Mankoff, GT) error correction

CS 4470/6456 - Fall 2002


Satin uist 2000 l.jpg
SATIN (UIST 2000)

  • Pen input for informal input

    • Sketching (others have investigated this)

  • Common toolkit story

    • Gee, “X” sure is a neat class of apps!

    • Golly, making “X” apps is tough!

    • Here’s a toolkit to build “X” things easily!

CS 4470/6456 - Fall 2002


The satin toolkit l.jpg
The SATIN Toolkit

  • The application space

    • Informal ink apps

    • Beyond just recognition

    • Pen “look-and-feel”

  • Abstractions

    • Recognizers

    • Interpreters

    • multi-interpreters

CS 4470/6456 - Fall 2002


Critiquing the paper satin l.jpg
Critiquing the Paper/SATIN

  • Strong points

  • Weak points

CS 4470/6456 - Fall 2002


ad