Freehand drawing system based on geometric constraints l.jpg
This presentation is the property of its rightful owner.
Sponsored Links
1 / 57

Freehand Drawing System based on Geometric Constraints PowerPoint PPT Presentation


  • 154 Views
  • Uploaded on
  • Presentation posted in: General

Freehand Drawing System based on Geometric Constraints. Kaisuke Nakajima Joint work with Takeo Igarashi. User Interface Research Group The University of Tokyo. Two Parts of the Talk. Introduction to Pegasus [Igarashi, UIST 1997 & CHI 1998] Improvement attempts My current study

Download Presentation

Freehand Drawing System based on Geometric Constraints

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Freehand drawing system based on geometric constraints l.jpg

Freehand Drawing Systembased on Geometric Constraints

Kaisuke Nakajima

Joint work with Takeo Igarashi

User Interface Research Group

The University of Tokyo


Two parts of the talk l.jpg

Two Parts of the Talk

  • Introduction to Pegasus

    • [Igarashi, UIST 1997 & CHI 1998]

  • Improvement attempts

    • My current study

    • Any comments greatly appreciated! 


Outline l.jpg

Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Problem l.jpg

Problem

  • Diagrams

    • In documents, slides, …

    • By drawing editors

  • Difficult to satisfy geometric relations!


Example l.jpg

Example


Slide6 l.jpg

Copy

Flip

Move


Example contd l.jpg

Example (contd.)

  • In this case, grids works well, but…


Another example l.jpg

Geometric constraints

Another Example


Slide9 l.jpg

The user attempts to

draw a perpendicular line,


Slide10 l.jpg

GRID

but grid prevents desired placements.


Slide11 l.jpg

He draws a box separately, and...


Slide12 l.jpg

ROTATE

rotates it, but fails to get precise angle.


Slide13 l.jpg

ROTATE

COPY

Better strategy:

copy the slope  rotate 90 degrees


Why difficult l.jpg

Move

Grid

Flip

Copy

Rotate

Why Difficult?

The user must plan detailed strategy.

Planning overhead


Outline15 l.jpg

Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Our idea l.jpg

Sketch

+ Beautify

Our Idea

  • Sketching is easy!

  • Sketch  Beautify

    • Interactive Beautification[Igarashi, UIST 1997]


Interactive beautification l.jpg

Draw and...

Interactive Beautification


Interactive beautification18 l.jpg

Draw and...

Interactive Beautification

Satisfied

Constraints

Beautify.


Interactive beautification19 l.jpg

Draw and...

Interactive Beautification

Beautify.


Interactive beautification20 l.jpg

Interactive Beautification

Beautify.


Ambiguity handling l.jpg

Ambiguity Handling

But free strokes are ambiguous.


Ambiguity handling22 l.jpg

Ambiguity Handling

Generate multiple candidates

 Let the user select


Slide23 l.jpg

In this way,the user can constructprecise geometric diagramswithout any editing commands!!


Prototype system pegasus l.jpg

Prototype System Pegasus

Live Demo


Diagrams drawn l.jpg

Diagrams Drawn


Outline26 l.jpg

Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Beautification systems l.jpg

Beautification Systems

[Pavlidis 1985] ...


Beautification systems contd l.jpg

Beautification Systems (contd.)

Batch-based

too many errors!

More Interaction (+ multiple candidates)


Free stroke vectorization l.jpg

Free Stroke Vectorization

[Apple Newton] [SmartSketch] ...


Free stroke vectorization contd l.jpg

Free Stroke Vectorization (contd.)

Local context


Free stroke vectorization contd31 l.jpg

Free Stroke Vectorization (contd.)

Local context

Global context


Drawing systems based on geometric constraints l.jpg

Drawing Systems based on Geometric Constraints

[Sutherland 1963] [Nelson 1985] ...


Drawing systems based on geometric constraints contd l.jpg

Drawing Systems based on Geometric Constraints (contd.)

  • Previous work

    • Explicitly specify constraints

  • Our approach

    • Infer constraints


Outline34 l.jpg

Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Beautification algorithm l.jpg

Segment coordinates

Constraint Inference

Multiple constraints

Constraint Solver

Multiple candidates

Candidate Evaluation

Primary candidate

Beautification Algorithm


Constraint inference l.jpg

Input

Reference segments

(array of (X0, Y0, X1, Y1))

New stroke

(x0, y0, x1, y1)

Output

Possible constraints

(linear equations of (x0, y0, x1, y1))

Constraint Inference

Perpendicular

const * (x1 – x0) + const * (y1 – y0) = 0

Edge Connection

x0 = const, y0 = const

etc.

(x1, y1)

(x0, y0)


Constraint inference contd l.jpg

Constraint Inference (contd.)

  • How?

  • Supported constraints

if (distance(point1, point2) < 30)

infer constraint(point1 == point2);


Constraint solver l.jpg

Input

Possible constraints

(linear equations of (x0, y0, x1, y1))

Output

Beautification candidates

(array of (x0, y0, x1, y1))

Constraint Solver

Perpendicular

Same Length

Edge Connection

Horizontal


Constraint solver contd l.jpg

Constraint Solver (contd.)


Candidate evaluation l.jpg

Candidate Evaluation

Candidate nearest to the original stroke

 Primary candidate


Outline41 l.jpg

Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Purpose l.jpg

Purpose

To confirm the intuition !

“It’s difficult for novice users

to use commands”

“Interactive beautification is good”


Two measures l.jpg

Rapidness

How fast?

Precision

Beautiful?

Two Measures


Experimental settings l.jpg

Experimental Settings

  • 18 subjects

  • 3 diagrams, 3 editors (9 sessions / person)


Systems l.jpg

Systems

  • CAD ... AutoSketch(AutoDesk), CAD Software.

  • Draw ... SmartSketch(Future Wave), Drawing Editor.

  • Pegasus…Our Prototype system.

On AMiTY (a pen computer)


Diagrams and constraints l.jpg

Diagrams and Constraints

B)

C)

A)

Parallel-1

Symmetric-1

Parallel-1

Parallel-2

Symmetric-2

Parallel-2

Connected

(all Vertices)

Perpendicular

Equal Interval

Vertical and Horizontal

Connected

(all Vertices)

Connected (all Vertices)


Results l.jpg

Precision

Rapidness

Averaged drawing time

for three diagrams

The ratio of sessions where

all constraints are satisfied

Results

100

600

500

80

400

60

300

40

200

Pegasus outperformed CAD and Draw,

in both rapidness and precision.

20

100

0

0

CAD

CAD

Draw

Pegasus

Draw

Pegasus


Evaluation conclusion l.jpg

Evaluation: Conclusion

  • Pegasus cannot do everything

  • But: certainly useful in its target domain

CAD

Paint

Geometric diagrams,

rapidly & precisely!


Outline49 l.jpg

Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Ongoing work l.jpg

Ongoing Work

  • Address limitations of Pegasus

    • Only lines

    • Too many candidates

    • Forgets constraints


Limitation only lines l.jpg

Limitation: Only Lines

 Support curves

  • Circles, ellipses, arcs,

    Bézier curves

  • (Experimental demo)


Limitation only lines contd l.jpg

Limitation: Only Lines (contd.)

  • Challenges with curves

    • More ambiguity

      • Shape recognition

      • Constraint inference

    • Complex constraints: how to represent?

      • e.g. line tangent to piecewise Bézier curve

    • Complex constraints: how to solve efficiently?

      • Exponential growth of candidate solutions


Limitation too many candidates l.jpg

Limitation: Too Many Candidates

Overlapping…

 Constraint switching interface

  • Visualize conflicting constraints

  • Enable manual switching

  • Challenges

    • How to detect conflicting constraints efficiently?


  • Limitation forgets constraints l.jpg

    Limitation: Forgets Constraints

     Remember constraints

    • Maintain them during manipulation

    • Chorus [Hosobe 2001]

    Skewed 

    Stretch!

    Stretch!


    Outline55 l.jpg

    Outline

    1. Problem

    2. Our Idea & Demonstration

    3. Related Work

    4. Algorithm

    5. Evaluation

    6. Ongoing Study

    7. Summary


    Summary l.jpg

    Summary

    • Pegasus: freehand drawing system

      • User study showed promising results

    • Geometric constraints play an important role in sketch beautification

    • Further improvements to be made


    Thank you l.jpg

    Thank you

    • Papers & demos available at

      http://www-ui.is.s.u-tokyo.ac.jp/


  • Login