Freehand drawing system based on geometric constraints
Download
1 / 57

Freehand Drawing System based on Geometric Constraints - PowerPoint PPT Presentation


  • 204 Views
  • Uploaded on

Freehand Drawing System based on Geometric Constraints. Kaisuke Nakajima Joint work with Takeo Igarashi. User Interface Research Group The University of Tokyo. Two Parts of the Talk. Introduction to Pegasus [Igarashi, UIST 1997 & CHI 1998] Improvement attempts My current study

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Freehand Drawing System based on Geometric Constraints' - faxon


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Freehand drawing system based on geometric constraints l.jpg

Freehand Drawing Systembased on Geometric Constraints

Kaisuke Nakajima

Joint work with Takeo Igarashi

User Interface Research Group

The University of Tokyo


Two parts of the talk l.jpg
Two Parts of the Talk

  • Introduction to Pegasus

    • [Igarashi, UIST 1997 & CHI 1998]

  • Improvement attempts

    • My current study

    • Any comments greatly appreciated! 


Outline l.jpg
Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Problem l.jpg
Problem

  • Diagrams

    • In documents, slides, …

    • By drawing editors

  • Difficult to satisfy geometric relations!



Slide6 l.jpg

Copy

Flip

Move


Example contd l.jpg
Example (contd.)

  • In this case, grids works well, but…


Another example l.jpg

Geometric constraints

Another Example


Slide9 l.jpg

The user attempts to

draw a perpendicular line,


Slide10 l.jpg

GRID

but grid prevents desired placements.



Slide12 l.jpg

ROTATE

rotates it, but fails to get precise angle.


Slide13 l.jpg

ROTATE

COPY

Better strategy:

copy the slope  rotate 90 degrees


Why difficult l.jpg

Move

Grid

Flip

Copy

Rotate

Why Difficult?

The user must plan detailed strategy.

Planning overhead


Outline15 l.jpg
Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Our idea l.jpg

Sketch

+ Beautify

Our Idea

  • Sketching is easy!

  • Sketch  Beautify

    • Interactive Beautification[Igarashi, UIST 1997]


Interactive beautification l.jpg

Draw and...

Interactive Beautification


Interactive beautification18 l.jpg

Draw and...

Interactive Beautification

Satisfied

Constraints

Beautify.


Interactive beautification19 l.jpg

Draw and...

Interactive Beautification

Beautify.



Ambiguity handling l.jpg
Ambiguity Handling

But free strokes are ambiguous.


Ambiguity handling22 l.jpg
Ambiguity Handling

Generate multiple candidates

 Let the user select


Slide23 l.jpg

In this way,the user can constructprecise geometric diagramswithout any editing commands!!


Prototype system pegasus l.jpg

Prototype System Pegasus

Live Demo



Outline26 l.jpg
Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Beautification systems l.jpg
Beautification Systems

[Pavlidis 1985] ...


Beautification systems contd l.jpg
Beautification Systems (contd.)

Batch-based

too many errors!

More Interaction (+ multiple candidates)


Free stroke vectorization l.jpg
Free Stroke Vectorization

[Apple Newton] [SmartSketch] ...



Free stroke vectorization contd31 l.jpg
Free Stroke Vectorization (contd.)

Local context

Global context


Drawing systems based on geometric constraints l.jpg
Drawing Systems based on Geometric Constraints

[Sutherland 1963] [Nelson 1985] ...


Drawing systems based on geometric constraints contd l.jpg
Drawing Systems based on Geometric Constraints (contd.)

  • Previous work

    • Explicitly specify constraints

  • Our approach

    • Infer constraints


Outline34 l.jpg
Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Beautification algorithm l.jpg

Segment coordinates

Constraint Inference

Multiple constraints

Constraint Solver

Multiple candidates

Candidate Evaluation

Primary candidate

Beautification Algorithm


Constraint inference l.jpg

Input

Reference segments

(array of (X0, Y0, X1, Y1))

New stroke

(x0, y0, x1, y1)

Output

Possible constraints

(linear equations of (x0, y0, x1, y1))

Constraint Inference

Perpendicular

const * (x1 – x0) + const * (y1 – y0) = 0

Edge Connection

x0 = const, y0 = const

etc.

(x1, y1)

(x0, y0)


Constraint inference contd l.jpg
Constraint Inference (contd.)

  • How?

  • Supported constraints

if (distance(point1, point2) < 30)

infer constraint(point1 == point2);


Constraint solver l.jpg

Input

Possible constraints

(linear equations of (x0, y0, x1, y1))

Output

Beautification candidates

(array of (x0, y0, x1, y1))

Constraint Solver

Perpendicular

Same Length

Edge Connection

Horizontal



Candidate evaluation l.jpg
Candidate Evaluation

Candidate nearest to the original stroke

 Primary candidate


Outline41 l.jpg
Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Purpose l.jpg
Purpose

To confirm the intuition !

“It’s difficult for novice users

to use commands”

“Interactive beautification is good”


Two measures l.jpg

Rapidness

How fast?

Precision

Beautiful?

Two Measures


Experimental settings l.jpg
Experimental Settings

  • 18 subjects

  • 3 diagrams, 3 editors (9 sessions / person)


Systems l.jpg
Systems

  • CAD ... AutoSketch(AutoDesk), CAD Software.

  • Draw ... SmartSketch(Future Wave), Drawing Editor.

  • Pegasus…Our Prototype system.

On AMiTY (a pen computer)


Diagrams and constraints l.jpg
Diagrams and Constraints

B)

C)

A)

Parallel-1

Symmetric-1

Parallel-1

Parallel-2

Symmetric-2

Parallel-2

Connected

(all Vertices)

Perpendicular

Equal Interval

Vertical and Horizontal

Connected

(all Vertices)

Connected (all Vertices)


Results l.jpg

Precision

Rapidness

Averaged drawing time

for three diagrams

The ratio of sessions where

all constraints are satisfied

Results

100

600

500

80

400

60

300

40

200

Pegasus outperformed CAD and Draw,

in both rapidness and precision.

20

100

0

0

CAD

CAD

Draw

Pegasus

Draw

Pegasus


Evaluation conclusion l.jpg
Evaluation: Conclusion

  • Pegasus cannot do everything

  • But: certainly useful in its target domain

CAD

Paint

Geometric diagrams,

rapidly & precisely!


Outline49 l.jpg
Outline

1. Problem

2. Our Idea & Demonstration

3. Related Work

4. Algorithm

5. Evaluation

6. Ongoing Study

7. Summary


Ongoing work l.jpg
Ongoing Work

  • Address limitations of Pegasus

    • Only lines

    • Too many candidates

    • Forgets constraints


Limitation only lines l.jpg
Limitation: Only Lines

 Support curves

  • Circles, ellipses, arcs,

    Bézier curves

  • (Experimental demo)


Limitation only lines contd l.jpg
Limitation: Only Lines (contd.)

  • Challenges with curves

    • More ambiguity

      • Shape recognition

      • Constraint inference

    • Complex constraints: how to represent?

      • e.g. line tangent to piecewise Bézier curve

    • Complex constraints: how to solve efficiently?

      • Exponential growth of candidate solutions


Limitation too many candidates l.jpg
Limitation: Too Many Candidates

Overlapping…

 Constraint switching interface

  • Visualize conflicting constraints

  • Enable manual switching

  • Challenges

    • How to detect conflicting constraints efficiently?


  • Limitation forgets constraints l.jpg
    Limitation: Forgets Constraints

     Remember constraints

    • Maintain them during manipulation

    • Chorus [Hosobe 2001]

    Skewed 

    Stretch!

    Stretch!


    Outline55 l.jpg
    Outline

    1. Problem

    2. Our Idea & Demonstration

    3. Related Work

    4. Algorithm

    5. Evaluation

    6. Ongoing Study

    7. Summary


    Summary l.jpg
    Summary

    • Pegasus: freehand drawing system

      • User study showed promising results

    • Geometric constraints play an important role in sketch beautification

    • Further improvements to be made


    Thank you l.jpg
    Thank you

    • Papers & demos available at

      http://www-ui.is.s.u-tokyo.ac.jp/


    ad