Animating chinese landscape paintings and panoramas
Advertisement
This presentation is the property of its rightful owner.
1 / 40

Animating Chinese Landscape Paintings and Panoramas PowerPoint PPT Presentation

Animating Chinese Landscape Paintings and Panoramas

Related searches for Animating Chinese Landscape Paintings and Panoramas

Download Presentation

Animating Chinese Landscape Paintings and Panoramas

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Animating chinese landscape paintings and panoramas

Animating Chinese Landscape Paintings and Panoramas

By

Nelson Siu-Hang CHU

Department of Computer Science

The Hong Kong University of Science and Technology


Outline

Outline

  • Introduction

  • Motivations

  • Two IBMR Approaches

    • Multi-Perspective Modeling

    • Baseline Extrusion

  • An Improved Graphical User Interface

  • Conclusions

Computer Science Department

Hong Kong University of Science and Technology


Introduction

Introduction

  • Image Based Modeling & Rendering (IBMR)

    • Pre-acquired images -> novel views

Computer Science Department

Hong Kong University of Science and Technology


Introduction cont

Introduction (cont.)

  • Image Based Modeling & Rendering (IBMR)

    • Advantages:

      • Realism with less computation

      • Computation independent of scene complexity

    • Disadvantage:

      • Number of images needed is large, in general

    • Success in film industry

      • e.g. The Matrix [SoftImage Magazine Aug. ’99]

Computer Science Department

Hong Kong University of Science and Technology


Introduction cont1

Introduction (cont.)

  • Tour Into the Picture (TIP) [HAA97]

    • “Visually 3D” animation from a single image

    • Easy-to-use graphical user interface (GUI)

    • Good results in relatively short time

    • Works especially well for inputs of paintings

Computer Science Department

Hong Kong University of Science and Technology


Motivation

Motivation

  • Impressive results using the TIP technique

TIP

By Hoi Ng 1982

Computer Science Department

Hong Kong University of Science and Technology


Animating chinese landscape paintings and panoramas

Motivation (cont.)

  • Chinese landscape paintings

    • Horizontal or vertical scrolls

from Mustard Seed Garden Painting Manual,

revised version by Ch’ao Hsun, 1887

Computer Science Department

Hong Kong University of Science and Technology


Animating chinese landscape paintings and panoramas

Multiple Perspectives in Chinese Landscape Paintings

Eye locations

Computer Science Department

Hong Kong University of Science and Technology


Motivation cont

Motivation (cont.)

  • Fixed-point perspective

    • As in photographs or western paintings

    • At most a spherical panorama

    • Space depicted is limited

  • Moving-point perspective

    • As in Chinese landscape painting or multi-perspective images e.g. in [WFH+97]

    • Space NOT limited

  • Goal: Model and animate multi-perspective images

Computer Science Department

Hong Kong University of Science and Technology


Motivation cont1

Motivation (cont.)

  • Panorama

    • Compact representation

    • Easy to produce

    • Cost effective for virtual reality (VR)

Computer Science Department

Hong Kong University of Science and Technology


Motivation cont2

Motivation (cont.)

  • Panorama Viewer

    • Camera pan, zoom, tilt only

    • Fixed viewpoint – we can’t move

  • VR techniques giving better VR experience exist, but too costly:

    • Special hardware

    • Large input data

So, it’s valuable if can enhance immersive effect of panorama without much increase in production and computational costs

Computer Science Department

Hong Kong University of Science and Technology


Outline1

Outline

  • Introduction

  • Motivations

  • Two IBMR Approaches

    • Multi-Perspective Modeling

    • Baseline Extrusion

  • An Improved Graphical User Interface

  • Conclusions

Computer Science Department

Hong Kong University of Science and Technology


The tip technique

The TIP Technique

Computer Science Department

Hong Kong University of Science and Technology


First approach multi perspective modeling mpm

Sub-scene 1

Sub-scene 2

First Approach: Multi-Perspective Modeling (MPM)

  • Solution: introduce local and global models; switch them smoothly

  • TIP is not applicable for multi-perspective images:

    • horizons at different levels

    • multiple cavities

Computer Science Department

Hong Kong University of Science and Technology


Animating chinese landscape paintings and panoramas

  • Rectangle

  • Cylinder

  • Sphere

MPM: Global Modeling

  • Global model

Computer Science Department

Hong Kong University of Science and Technology


Animating chinese landscape paintings and panoramas

  • A box model as in TIP

  • Foreground objects as “billboards”

MPM: Sub-scene Modeling

  • Local model for a sub-scene

Computer Science Department

Hong Kong University of Science and Technology


Mpm system overview

Pre-processing

Digitize the input image

Modeling

Model back-ground using TIP interface

Identify

sub-scenes

Prepare:

Foreground mask

Background image

Select a global model

Build billboards for foreground objects from mask

Rendering

Record animation key-frames

Generate smooth camera path

Render & output animation

MPM: System Overview

For each sub-scene

Computer Science Department

Hong Kong University of Science and Technology


Mpm model switching

MPM: Model Switching

Scene entry

points

Computer Science Department

Hong Kong University of Science and Technology


Panorama as input

Panorama as Input

Sub-scene 2

Sub-scene 1

Computer Science Department

Hong Kong University of Science and Technology


Mpm model switching1

MPM: Model Switching

Computer Science Department

Hong Kong University of Science and Technology


Animation results

Animation Results

  • Painting “Fishing village in mild snow”

  • Real scene “HKUST Piazza”

Computer Science Department

Hong Kong University of Science and Technology


Outline2

Outline

  • Introduction

  • Motivations

  • Two IBMR Approaches

    • Multi-Perspective Modeling

    • Baseline Extrusion

  • An Improved Graphical User Interface

  • Conclusions

Computer Science Department

Hong Kong University of Science and Technology


Second approach baseline extrusion

Second Approach: Baseline Extrusion

  • Targets at panoramic inputs

  • Builds a unified model

  • Assumptions

    • A fixed viewpoint (panorama)

    • A flat ground is present in the scene

Computer Science Department

Hong Kong University of Science and Technology


Second approach baseline extrusion1

Baseline

Second Approach: Baseline Extrusion

  • Main Idea:

    • user draws “baselines” on perspective views of the input image to indicate positions and orientations of billboards

    • Extrude the baselines to form billboards

Computer Science Department

Hong Kong University of Science and Technology


Second approach baseline extrusion2

Second Approach: Baseline Extrusion

  • Basically two types:

    • Indoor: man-made structures

    • Outdoor: usually a sky is captured

Computer Science Department

Hong Kong University of Science and Technology


Longitude and latitude coordinates

Longitude and latitude coordinates

  • Input image represented as a spherical surface, with polar coordinates (, )

Radius=1

o

Computer Science Department

Hong Kong University of Science and Technology


Calculation of billboard positions from baseline

By considering OBV’ and OAV,

Calculation of billboard positions from baseline

Computer Science Department

Hong Kong University of Science and Technology


Sample structure inferred from a baseline

Sample structure inferred from a baseline

Computer Science Department

Hong Kong University of Science and Technology


Baseline extrusion

Baseline

Baseline Extrusion

  • Billboard heights will be determined by:

    • Scanning mask image, or

    • Ceiling height

Computer Science Department

Hong Kong University of Science and Technology


Specific model component ceiling plane

Specific model component: Ceiling Plane

  • Define the ceiling height interactively:

Computer Science Department

Hong Kong University of Science and Technology


Animation result

Animation Result

  • Real scene “Chapel Quad”

Input panorama

Computer Science Department

Hong Kong University of Science and Technology


Outline3

Outline

  • Introduction

  • Motivations

  • Two IBMR Approaches

    • Multi-Perspective Modeling

    • Baseline Extrusion

  • An Improved Graphical User Interface

  • Conclusions

Computer Science Department

Hong Kong University of Science and Technology


Graphical user interface gui improvement perspective grids

Perspective Grids

Graphical User Interface(GUI) Improvement: Perspective Grids

In TIP, a good GUI is the key!

Spidery mesh

Computer Science Department

Hong Kong University of Science and Technology


Deriving model from a spidery mesh

45°

Deriving model from a spidery mesh

Computer Science Department

Hong Kong University of Science and Technology


Drawing perspective grids

45-degree

vanishing point

Straight-ahead

vanishing point

Horizon

Drawing Perspective Grids

Computer Science Department

Hong Kong University of Science and Technology


Perspective grids user operations

Perspective Grids: User operations

Computer Science Department

Hong Kong University of Science and Technology


Advantages of perspective grids

Advantages of perspective grids

  • Visual modeling

    • Show a better sense of depth

    • Intuitively estimate the shape of the model

    • Tool for non-technical users – knowledge of field-of-view or focal length not required!

  • Draw the grids using 2D geometry

    • Real-time feedback guaranteed

Computer Science Department

Hong Kong University of Science and Technology


Conclusions

Conclusions

  • Proposed two approaches for producing animations

    • From a single image with multiple perspectives

    • From a panorama

  • As extensions of TIP

    • Tour into images of higher spatial complexity

    • Produce longer animations to make it more entertaining

  • As extensions of panorama viewing

    • Produce animations of higher immersive effect

    • Reasonable cost

Computer Science Department

Hong Kong University of Science and Technology


Conclusions cont

Conclusions (cont.)

  • Limitations of our IBMR approaches

    • Navigation limited by geometry and texture information captured by the input image

    • Multi-Perspective Modeling

      • Some constrained nodes in animation path

      • Not suitable for free navigation

    • Baseline Extrusion

      • Currently vertical billboards only

      • Modeling inclined surfaces & complex objects left as future work

  • Proposed a minor GUI improvement

Computer Science Department

Hong Kong University of Science and Technology


Questions

Questions?


  • Login