Animating chinese landscape paintings and panoramas
Download
1 / 40

Animating Chinese Landscape Paintings and Panoramas - PowerPoint PPT Presentation


  • 808 Views
  • Updated On :

Animating Chinese Landscape Paintings and Panoramas

Related searches for Animating Chinese Landscape Paintings and Panoramas

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'Animating Chinese Landscape Paintings and Panoramas' - bajeesh


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Animating chinese landscape paintings and panoramas

Animating Chinese Landscape Paintings and Panoramas

By

Nelson Siu-Hang CHU

Department of Computer Science

The Hong Kong University of Science and Technology


Outline
Outline

  • Introduction

  • Motivations

  • Two IBMR Approaches

    • Multi-Perspective Modeling

    • Baseline Extrusion

  • An Improved Graphical User Interface

  • Conclusions

Computer Science Department

Hong Kong University of Science and Technology


Introduction
Introduction

  • Image Based Modeling & Rendering (IBMR)

    • Pre-acquired images -> novel views

Computer Science Department

Hong Kong University of Science and Technology


Introduction cont
Introduction (cont.)

  • Image Based Modeling & Rendering (IBMR)

    • Advantages:

      • Realism with less computation

      • Computation independent of scene complexity

    • Disadvantage:

      • Number of images needed is large, in general

    • Success in film industry

      • e.g. The Matrix [SoftImage Magazine Aug. ’99]

Computer Science Department

Hong Kong University of Science and Technology


Introduction cont1
Introduction (cont.)

  • Tour Into the Picture (TIP) [HAA97]

    • “Visually 3D” animation from a single image

    • Easy-to-use graphical user interface (GUI)

    • Good results in relatively short time

    • Works especially well for inputs of paintings

Computer Science Department

Hong Kong University of Science and Technology


Motivation
Motivation

  • Impressive results using the TIP technique

TIP

By Hoi Ng 1982

Computer Science Department

Hong Kong University of Science and Technology


Motivation (cont.)

  • Chinese landscape paintings

    • Horizontal or vertical scrolls

from Mustard Seed Garden Painting Manual,

revised version by Ch’ao Hsun, 1887

Computer Science Department

Hong Kong University of Science and Technology


Multiple Perspectives in Chinese Landscape Paintings

Eye locations

Computer Science Department

Hong Kong University of Science and Technology


Motivation cont
Motivation (cont.)

  • Fixed-point perspective

    • As in photographs or western paintings

    • At most a spherical panorama

    • Space depicted is limited

  • Moving-point perspective

    • As in Chinese landscape painting or multi-perspective images e.g. in [WFH+97]

    • Space NOT limited

  • Goal: Model and animate multi-perspective images

Computer Science Department

Hong Kong University of Science and Technology


Motivation cont1
Motivation (cont.)

  • Panorama

    • Compact representation

    • Easy to produce

    • Cost effective for virtual reality (VR)

Computer Science Department

Hong Kong University of Science and Technology


Motivation cont2
Motivation (cont.)

  • Panorama Viewer

    • Camera pan, zoom, tilt only

    • Fixed viewpoint – we can’t move

  • VR techniques giving better VR experience exist, but too costly:

    • Special hardware

    • Large input data

So, it’s valuable if can enhance immersive effect of panorama without much increase in production and computational costs

Computer Science Department

Hong Kong University of Science and Technology


Outline1
Outline

  • Introduction

  • Motivations

  • Two IBMR Approaches

    • Multi-Perspective Modeling

    • Baseline Extrusion

  • An Improved Graphical User Interface

  • Conclusions

Computer Science Department

Hong Kong University of Science and Technology


The tip technique
The TIP Technique

Computer Science Department

Hong Kong University of Science and Technology


First approach multi perspective modeling mpm

Sub-scene 1

Sub-scene 2

First Approach: Multi-Perspective Modeling (MPM)

  • Solution: introduce local and global models; switch them smoothly

  • TIP is not applicable for multi-perspective images:

    • horizons at different levels

    • multiple cavities

Computer Science Department

Hong Kong University of Science and Technology


  • Cylinder

  • Sphere

MPM: Global Modeling

  • Global model

Computer Science Department

Hong Kong University of Science and Technology


  • Foreground objects as “billboards”

MPM: Sub-scene Modeling

  • Local model for a sub-scene

Computer Science Department

Hong Kong University of Science and Technology


Mpm system overview

Pre-processing

Digitize the input image

Modeling

Model back-ground using TIP interface

Identify

sub-scenes

Prepare:

Foreground mask

Background image

Select a global model

Build billboards for foreground objects from mask

Rendering

Record animation key-frames

Generate smooth camera path

Render & output animation

MPM: System Overview

For each sub-scene

Computer Science Department

Hong Kong University of Science and Technology


Mpm model switching
MPM: Model Switching

Scene entry

points

Computer Science Department

Hong Kong University of Science and Technology


Panorama as input
Panorama as Input

Sub-scene 2

Sub-scene 1

Computer Science Department

Hong Kong University of Science and Technology


Mpm model switching1
MPM: Model Switching

Computer Science Department

Hong Kong University of Science and Technology


Animation results
Animation Results

  • Painting “Fishing village in mild snow”

  • Real scene “HKUST Piazza”

Computer Science Department

Hong Kong University of Science and Technology


Outline2
Outline

  • Introduction

  • Motivations

  • Two IBMR Approaches

    • Multi-Perspective Modeling

    • Baseline Extrusion

  • An Improved Graphical User Interface

  • Conclusions

Computer Science Department

Hong Kong University of Science and Technology


Second approach baseline extrusion
Second Approach: Baseline Extrusion

  • Targets at panoramic inputs

  • Builds a unified model

  • Assumptions

    • A fixed viewpoint (panorama)

    • A flat ground is present in the scene

Computer Science Department

Hong Kong University of Science and Technology


Second approach baseline extrusion1

Baseline

Second Approach: Baseline Extrusion

  • Main Idea:

    • user draws “baselines” on perspective views of the input image to indicate positions and orientations of billboards

    • Extrude the baselines to form billboards

Computer Science Department

Hong Kong University of Science and Technology


Second approach baseline extrusion2
Second Approach: Baseline Extrusion

  • Basically two types:

    • Indoor: man-made structures

    • Outdoor: usually a sky is captured

Computer Science Department

Hong Kong University of Science and Technology


Longitude and latitude coordinates
Longitude and latitude coordinates

  • Input image represented as a spherical surface, with polar coordinates (, )

Radius=1

o

Computer Science Department

Hong Kong University of Science and Technology


Calculation of billboard positions from baseline

By considering OBV’ and OAV,

Calculation of billboard positions from baseline

Computer Science Department

Hong Kong University of Science and Technology


Sample structure inferred from a baseline
Sample structure inferred from a baseline

Computer Science Department

Hong Kong University of Science and Technology


Baseline extrusion

Baseline

Baseline Extrusion

  • Billboard heights will be determined by:

    • Scanning mask image, or

    • Ceiling height

Computer Science Department

Hong Kong University of Science and Technology


Specific model component ceiling plane
Specific model component: Ceiling Plane

  • Define the ceiling height interactively:

Computer Science Department

Hong Kong University of Science and Technology


Animation result
Animation Result

  • Real scene “Chapel Quad”

Input panorama

Computer Science Department

Hong Kong University of Science and Technology


Outline3
Outline

  • Introduction

  • Motivations

  • Two IBMR Approaches

    • Multi-Perspective Modeling

    • Baseline Extrusion

  • An Improved Graphical User Interface

  • Conclusions

Computer Science Department

Hong Kong University of Science and Technology


Graphical user interface gui improvement perspective grids

Perspective Grids

Graphical User Interface(GUI) Improvement: Perspective Grids

In TIP, a good GUI is the key!

Spidery mesh

Computer Science Department

Hong Kong University of Science and Technology


Deriving model from a spidery mesh

45°

Deriving model from a spidery mesh

Computer Science Department

Hong Kong University of Science and Technology


Drawing perspective grids

45-degree

vanishing point

Straight-ahead

vanishing point

Horizon

Drawing Perspective Grids

Computer Science Department

Hong Kong University of Science and Technology


Perspective grids user operations
Perspective Grids: User operations

Computer Science Department

Hong Kong University of Science and Technology


Advantages of perspective grids
Advantages of perspective grids

  • Visual modeling

    • Show a better sense of depth

    • Intuitively estimate the shape of the model

    • Tool for non-technical users – knowledge of field-of-view or focal length not required!

  • Draw the grids using 2D geometry

    • Real-time feedback guaranteed

Computer Science Department

Hong Kong University of Science and Technology


Conclusions
Conclusions

  • Proposed two approaches for producing animations

    • From a single image with multiple perspectives

    • From a panorama

  • As extensions of TIP

    • Tour into images of higher spatial complexity

    • Produce longer animations to make it more entertaining

  • As extensions of panorama viewing

    • Produce animations of higher immersive effect

    • Reasonable cost

Computer Science Department

Hong Kong University of Science and Technology


Conclusions cont
Conclusions (cont.)

  • Limitations of our IBMR approaches

    • Navigation limited by geometry and texture information captured by the input image

    • Multi-Perspective Modeling

      • Some constrained nodes in animation path

      • Not suitable for free navigation

    • Baseline Extrusion

      • Currently vertical billboards only

      • Modeling inclined surfaces & complex objects left as future work

  • Proposed a minor GUI improvement

Computer Science Department

Hong Kong University of Science and Technology



ad