What Does the Scene Look Like From a Scene Point?. M. Irani, T. Hassner, and P. Anandan ECCV 2002. Donald Tanguay August 7, 2002. Overview. Categorization of novel view synthesis Outline of approach Planar parallax formulation Synthesizing the virtual view Practical simplification Results
M. Irani, T. Hassner, and P. AnandanECCV 2002
Donald TanguayAugust 7, 2002
Breakdown into 3 categories:
Choose a scene point Vfrom which to look.
Black point in eachimage is the virtualepipole (image ofselected COP).
If projections were aligned, matching determines the correct color:
One camera is selected as the reference camera R.Projections of L in all other cameras will be mapped into R’s image.
Transform the line in C1 into R by the homographyinduced by the ground plane.
Geometrically, the homography displaces each pixel in Ci asthough the corresponding 3D point was on the ground plane.The “piercing point” always maps to the same point in R.
After plane alignment, the lines in the reference camera fanfrom the imaged piercing point to the virtual epipoles.
In R’s image plane, whatis the relationship betweenblue and red lines?
Given real epipoles ei and virtual epipoles vi: for any axis point pV,Mi is the projective transformation that brings each line li into alignment with lR.
Hsyn is the homography between the
synthesized view and the reference view R.
In an uncalibrated setting, the position of the virtual
camera can be specified in several ways:
For each pixel p in the synthesized image: