150 likes | 283 Views
This research project explores the creation of image mosaics in real-time, enabling users to stitch images from different viewpoints seamlessly. We focus on finding a transformation that minimizes errors between two images, whether from a planar scene or arbitrary orientations. Using innovative techniques, including hardware-accelerated texture mapping and hierarchical algorithms, we achieve interactive image processing. Our results showcase full panoramic views and demonstrate the project's potential in creating engaging visual experiences with optimized transforms in real-time.
E N D
Real-Time Image Mosaicing --Research Project for 15-869, Nov 29, 1999 Li Zhang
Image Mosaicing • Stitching together images taken from different viewpoints seamlessly • Representation: cylindrical, spherical, and perspective panoramas
Problem Statement • Given two images I0 and I1 of a scene, find a transform T that minimizes
Special cases • If the scene is planar, and I0 and I1are taken from different viewpoints with different orientation, • If the scene is arbitrary, and I0 and I1are taken from same viewpoint with different orientation, T is a planar perspective transform M
My work • Given two images I0 and I1 of a scene, find a transform M that minimizes • Search M interactively in real-time
Algorithm Details(1) • Given I0, I1 and current M,we iteratively update M using • We wish D to minimize
Algorithm Details(2) • We warp I1 into I1’ such that • We instead wish D to minimize
Acceleration Details(1) • We find d by solving a least-square minimization problem with following acceleration techniques: • Approximate the Jacobian as
Acceleration Details(2) • Warp I1’ from I1using hardware-accelerated texture mapping; • Perform minimization hierarchically using OpenGL Mipmaps.
Results(1) • Real images of University Center Mural
Results(2) • Full view panorama of UC Mural
Summary(1) • Good features: • Users can interactively create image mosaics in real-time • The transform is locally optimized
Summary(2) • 8-parameter transform sometimes get stuck in local minimum • The size of image is limited by frame buffer
Reference • R. Szeliski and H.-Y. Shum. Creating full view panoramic image mosaics and texture-mapped models. Computer Graphics (SIGGRAPH'97), pages 251-258, August 1997.