1 / 27

Image-processing Technologies for Digital Content Creation

Image-processing Technologies for Digital Content Creation. Luc.robert@autodesk.com. CORPORATE INFORMATION. REALVIZ: Founded March 98 Exclusive technology from INRIA Sophia-Antipolis Technology from the Robotvis group Headquarters and R&D in Sophia Antipolis, Southern France

keanu
Download Presentation

Image-processing Technologies for Digital Content Creation

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Image-processing Technologies for Digital Content Creation Luc.robert@autodesk.com

  2. CORPORATE INFORMATION REALVIZ: Founded March 98 Exclusive technology from INRIA Sophia-Antipolis • Technology from the Robotvis group Headquarters and R&D in Sophia Antipolis, Southern France 90% of revenue outside France, 50% in the USA Just acquired by Autodesk (PSEB division)

  3. MISSION Image-based technologies empower designers and graphic artists to efficiently create the most effectivevisual content based on digital photographs and videos. Post-production Multimedia Digital Imaging Architecture CAD Video Games Dinotopia - Courtesy of Framestore CFC Monkey – Courtesy of Quiet Man

  4. USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture

  5. PANORAMIC PHOTOGRAPHY Panoramic Photography

  6. IMAGE STITCHING Creation of panoramic images up to full spheres (360° horizontal by 180° vertical) – fully automatic Thousands users : professional photographers, digital imaging hobbyists, multimedia & web designers, architects, post-production artists

  7. FULL SPHERICAL PANORAMAS Click inside to see the full screen, full spherical QuickTime VR Panorama Courtesy of VR Way

  8. USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture

  9. IMAGE BASED MODELING Bridging the gap between 2D and 3D Image Based Modeling

  10. IMAGE BASED MODELING Creation of 3D photo-textured objects from photographs (1 to many) Applications • Virtual reality: 3D Simulation/Storytelling • Urban planning & perspective matching for 3D CAD models • Photogrammetry • Video games • 3D animation & special effects

  11. From stills… … for photo-realistic 3D models ! … calibrated in 3D from the manual placement of matching points … IMAGE BASED MODELING

  12. … to a photo-realistic 3D environment ! From a panorarma or a still picture… IMAGE BASED MODELING … more demos

  13. USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture

  14. SPECIAL EFFECTS SFX Solutions

  15. CAMERA TRACKING Before… … After Camera path & 3D points extracted with MatchMover 3D content Rendered in 3D animation software Click inside to see the movie. Click inside to see the movie. Click inside to see the movie. Courtesy of Platige Image 2005 Click inside to see the movie. Courtesy of Platige Image 2005

  16. CAPTURING 3D RIGID MOTION • Feature points are extracted and tracked across sequences • Based on parallax and rigidity (epipolar geometry), the algorithm extracts: • Camera path and parameters (zoom, distortion) over time • 3D point coordinates • Ready for 2D/3D video-montage… all in one click!

  17. SOME MOVIES

  18. USE CASES Panoramic Photography Image Based Modeling SFX Solutions Motion Capture

  19. MOTION CAPTURE Motion Capture

  20. VIDEO-BASED MOCAP Capture non-rigid 3D motion from several videos

  21. VIDEO-BASED MOCAP Video-based motion capture solution Applications: animation, bio-medical, ergonomy…etc Covering facial, full body, and on-set mocap Total flexibility • From 2 cameras to as many as needed • Cameras can fixed or moving. • Cameras can be of different frame rate and different definitions. • No need for a motion capture studio Computed data • Tracked 3D points • Camera data

  22. VIDEO-BASED MOCAP

  23. MATCHMOVING FROM RIGID MOTION… One moving camera observing a rigid scene : Parallax (i.e relative 2D image motion) allows recovering 3D camera motion and scene structure N 1 ..t..

  24. Time 1 Cam3 Cam1 Cam2 Time N Cam1 Cam3 Cam2 • Bonus: We can handle camera motion as well! … TO NON-RIGID MOTION • Several synchronous cameras are used • Same geometric problem as matchmoving at each time

  25. VIDEO-BASED MOCAP …Result

  26. ON-SET MOCAP • All sequences shot with • - 2 fixed cameras: HD digital (1920x1080) • 1 mobile camera (the main shooting cam): film, scanned at 2048x1536 …Result

  27. Q&A

More Related