1 / 18

vLab:Visual Media Research

vLab:Visual Media Research. Prof. Adrian Hilton Royal Society Industry Fellow Centre for Vision, Speech and Signal Processing University of Surrey. Visual Content Production. 3D shape capture. 3D people for games. 1996. 3D video face. 1999. 3D studio capture. 2003. 1999. 2005.

virginia-boyer
Download Presentation

vLab:Visual Media Research

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. vLab:Visual Media Research Prof. Adrian Hilton Royal Society Industry Fellow Centre for Vision, Speech and Signal Processing University of Surrey

  2. Visual Content Production 3D shape capture 3D people for games 1996 3D video face 1999 3D studio capture 2003 1999 2005 3D video sports 2007 3D video people 4D video 3D video live-action 2009 2011 Stereo 3D videometrics

  3. 3D Studio Production Highly realistic animated models of actors Collaboration:BBC, Sony, The Foundry Funding: EPSRC, TSB, EU Multi-view Video Animation Shape Reconstruction

  4. 4D Performance Capture – global alignment

  5. 4D Interactive Animation

  6. iview: Free-viewpoint Video in Sports Production Free-viewpoint video for production of live sports events Editorial value - on pitch views: referee or player - offside decisions in football - goal decisions Production requirements - broadcast video quality - action replay Lead partner: BBC Collaborators: Hawkeye, Snell&Wilcox Funding: TSB/EPSRC Challenges: - large areas (football pitch) - uncontrolled illumination - wide-baseline views (8-12 match cameras) - broadcast quality iview project: BBC R&D, S&W, Hawkeye Objective: Free-viewpoint video for production of live sports events Methodology: Transfer model-free reconstruction from studio to outdoor Funding: DTI Technology Programme/EPSRC 2006-2009

  7. 3D Sports Production Is the player offside?

  8. 3D Sports Production IVIEW PIPELINE OPERATOR shot selection Capture Calibration 3D Reconstruction + matte refinement Rendering 2D Segmentation

  9. 3D Sports Production OFFSIDE?

  10. 3D Sports Production IVIEW PRODUCTION TRIALS Football:England European cup qualifiers - Wembley, Nov’07 Rugby: 6 Nations - Twickenham, Feb’08

  11. i3Dpost: Film & Games Post-Production Multiple view video in post-production Aims - Multi-view video to improve 2D video post-production - 3D video modelling of actors - 3D set modelling from images Production requirements - Real dynamic scenes - Improved post-production workflow Lead partner: The Foundry Collaborators: BUF, QD, Trinity, CERTH Funding: EU

  12. i3Dpost: Film & Games Post-Production

  13. i3Dlive: 3D Film and TV Production Stereo production of live action from multiple view video Aims - 3D video of ‘real’ scenes - Stereo 3D production - Video appearance editing using 3D Production requirements - Film quality stereo - Interactive editing and 3D production Lead partner: The Foundry Collaborators: BBC Funding: TSB/EPSRC

  14. i3Dlive: 3D Film and TV Production INPUT 3D VIDEO STEREO

  15. Digital Doubles Photo-realistic doubles of real actors for film production Funding: Royal Society Industry Fellowship (2008-12) Collaboration: Framestore

  16. Research Directions • 4D Video • Animation • Learning models of interaction • Recognition of human movement • Videometrics • Measurement of human motion • Performance analysis in sports • Body Shape • Measurement of body shape • Clinical analysis for obesity • Fashion for online retail

  17. Visual Media Research Group http://www.ee.surrey.ac.uk/CVSSP/VMRG Research Team Jean-Yves Guillemaut, Joe Kilner, James Edge, Hansung Kim, Phil Parsonage, Evren Imre, Ash Doshi, Takeshi Takai, Nat Nadtoka, Peng Huang, Peter Williams, Chris Budd, Mykyta Fastovets, Sarim Mohammed, Dan Casas, Magara, Tejera Collaborators BBC, Sony, Framestore, The Foundry, Snell&Wilcox, Blitz Games, Hawkeye, Rebellion, IKinema Funding EPSRC, TSB, EU, Royal Society, Industry Portfolio: £3.5M Industry support: £400K EPSRC Visual Media Platform Grant 2003-2013

More Related