1 / 18

Centre for Vision, Speech & Signal Processing

Centre for Vision, Speech & Signal Processing. Adrian Hilton - Director CVSSP Professor of Computer Vision & Graphics Professor of Computer Vision & Graphics. CVSSP. Research Focus: Multidimensional signal processing, interpretation and understanding

alva
Download Presentation

Centre for Vision, Speech & Signal Processing

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Centre for Vision, Speech & Signal Processing • Adrian Hilton - Director CVSSP • Professor of Computer Vision & Graphics • Professor of Computer Vision & Graphics

  2. CVSSP • Research Focus: • Multidimensional signalprocessing, interpretation and understanding • Signals: audio, speech, images, video, stereo, 3D video, • 3D medical images, 4D sequences • Founded in 1986 by Prof. Josef Kittler FREng. • 110 people (15 academics, 30 post-docs, 65 PhDs) • Top ranking in RAE 2008 assessment (Elec.Eng.) • Grant portfolio £8.5M, Annual turnover £4.5M • Research funding: EPSRC, EU, TSB, Industry, Charity

  3. CVSSP Structure A-lab: Machine Audition V-Lab: Visual Media ImagiCommunication B-Lab: Biometrics 3 4 Core Science Signal Processing Image & Video Processing Pattern Recognition Computer Vision Machine Learning Graphics M-Lab: Medical Imaging Communication C-Lab: Cognitive Vision I-Lab: Multimedia Communications

  4. A-lab: Machine Audition • Dr. Philip Jackson • Dr. Wenwu Wang • Institute of Music and Sound Recording • Audio perception • Audio search & retrieval • Blind source separation • 3D sound modelling • Speech modelling • Quality assessment • Audio-visual signal processing • Sparse signal processing • BBC Audio Partnership: 5 year strategic partnership in 3D audio-visual production • Questral: Quantitative measures for spatial audio perception (EPSRC) • Dynamic Faces: Understanding facial dynamics during speech (EPSRC) • Audio and visual speech separation (EPSRC/DSTL) • In car cross-talk separation in spatial audio (B&O) • Collaborators: BBC, Bang&Olufsen, Sony spatial audio audio signatures audio-visual speech modelling

  5. B-Lab: Biometrics BiometricsSecurity • Prof. Josef Kittler, Dr. Bill Christmas • Novel solutions to biometric authentication • Face recognition • Face verification • Multimodal biometrics • Classifier fusion • 3D biometrics • Surveillance • EU projects: • Banca, biosecure,xm2vts voice lips Spin-out company (2001) 3D face recognition

  6. C-Lab: Cognitive Vision • Prof. Richard Bowden, Prof. John Illingworth • Learning to understand human motion in video • human motion analysis • face tracking • sign-language recognition • gesture recognition • social signal processing • visual interaction • surveillance • Projects: • Learning to Recognise Dynamic Visual Content (EPSRC) • DictaSign sign-language to sign-language interpretation(EU) • LiLiR Language independent lip reading (EPSRC) • Diplex Dynamic perception action learning (EU) sign-language recognition face tracking people detection

  7. I-Lab: Multimedia Communications • Prof. Ahmet Kondoz, Dr. Janko Calic, Dr. Anil Fernando • Innovative ways to use multimedia & communication to improve the way we live, work & play • Audio-visual coding & transmission • Stereo 3D video coding • Multimedia communication • Real-time remote collaboration • Quality of experience in multimedia system • Projects: • ROMEO Integrated project in multimedia coms. (EU IP) • VISNET Networked audio-visual media technology(EU) • Diomedes Delivery of 3D immersive entertainment (EU) End-to-end multimedia communication Remote collaboration

  8. M-Lab: Medical Imaging • Dr. Kevin Wells, Dr. Emma Lewis • 3D volumetric image analysis • Dynamic 3D image analysis • Abnormality detection • Partial volume quantification • Movement correction with 3D video • Next generation medical imaging sensors • Identification of rare cells for cancer detection • Projects: • Optimam - optimal digital imaging for UK breast screening (Cancer Research UK) • MI3 - CMOS imaging for biomedical applications (EPSRC) • Motion correction in medical imaging to correct for respiration (EPSRC) Abnormalities due to Alzheimer’s

  9. V-Lab: Visual Media • Prof. Adrian Hilton, Dr. John Collomosse, Dr. Krystian Mikolajczyk • Enabling technologies for next generation communication & entertainment • Visual content production • Audio-visual search and retrieval • Visual interaction & communication • 3D and free-viewpoint video • Visual content analysis • Video-based animation production • Human shape & motion analysis • Film, broadcast and interactive entertainment, fashion, biomechanics • Visual Media Platform Grant (EPSRC) • BBC Audio-Visual Partnership - audio-visual 3D media production • Body shape recognition for online fashion (EPSRC) • RE@CT - Production and delivery of interactive 3D content (EU) • SCENE - Novel scene representation for 3D media (EU) • SyMMM - Onset metadata in movie production (TSB) • VBAP - Video-based animation production (EPSRC) • Collaborators: BBC, Sony, Framestore, DNeg, The Foundry, Filmlight, Vicon, Bodymetrics Free-viewpoint video 3D video video stylisation object tracking visual search

  10. CVSSP Labs-Themes

  11. CVSSP Theme-Expertise

  12. CVSSP Scientific Achivement • Best papers: • Int.Conf, on Pattern Recognition (ICPR) Biometrics and HCI 2010 • IEEE Int.Conf. on Human System Interaction (HSI) 2010 • BBC Best Paper Awards European Conference on Visual Media Production 2009 • Highest cited paper, journal Computer Vision & Image Understanding 2007-10 A.Hilton • Pattern Recognition Society ‘Best Journal Paper Award’ Prof.A.Hilton • IEE J.Langham Best Journal Paper Award - Prof.J.Illingworth, A.Hilton • Awards: • UK ICT Pioneers “Technology Everywhere” winner - Zdenek Kalal • IEEE Chester Sall Award 2011 winner - Veruna DeSilva • European Biometric Industry Achievement winner - Bud Goswami • BTAS 2010 Best Paper Award winner - Bud Goswami • Int. Association of Pattern Recognition KS Fu Award - Prof.J.Kittler • MoD Grand Challenge best innovation award - Dr. K.Mikolajczyk • Visual object challenge 2010 best results - Dr.K.Mikolajczyk • Royal Television Society Communications Award - Prof. A.Kondoz • EU ICT Prize Awards for ModelMaker, Avatar-Me - Prof. A.Hilton • Universities UK 100 discoveries of life-changing reasearch over 50 years • 35. The development of a laser scanner for 3D objects • >20 Invited key-note presentations at International Conferences (2006-present)

  13. CVSSP Funding • Current grant portfolio £8.5M (EPSRC, EU, TSB, industry) • EPSRC grant portfolio £4.5M • EU projects Cognitive Systems and ICT £3M • Industry funding £0.8M • EPSRC Visual Media platform grant 2003-2013 • EPSRC Basic Technology grant in Medical Imaging • JISC/SRIF Infrastructure for HD imaging £4.5M (2001,2003) • CVSSP annual turnover £4.5M

  14. CVSSP Facilities • HD multi-camera digital film studio 100m2 • 8 x Thomson Viper cameras • HD multi-camera portable capture system • 16 x Canon G1 HD-SDI cameras • DVS 24TB HD-SDI video storage • Marker-based human motion camera • Coda-motion 56 active marker system • 4D dynamic face capture • 3DMD video-rate shape & appearance • Sound proof booth for • Esmono • 3D display (stereo, multi-view, holographic) • Panasonic, JVC, Holographica • Video processing & storage • 300TB storage, 200 processing cores

  15. CVSSP Impact • People: • PhD level researchers (10-15/annum) • Employed in industry & academia • Social: • technologies for identity verification and security • medical image analysis to diagnose abnormalities • technologies for natural interaction & communication • access to creative archives (dance, BBC, film) • Economic: • collaboration with UK industry • technology transfer via licensing • 3 spinout companies

  16. CVSSP Technology Transfer OmniPerception Founded in 2001 to exploit Face Recognition technology Imagineer Systems Founded in 2003 to exploit 2D-3D video editing technology MulSys Founded in 2003 to exploit multimedia communications, wireless 2D/3D media AvatarMe Startup ModelMaker 3DScanner Technology licensed to 3D Scanners UK Ltd. Technology for human shape from images EU IST Grand Prize EU IST Innovation Prize Manufacturing Industry Design Product of the Year

  17. CVSSP Collaborators Visiting researchers: BBC, NHK

  18. CVSSP • One of the largest computer vision & multimedia signal processing groups in the UK • Internationally recognised for excellence in research • numerous best-papers, awards, key-notes • Strong collaborative research with UK industry • transfer of people to industry • 3+ spin-out companies • technology transfer • face recognition (OmniPerception) • 3D shape capture & modelling (3D Scanners) • dynamic 4D face capture (3DMD, Framestore) • visual search (BBC) • free-viewpoint video in sports (BBC) • multi-view video analysis (BBC,The Foundry, Framestore) • stereo 3D production from 2D cameras (BBC,The Foundry)

More Related