1 / 27

MSR Cambridge Vision Group

Explore the latest advancements in image and video editing from MS Research Cambridge (MSRC), focusing on areas such as airbrushing history, video segmentation, object recognition, and real-time object recognition. Learn about technologies like PatchWorks, Clone, and Resynthesizer that enable efficient editing of visual content. Discover how machine learning is revolutionizing object recognition and visual search challenges.

azure
Download Presentation

MSR Cambridge Vision Group

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. MSR Cambridge Vision Group • Editing Images • Editing videos • Live video • Recognising objects • Remote collaboration

  2. Images and videos as first-class objects MS Research Cambridge (MSRC) -- Machine Learning and Perception Group

  3. Vacation fantasy

  4. Airbrushing history – in and out

  5. JetStream

  6. Interactive segmentation (Markov Random Field)

  7. Patchworks • Inpainting: smooth completion over small gaps, but slow • PatchWork: similar (a bit less smooth) to Inpainting, but fast... PatchWorks Inpainting

  8. Filling in large Holes • Inpainting: does not work • Resynthesizer (Gimp): 2’45’’ (computation) • Clone (PictureIt): 5’ (hand-labor) • PatchWork: 10’’ (computation) Clone Resynthesizer PatchWorks

  9. “Blindspot” filling: texture analysis and synthesis

  10. Demo: • Patchworks/Grabcut

  11. Image editing: autocollage

  12. From still images ... to video • Research challenge: analysing movement • Reacting to people • Making personal video manageable

  13. Why is visual search hard? What the computer sees What you see

  14. Cartoon collection -- Daimler-Benz ++

  15. Tracking motion with a cartoon “flip-book” • Application of (award winning) MSRC work on visual tracking

  16. Agile motion

  17. Demonstration: audiovisual tracking

  18. Stereo webcam conventional camera - zoomed out conventional camera - zoomed in Smart Framing - start Smart Framing - continue

  19. i2i project Prize-winning technology

  20. 3D object insertion into video

  21. 3D object insertion into video

  22. General object class recognition Learned visual dictionary - underlies image/video search - object sensitive image editing Machine Learning: Object recognition

  23. Real time object recognition

  24. The C-Slate Project

  25. Image segmentation applications to colonoscopy joint project (TCI) with U. Oxford Stereo imaging surgical visualisation, Papworth hospital Video tracking - echocardiographic analysis - joint PhD (ESI) with U. Oxford People: Andrew Blake, Antonio Criminisi, Carsten Rother, Victor Lempitsky. Medical Imaging Interests at MSRC

  26. Summary: MSRC Vision/Graphics • Images and videos: first-class citizens of the desktop • Image processing accessible for all users • Video: communication, remote collaboration, medicine • Research feeding into video and graphics products

More Related