from 3d scene geometry to human workspace n.
Download
Skip this Video
Loading SlideShow in 5 Seconds..
From 3D Scene Geometry to Human Workspace PowerPoint Presentation
Download Presentation
From 3D Scene Geometry to Human Workspace

Loading in 2 Seconds...

play fullscreen
1 / 14

From 3D Scene Geometry to Human Workspace - PowerPoint PPT Presentation


  • 105 Views
  • Uploaded on

From 3D Scene Geometry to Human Workspace. Authors: Abhinav Gupta, Scott Satkin , Alexei A. Efros and Martial Hebert The Robotics Institute, Carnegie Mellon University Presenter: Jiapei Zhang. Project Undertaking. Image if I were Abhinav

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about 'From 3D Scene Geometry to Human Workspace' - lloyd


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
from 3d scene geometry to human workspace

From 3D Scene Geometry to Human Workspace

Authors: Abhinav Gupta, Scott Satkin, Alexei A. Efros and Martial Hebert

The Robotics Institute, Carnegie Mellon University

Presenter: Jiapei Zhang

project undertaking
Project Undertaking
  • Image if I were Abhinav
  • I received a project from my boss about indoor scene understanding
selection of subject material at hand
Selection of SubjectMaterial at hand
  • A set of indoor-scene images
  • Motion Capture Database
  • No LiDAR scanner, not as rich as VCC, China
  • How I wish to be a VCCer one day

VCC

V5

selection of project inspirations from psychology
Selection of ProjectInspirations from Psychology
  • Where is the “entrance” of my novelty?
  • Where is the “Observer” for traditional

Image Understanding?

Put Human back to Image

  • Gestalt Psychologists: Objects are best defined not by their identity but rather by their function.

The meaning or a value of a thing

consist of what it affords.

-----JJ Gibson(1979)

“Affordance” “functionality”

selection of project shoulder of giants
Selection of ProjectShoulder of Giants
  • Bounding Box Level == Object Detection
  • Single-View Indoor Geometry Estimation
  • Human Pose Analysis via Motion Capture
selection of project give a final word
Selection of ProjectGive a Final Word
  • Propose a scene representation that combines 3D scene geometry with a set of possible human actions, to create a joint space of human-scene interactions.
  • Predict the full human workspace of the scene

Human Action

Modeling

3D Scene

Understanding

implementation detail representing scene geometry
Implementation DetailRepresenting Scene Geometry
  • An indoor scene is modeled by the layout of room(walls, floors, ceilings) and the location/layout of objects.
  • The objects are modeled by a set of occupied voxels.
implementation of detail qualitative human pose representation
Implementation of DetailQualitative Human Pose Representation
  • Each pose is represented by the occupied blocks in discretized 3D space(red) and the required surfaces of interaction(green).
implementation of detail human scene interactions
Implementation of DetailHuman-Scene Interactions
  • Constraints
  • Binary Occupancy Matrix
  • “Space Search” to fit “Constrains”

Free space constrain

Supportconstrain

retrospect and meditation
Retrospect and Meditation
  • Now return back to me
  • What useful info. for our Indoor-Scene Project I could extract from this paper ?
retrospect and meditation1
Retrospect and Meditation
  • Incorporate images to our projects

Will geometry estimation improve our rough mesh model?

  • Categorize “mobility” of scene into two:
  • Extract from Repetitions: Based on Geometry
  • Extract from “Human Pose”: Based on Functionality